1. Nancy Padian UC Berkeley
What IE is not and is not Male Circumcision Impact Evaluation Meeting Johannesburg, South Africa January 18-23, 2010
Nancy Padian
UC Berkeley

2. Traditional randomized “eficacy” controlled trials (RCTs)
Targets individuals or communities
evaluator directly controls implementation
Intensive in terms of cost, training
Implementation is perfect
Does not consider adherence, migration or other factors that might have diluted the effect
Efficacy/ highest internal validity (not real world)
10/17/2019

3. How is IE different from M&E?
M&E: Evaluating how a program is implemented
Is the program being implemented as designed?
Could the operations be more efficient?
Are the benefits getting to those intended?
Costing and accounting
Monitoring trends
Are indicators moving in the right direction?
No ability for intervention attribution
IE: Estimating the effect of the program

4. Question types and methods
M&E: monitoring & process evaluation
Is program being implemented efficiently?
Is program targeting the right population?
Are outcomes moving in the right direction?
Descriptive
analysis
Impact Evaluation:
What was the effect of the program on outcomes?
How would outcomes change under alternative program designs?
Is the program cost-effective?
Causal
analysis

5. Monitoring and Evaluation Results Pyramid
INPUTS
OUTPUTS
OUTCOMES
IMPACT
ALL
MOST
SOME
FEW
NUMBER OF PROJECTS
LEVELS OF EVALUATION EFFORTS
Source: UNAIDS, The World Bank. Monitoring and Evaluation Operations Manual. 2002

6. Monitoring and Evaluation Results Pyramid
INPUTS
OUTPUTS
OUTCOMES
IMPACT
ALL
MOST
SOME
FEW
NUMBER OF PROJECTS
Resources (fixed or mobile)
Staff
Funds
Supplies
Training
No. of procedures
Condom availability
Trained staff
Service quality
Short-term and intermediate effects:
Behavior change
STIs
Long-term effects:
HIV/AIDS
Mortality
Economic impact
POTENTIAL FOR RESULTS ATTRIBUTION
Source: UNAIDS, The World Bank. Monitoring and Evaluation Operations Manual. 2002

7. When to use M&E and when IE?
Is MC being delivered as planned?
Does outreach to women increase uptake?
What are the trends in HIV prevalence?
Does MC affect prevention behavior?
What is a precise estimate of MC effectiveness?
M&E IE
M&E IE IE