1. Planning for Evaluation
Gerjo Kok
Summer Course
2016

2. Planning QoL, Health: Behavior: Environment: Determinants of behavior:
Determinants of environment:
Evaluation: ?

3. Planning QoL, Health: HIV (prevention) Behavior: condom use
Environment: availability
Determinants of behavior: skills
Determinants of environment: costs
Evaluation: condom use

4. Planning QoL, Health: HIV (treatment) Behavior: HIV-drugs adherence
Environment: availability, costs
Determinants of behavior: costs
Determinants of environment: politics
Evaluation: easy access to HIV-drugs

5. Program Evaluation
Starts with planning
Important
Threatening

6. Effect Evaluation Does the program make a difference?
Quality of life
Health indicators
Behaviors
Environmental conditions
Program objectives
Intervention groups vs control group

7. Process Evaluation Was the program delivered as planned?
Why was it delivered as it was?
Was the program well-designed?
Intervention group only
Evaluation of IM Steps 3, 4 and 5

8. Efficiency Evaluation
Are the effects worth the money?
Cost-benefit, Cost-effectiveness
Input and output in terms of money
(Including costs of implementation)

9. Evaluation Map Effect evaluation Process evaluation
Implemen-
tation
Program
strategies
Change
objectives
Behavior
Health &
Quality of
Life
Step Step Step Step Step 1
Theories
for
methods
Environment

10. Write Evaluation Questions
Process
Who are the program participants?
Does program implementation match implementation planning?
Effect
What changes were achieved?

11. Develop Indicators and Measures
Define constructs
Look for measurable indicators for the constructs
Quantify indicators into measurement device

12. Indicators and Measures: Program Goals
Goal: increase in safe(r) sex
Indicators: condom use, reduction of new STD/HIV infections
Measures: self-reports (short-term), STD clinic monitoring (long term)

13. Indicators and Measures: Behavior
Performance objectives for behavior change as indicator for behavior
Carry condoms
Discuss condom use
Measures:
Self-report, checks
Questionaire items regarding actual or intended communicative behavior

14. Indicators and Measures: Determinants
Program objectives are blueprints for measurement
“After the program students can identify places where to buy condoms”
“After the program students express confidence in being able to negotiate condom use”

15. Indicators and Measures: Environment
Performance objectives for environmental change as indicator for environment
School management installs condom vending machines
Measures
Questionaire items
Observation
Sales figures

16. Specify Evaluation Design
Effect evaluation:
How do indicators compare before and after the program?
 pretest and posttest
Can we attribute changes to the program?
 random assignment, control group

17. Experimental group
Post-test

18. Intervention group
Pre-test
Post-test

19. Intervention group
Pre-test
Post-test

20. Experimental group
Control group
Pre-test
Post-test

21. Experimental group
Control group
Pre-test
Post-test

22. Experimental group
Control group
Pre-test
Post-test

23. Experimental group R
Control group
Pre-test
Post-test

24. Evaluation Plan
Evaluation questions, design, indicators, measurement, timing
Statistical analyses and presentation of results
Description of how the evaluation will be caried out