The Program Evaluation Cycle Module 3

2 Overview n Overview of the evaluation cycle n Major components of the cycle n Main products of an evaluation n The evaluation process in context

3 The Program Cycle Review Existing Programs Identify New Program Needs Design a Program Confirm Resources Develop Program Examine Future Program Needs Implementation Fine Tuning the Program Evaluate Program

4 Is there a legitimate need for an evaluation? n Is there an interest in: Accountability? Decision- Making ? Learning? n What information could an evaluation produce that we don’t have now? n Are there faster, better, more cost-effective ways of improving a program than conducting an evaluation?

5 Plan an Evaluation n Assess stakeholder’s needs n Prepare terms of reference to state Issues Methodology/Approach Schedule and cost n Prepare workplan to clarify Questions/Issues Evaluation methodology

6 Collect Data n Understand the potential data sources: people; documents; data bases; settings n Determine efficient and effective ways to collect the data - e.g.: interviews; checklists; questionnaires; focus groups; performance tests; observation; technical measurement n Collect quantitative and qualitative data

7 Analyze Data n Using qualitative approaches - e.g.: determining the important themes and messages n Using quantitative approaches - e.g.: counts; statistics n Integrating qualitative and quantitative approaches

8 Interpret Data & Formulate Findings n Weigh the evidence n Attribute effects or results: Formulate plausible cause-effect relationships n Formulate findings: Articulate what the data says so that everyone understands

9 Recommend Action n What are the big messages of the evaluation? n What would be helpful to recommend?

10 Communicate Evaluation Results n Decide: When to share information What to share Who to share it with How it should be presented

11 Use Results n Ownership: Who cares about follow-up? n Accountability: Who is responsible for follow-up?

12 When to invest in program evaluation Program Before During At the endIn the future To improve program design To improve program implementation For accountability To assess impact

13 Key Timing for Evaluation Program Before During At the endIn the future Evaluation Frameworks Mid-Term Evaluations End of Program Evaluation Impact Evaluation

14 Evaluation Products n Scope of Work/Terms of Reference (TOR) n Work Plan n Evaluation Framework n Briefings/Progress Reports n Summary of Results/Evaluation Report

15 The Evaluation Process in Context Resources Values Ethics Politics

16 Questions for Discussion n Does the program evaluation cycle always coincide with program milestones? n What issues can emerge?