Module 1 Program Evaluation and Its Practice

2 Overview n What is evaluation? n Definitions of program evaluation n What can be evaluated? n What is a program? n Why evaluate programs? n Historical overview

3 Working Definition of Program Evaluation n Evaluation is the process of making judgements about programs based on information and analysis relative to such issues as relevance, cost-effectiveness and success for its stakeholders

4 Evaluations provide... Judgements – that affect Stakeholders – who are the people with a vested interest Information – with which to make

5 What to Evaluate? Institution Organization Projects Program

6 Program Evaluation n A program is an intervention, comprised of various activities, processes or projects, all of which are intended to contribute to a common goal. n Program evaluation can be applied both to the whole program or to its sub-components.

7 Formative Evaluation n To improve the operation of an existing program n Conducted during the implementation of the program n Allows you to pinpoint problems, correct them and get things back on track

8 Summative Evaluation n Conducted to assess the results of the program (its outcomes) n Done once the program is completed n Allows you to demonstrate results of the program

9 Why Evaluate Programs? n Accountability n Decision-Making n Learning ?

10 Evaluations provide... Judgements – that affect Stakeholders – who are the people with a vested interest Information – with which to make

11 Evaluation has Roots in Many Fields n Law (Common/Civil) n Agriculture (Agricultural Economics) n Health / Medicine n Human Sciences (Psychology / Education) n Evaluation Science n Business

12 Dominant Approaches n 19th century: Measurement n 1920s - 50s: Description/Comparison n 1950s - 80s: Judgement n 1980s: Transparency/ Accountability Performance n 1990s: Empowerment/ Transformation

13 Good Program Evaluation n Is strategic, as it gives priority to large, problematic or important programs n Focuses on important issues for decision- makers n Is credible n Is timely n Produces useable results

14 Monitoring and Evaluation n Monitoring assesses progress in implementation of ongoing programs n n Evaluation provides a snapshot against some benchmarks at a point in time of programs that may or may not be continuing

15 Monitoring and Evaluation - Rationale n Monitoring holds implementers accountable for delivery of inputs provides basis for corrective action provides assessment of continued relevance n n Evaluation Accountability - was money well spent? Learning - what could we do better next time?

16 Monitoring and Evaluation - Focus n Monitoring Was delivery according to plan? What were the deviations? Were they justifiable? n n Evaluation Relevance Appropriateness Success Cost effectiveness Lessons learned Effectiveness Impact Sustainability Efficiency

17 Monitoring and Evaluation - Timing n Monitoring Ongoing or periodic throughout the life of the program n n Evaluation Typically at mid- point in a funding cycle, a year before the end Impact evaluation - 3 to 5 years afterwards Delay depends on the nature of the project