1. WELCOME June 2012 Evaluation Planning and Management John Wooten ~Lynn Keeys

2. Session 3: Project Design Stage – Preliminary Evaluation Planning Objectives: Understand the stages of evaluation planning Overview highlights of performance management -- development hypotheses and conceptual/analytical frameworks Introduce evaluation designs Explore preliminary evaluation design issues Evaluation Road Map: Stage 1 2

3. Evaluation Planning Evaluation planning begins during project design True or not? Why or why not? 3

4. Evaluation Planning Consider project design as synonymous with evaluation planning 4

5. Dev M&E plan (preliminary decisions to evaluate) Project design Project implementation Active decision to evaluate Reflectively assess preliminary evaluation plan…until… Finalize/implement evaluation plan Evaluation Planning Stages 5

6. Preliminary Evaluation Planning To organize, assess and report empirical evidence adequate to test a development hypothesis – a key evaluation question reformulated as a proposition Key objective of evaluations … 6

7. Preliminary Evaluation Plan Important part of a project design that explains how the development hypothesis will be tested. So what should distinguish a preliminary evaluation plan from a final, detailed evaluation plan? (How far should we plan…preliminarily?) 7

8. Final Evaluation Plan Components 1.Key evaluation questions under study 2.The research design and data collection/analysis methods for answering these questions 3.A valid data collection plan 4.An indicative budget and general timeframes 5.A data analysis plan to ensure questions are answered appropriately and responsively 6.A description of required product(s) (e.g., a report) 7.A communications approach for disseminating the findings, conclusions, recommendations and lessons 8.Follow-up plan?? (How far should we plan…preliminarily?) 8

9. 1.Key evaluation questions under study 2.The research design for answering these questions (See ADS 201.3.9.3 and 9.4; esp. for all pilot projects and impact evaluations) 3.A valid data collection/analysis plan (PMP, impact evaluations) 4.An indicative budget and general timeframes 5.A data analysis plan to ensure questions are answered appropriately and responsively 6.A description of required product(s) (e.g., a report) 7.A communications approach for disseminating the findings, conclusions, recommendations and lessons Preliminary Evaluation Plan 9

10. Project Design M&E Plan (new requirements) 1.Known specific “evaluation triggers” 2.Key evaluation questions 3.Indicative purpose statements 4.Preliminary evaluation research design 5.Impact evaluations: fully designed during or shortly after project design; details summarized in M&E Plan 6.USAID/Washington support requirements USAID Policy Requires/Recommends: 10

11. USAID Policy Requires/Recommends: Use BEST methods~ Stay tuned… 11

12. (jwootenjr@yahoo.com) (lynnkeeys50@yahoo.com) 12 Evaluation Planning and Management John Wooten ~ Lynn Keeys Thank you~