1. Food and Nutrition Technical Assistance III Project (FANTA) FHI 360 1825 Connecticut Ave., NW Washington, DC 20009 Tel: 202-884-8000 Fax: 202-884-8432 Email: fantamail@fhi360.org Website: www.fantaproject.org Food for Peace Monitoring, Evaluation and Reporting Requirements Food for Peace Monitoring and Evaluation Workshop for FFP Development Food Assistance Projects

2. Session Objectives By the end of the session participants will have: 1.Shared their thoughts about the benefits of M&E 2.Reviewed the FFP M&E and Reporting Requirements and identified those that seem challenging to their projects Food for Peace Monitoring, Evaluation and Reporting Requirements

3. Who will benefit from the results of your M&E work and how/why? Activity 1: Share your thoughts… Food for Peace Monitoring, Evaluation and Reporting Requirements

4. Session Objective Review FFP M&E and reporting requirements for the lifecycle of a project Project Lifecycle, M&E and Reporting Requirements Midway Requirements Start Up Stage Requirements Project End Requirements Annual Requirements Food for Peace Monitoring, Evaluation and Reporting Requirements

5. Midway Requirements Start Up Stage Requirements Project End Requirements Annual Requirements Next Section Project Lifecycle, M&E and Reporting Requirements Food for Peace Monitoring, Evaluation and Reporting Requirements

6. Project Lifecycle, M&E and Reporting Requirements Project Lifecycle: What are the M&E and Reporting Requirements at Each Stage? Proposal stage Start Up Midway End of project End of Year 1 End of Year 2 End of Year 3 End of Year 4 Learning Information from M&E system closed Food for Peace Monitoring, Evaluation and Reporting Requirements

7. Requirement 1 : LogFrame Project Lifecycle, M&E and Reporting Requirements Narrative SummaryIndicators Data SourcesAssumptions Goal Project Purpose Sub-purpose Immediate Outcome Output Input Food for Peace Monitoring, Evaluation and Reporting Requirements

8. LogFrame is a matrix that summarizes the Theory of Change and shows what the project intends to do and how, what the key assumptions are, and how outputs and outcomes will be monitored and evaluated. Levels of LogFrame: goal, purpose, sub-purpose, immediate outcomes, outputs, inputs Goal, purpose, sub-purpose, and immediate outcomes should be stated as results (not activities). All elements of the LogFrame should be measurable and context specific. Requirement 1 : LogFrame Project Lifecycle, M&E and Reporting Requirements Food for Peace Monitoring, Evaluation and Reporting Requirements

9. Theory of Change LogFrame Indicator Performance Tracking Table (IPTT) Performance Indicator Reference Sheets (PIRS) Plans on: annual monitoring, data analysis, management, safeguard, dissemination, use, quality assurance, evaluation M&E staffing plan and structure Project Lifecycle, M&E and Reporting Requirements Requirement 2: M&E Plan Food for Peace Monitoring, Evaluation and Reporting Requirements

10. IPTT should include: Baseline/final evaluation and annual monitoring indicators All applicable FFP “required” and “required if applicable” indicators Mission/F indicators, gender and environmental indicators (linked to performance of project activities only) Indicators related to all levels of the LogFrame Levels of disaggregation and targets for all indicators Project Lifecycle, M&E and Reporting Requirements Requirement 2: M&E Plan (continued) Food for Peace Monitoring, Evaluation and Reporting Requirements

11. Aims to help USAID learn more systematically from its work and increases accountability Calls for “large” and “pilot/innovative” projects (of any size) to undergo evaluations that are external Projects designed based on a proven Theory of Change should undergo performance evaluations, whereas “pilot/innovative” projects should undergo impact evaluations (the latter only if feasible) USAID Evaluation Policy issued in January 2011 Project Lifecycle, M&E and Reporting Requirements Food for Peace Monitoring, Evaluation and Reporting Requirements

12. Most evaluations will be external (i.e. third-party contractor or grantee managed by USAID, not by the implementing partners) Decision on whether impact or performance evaluation at discretion of operating unit (FFP) Most FFP food security projects will likely undergo performance evaluations (not impact evaluations) for the time being USAID Evaluation Policy (continued) Project Lifecycle, M&E and Reporting Requirements Food for Peace Monitoring, Evaluation and Reporting Requirements

13. Project Lifecycle, M&E and Reporting Requirements Midway Requirements Start Up Stage Requirements Project End Requirements Annual Requirements Next Section Food for Peace Monitoring, Evaluation and Reporting Requirements

14. PVOs should attend the FFP M&E workshop (held by FANTA) Madagascar: November 4-13, 2014 Burundi: November 17-25, 2014 Malawi: December 8-17, 2014 Two days intro sessions followed by technical assistance one-on-one for each award Requirement 3: FFP M&E workshop Start Up Stage Requirements Food for Peace Monitoring, Evaluation and Reporting Requirements

15. Submit revised LogFrame, IPTT, Theory of Change (ToC) - due 20 days to FFP after the M&E workshop. Target values for baseline/final evaluation indicators are submitted as percentage point change during proposal stage. No need to update these targets until after baseline survey conducted BUT target values for annual monitoring indicators required with submission of revised IPTT 20 days after workshop Requirement 4: ToC, Logframe, IPTT Start Up Stage Requirements Food for Peace Monitoring, Evaluation and Reporting Requirements

16. Requirements #5: Submit comprehensive M&E Plan and Detailed Implementation Plan (DIP)—due 60 days after the M&E workshop to FFP Strongly encouraged: Attend new M&E Plan workshop held by TOPS in coordination with FFP. Start Up Stage Requirements Start Up Stage: Requirement 5 Food for Peace Monitoring, Evaluation and Reporting Requirements

17. Third-party survey firm (not PVO) to conduct baseline study Projects can start implementation before data collection for the baseline is complete! Quantitative study must use population-based household survey (simple pre- post designs required only) Baseline survey must be comparable to the final evaluation survey Data collected for impact and some outcome indicators from IPTT; includes FFP gender indicators Start Up Stage Requirements Requirement 6: Baseline Study Food for Peace Monitoring, Evaluation and Reporting Requirements

18. Third-party survey firm (not PVO) to conduct baseline study Study will include a qualitative component to add richness and context to the quantitative results Completed within first year of implementation as early as possible (and ideally during the “lean season”) Baseline report will provide results by PVO and for the overall FFP program implementation areas Datasets also required to be submitted to comply with USG Open Data requirements PVO can conduct other formative research, as needed Start Up Stage Requirements Baseline Study (continued) Food for Peace Monitoring, Evaluation and Reporting Requirements

19. Project Lifecycle, M&E and Reporting Requirements Midway Requirements Start Up Stage Requirements Project End Requirements Annual Requirements Next Section Food for Peace Monitoring, Evaluation and Reporting Requirements

20. Submit annual results report (ARR)—retrospective reporting relative to US fiscal year (Oct 1–Sept 30) Annual Requirements Annual Results Report ARR Narrative Attachments to FFPMIS FFPMIS Data Entry Requirement 7: Annual Results Report Food for Peace Monitoring, Evaluation and Reporting Requirements

21. 1.ARR Narrative containing: Annual Food Assistance Project Activities and Results Lessons Learned Annual Requirements Annual Results Report (continued) Food for Peace Monitoring, Evaluation and Reporting Requirements

22. 2. Attachments to FFPMIS: Success Stories Indicator Performance Tracking Table (IPTT) IPTT Data Source Descriptions Detailed Implementation Plan (DIP) Expenditure Report Technical Sectors Tracking Table Program Design and Performance Reports Supplemental Materials Annual Requirements Annual Results Report (continued) Food for Peace Monitoring, Evaluation and Reporting Requirements

23. 3. FFPMIS Data Entry: Monetization and Cost Recovery Tables Standardized Annual Performance Questionnaire (SAPQ) Beneficiary and Resource Tracking Tables Annual Requirements Annual Results Report (continued) Food for Peace Monitoring, Evaluation and Reporting Requirements

24. Project Lifecycle, M&E and Reporting Requirements Midway Requirements Start Up Stage Requirements Project End Requirements Annual Requirements Next Section Food for Peace Monitoring, Evaluation and Reporting Requirements

25. Reasons for conducting MTE:  Learn from successes, acknowledge problems  Assess implementation progress and roadblocks Participatory, qualitative assessments are encouraged Process evaluation Team leader must be external MTE team should comprise expertise in all technical sectors and cross-cutting issues addressed by project No MTE team members should have previous responsibility in design/implementation of project under evaluation Midway Requirements Requirement 8 (PVO): Mid-term Evaluation Food for Peace Monitoring, Evaluation and Reporting Requirements

26. MTE finalized for FFP 5-year development projects by mid PY3 Not required to include quantitative component or be population- based like baseline/final evaluation Midterm report to be submitted to FFP 3 months after data collection ends or qualitative study conducted Midway Requirements Mid-term Evaluation (continued) Food for Peace Monitoring, Evaluation and Reporting Requirements

27. Project Lifecycle, M&E and Reporting Requirements Midway Requirements Start Up Stage Requirements Project End Requirements Annual Requirements Next Section Food for Peace Monitoring, Evaluation and Reporting Requirements

28. Third-party survey firm to conduct final evaluation study (quantitative and qualitative) Quantitative study must use population-based household survey (simple pre-post designs required only) Final evaluation survey must be comparable to the baseline survey same impact and outcome indicators and questionnaires same time of year Most will be performance evaluations with pre-post designs. Project End Requirements Requirement 9: Final Evaluation Study Food for Peace Monitoring, Evaluation and Reporting Requirements

29. FFP Request for Applications http://www.usaid.gov/what-we- do/agriculture-and-food-security/food- assistance/programs/development-programshttp://www.usaid.gov/what-we- do/agriculture-and-food-security/food- assistance/programs/development-programs FFP ARR Guidance http://www.usaid.gov/what-we-do/agriculture- and-food-security/food-assistance/guidance/implementation-and- reportinghttp://www.usaid.gov/what-we-do/agriculture- and-food-security/food-assistance/guidance/implementation-and- reporting USAID Evaluation Policy http://www.usaid.gov/evaluation/http://www.usaid.gov/evaluation/ Resources Food for Peace Monitoring, Evaluation and Reporting Requirements

30. This presentation is made possible by the generous support of the American people through the support of the Office of Health, Infectious Diseases and Nutrition, Bureau for Global Health; and the Office of Food for Peace, Bureau for Democracy, Conflict and Humanitarian Assistance, United States Agency for International Development (USAID), under terms of Cooperative Agreement No. AID-OAA-A-12-00005, through FANTA, managed by FHI 360. The contents are the responsibility of FHI 360 and do not necessarily reflect the views of USAID or the United States Government. Food for Peace Monitoring, Evaluation and Reporting Requirements