Aaron Zazueta Chief Evaluation Officer 2013 EVALUATION IN THE GEF

Page 2 Overview 1.What is M &E 2.Monitoring & Evaluation Policy 3.Terminal Evaluations in the GEF 4.GEF5 - GEFEO work program 5.Special Initiatives: Climate-Eval and CEPKE

Page 3 M&E Policy

Page 4 M&E and RBM Monitoring is one of the main instruments of Results Based Management Evaluation is a “reality check” on monitoring and RBM Monitoring & RBM tell whether the organization is “on track” Evaluation could tell whether the organization is “on the right track”

Page 5 Monitoring Evaluation MonitoringEvaluation

Page 6 The GEF M&E Policy Indicates the GEF minimum M&E requirements covering:  project design,  application of M&E at the project level, and  project evaluation. Defines the concepts, role, and use of monitoring and evaluation within the GEF Defines the institutional framework and responsibilities. Current M&E Policy: Approved by GEF Council in November 2010

Page 7 M&E in the GEF 2 overarching objectives: Promote accountability for the achievement of GEF objectives through the assessment of results, effectiveness, processes, and performance of the partners involved in GEF activities. Promote learning, feedback, and knowledge sharing on results and lessons learned among the GEF and its partners as a basis for decision making on policies, strategies, program management, programs, and projects; and to improve knowledge and performance.

Page 8 Separate reporting lines for Monitoring (through Secretariat) and Evaluation (through Evaluation Office)

Page 9 M&E Key Responsibilities in GEF

Page 10 GEF Evaluation Office Mission “Enhance global environmental benefits through excellence, independence and partnership in monitoring and evaluation” Principles Impartiality Professionalism Transparency

Page 11 Types of Evaluations Project EvaluationsProgram Evaluations Country Level Evaluations Impact Evaluations Cross-cutting and thematic evaluations Process and performance evaluations Ad-hoc Reviews Overall Performance Studies (OPS) Different TORs, scopes, frequency, audiences, methodologies, lead

Page 12 Follow up to Evaluations A management response is required for all evaluations and performance reports presented to the GEF Council by the GEF EO. It is coordinated by GEF CEO with inputs from other GEF stakeholders. GEF Council takes into account both the evaluation and the management response when taken a decision. GEF EO reports on implementation of decisions annually (Management Action Record)

Page 13 M&E: Minimum Requirement 1 Design of M&E Plans Concrete and fully budgeted M&E plan by CEO endorsement for FSP and CEO approval for MSP. Project logical frameworks should align with GEF focal area results frameworks. M&E Plan should include: SMART indicators Baseline data for M&E by CEO endorsement Mid Term Reviews (where required or foreseen) and Terminal Evaluations included in plan Organizational set up and budget for M&E

Page 14 M&E: Minimum Requirement 2 Implementation of M&E Plans Project/program monitoring and supervision will include execution of the M&E plan: Use of SMART indicators for process and implementation Use of SMART indicators for results Baseline for the project is fully established and data are compiled to review progress Organizational set up for M&E is operational and its budget is spent as planned

Page 15 M&E: Minimum Requirement 3 Project/Program Evaluations: All full sized projects and programs will be evaluated at the end of implementation Evaluations should:  Be independent of project management or reviewed by GEF Agency evaluation unit  Apply evaluation norms and standards of the GEF Agency  Assess, as a minimum, outputs and outcomes, likelihood of sustainability, compliance with Minimum Requirements 1 & 2  Contain basic project data and lessons on the evaluation itself (including TORs)  Should be sent to GEF EO within 12 months of completion of project/program Guidelines for evaluating MSPs/EAs will be developed

Page 16 M&E: New Minimum Requirement 4 Engagement of Operational Focal Points M&E plans should include how OFPs will be engaged OFPs to be informed on M&E activities, including Mid Term Reviews and Terminal Evaluations, receiving drafts for comments and final reports OFPs invited to contribute to the management response (where applicable) GEF Agencies keep track of the application of this requirement in their GEF financed projects and programs

Page 17 Evaluation Criteria Relevance. The extent to which the activity is suited to local and national development priorities and organizational policies, including changes over time Effectiveness. The extent to which an objective has been achieved or how likely it is to be achieved Efficiency. The extent to which results have been delivered with the least costly resources possible; also called cost effectiveness or efficacy Results. The positive and negative, and foreseen and unforeseen, changes to and effects produced by a development intervention Sustainability. The likely ability of an intervention to continue to deliver benefits for an extended period of time after completion. Projects need to be environmentally as well as financially and socially sustainable

Page 18 Terminal Evaluations Purpose of Terminal Evaluations  Track performance of GEF portfolio (aggregation of project results)  Provide feedback on performance  Synthesize lessons that may help improve GEF functioning

Page 19 Terminal Evaluations Are carried out by Agencies at project completion Follow GEF EO Terminal Evaluation Guidelines Done 6 months (±) of project completion Reviewed by Agency evaluation office Submitted to the GEF EO within 12 months of evaluation completion

Page 20 Terminal Evaluation Review GEF EO reviews  Terminal evaluations not reviewed by the Agency Evaluation Offices  Random “spot checking” for the terminal evaluations reviewed by the Agency Evaluation Offices Primary reviewers prepare draft reviews Peer reviewers provide feedback If required senior reviewers confirm the findings

Page 21 Terminal Evaluation Review Draft reviews shared with Agencies Agency feedback incorporated TE verification on a sample basis Ratings: outcomes, sustainability, supervision, M&E, and quality of TE aggregated Synthesis of the data presented in the APR

Page 22 GEFEO GEF-5 Work Program Implementation of GEF M&E Policy  Annual Reporting to Council:  Country Portfolio Evaluations (May-June)  Performance and process issues (May-June)  Impact (November) Thematic/Cross-sectoral evaluations (November)  Knowledge Sharing  dissemination of lessons; participation in country support program Overall Performance Studies – replenishment process (every 4 years) Active participation evaluation communities (UN/MDBs)

Page 23 Knowledge Products Thematic Evaluations Country Portfolio Evaluations Sub-Studies and Evaluations Performance Impact M & E Policy Learning Products Blog Multimedia SignpostsWebinars Learning Products

Page 24 Special Initiatives Climate-Eval: Community of Practice on Evaluation of Climate Change and Development CEPKE: Comprehensive Evaluation Platform for Knowledge Exchange

Thank you