3 GEF M&E PolicyDefines the concepts, role, and use of monitoring and evaluation within the GEFDefines the institutional framework and responsibilities.Indicates the GEF minimum M&E requirements covering:project design,application of M&E at the project level, andproject evaluation.Current M&E PolicyApproved by GEF Council in November 2010
4 M&E in the GEF: Objectives Promote accountability for the achievement of GEF objectives through the assessment of results, effectiveness, processes, and performance of the partners involved in GEF activities.Promote learning, feedback, and knowledge sharing on results and lessons learned among the GEF and its partners as a basis for decision making on policies, strategies, program management, programs, and projects; and to improve knowledge and performance.
5 Separate reporting lines for Monitoring (through Secretariat) and Evaluation (through Independent Evaluation Office)GEF CouncilAnnual evaluation reportsOverall Performance Study(to Assembly)Annual Work Programand BudgetAnnual Monitoring ReportEvaluation Management ResponseProgramming documents and indicatorsResults Based ManagementAgency evaluation unitsGEF Independent Evaluation OfficeGEF SecretariatCorporate evaluationsProject and ProgramIndependent evaluationsProject and ProgramevaluationsProject and Program Implementation ReportsAgency Portfolio ReportsProject documents with M&E plansAgency GEF coordination unitsProject and Program Implementation ReportsProject and Program monitoring documentationTerminal evaluationsGEF projects and programs
6 M&E Key Responsibilities in GEF PartnerKey Roles and Responsibilities in M&EGEF CouncilPolicy-makingOversightEnabling environment for M&EGEF Independent Evaluation OfficeIndependent GEF evaluationOversight of M&ESetting minimum requirements for evaluationGEF SecretariatGEF Results Based Management (monitoring and reporting)Review of GEF M&E requirements in project proposalsAgency GEF operational unitsMonitoring of the Agency GEF portfolioEnsure M&E at the project levelAgency evaluation unitsProject and/or corporate Agency evaluationsMainstreaming GEF into relevant Agency evaluationSTAPAdvice on scientific/technical matters in M&ESupport to scientific and technical indicatorsParticipating CountriesCollaboration on M&E at portfolio and project levelsStakeholdersParticipation in monitoring activities and mechanismsProviding views and perceptions to evaluations
7 GEF Independent Evaluation Office MissionEnhance global environmental benefits through excellence, independence and partnership in monitoring and evaluation.PrinciplesImpartialityProfessionalismTransparencyCreated by decision of the May 2003 GEF Council.Added to the GEF Instrument in April 2014.There are different kinds of evaluations that different parties conduct.Types of Evaluations:Project EvaluationsProgram EvaluationsCountry Level EvaluationsImpact EvaluationsCross-cutting and thematic evaluationsProcess and performance evaluationsAd-hoc ReviewsComprehensive Evaluations
8 GEF IEO GEF-6 Work Program The IEO will continue to provide feedback on the performance, results, and impacts of GEF support.The GEF-6 Work Program will be organized around key issues derived from the Sixth Replenishment of the GEF Trust Fund and relevant to the GEF 2020 Strategy, such as:The extent, mechanisms, and conditions by which GEF support has identified and delivered integrated solutions and multiple benefits.The extent, mechanisms, and conditions by which GEF support has addressed drivers of environmental degradation.The performance of the GEF, including issues related to the GEF 2020 Strategy core operational principles.
9 IEO Work Program for GEF-6 Mainstreaming of KM and Gender in all evaluationsMultiple Benefits and Integrated Approaches:Evaluation of Multiple Benefits in the GEFEvaluation of Programmatic ApproachesMidterm Review of Integrated ProgramsAddressing Drivers of Global Environmental Change:Joint Impact Evaluation of GEF Support to Protected Areas and Protected Area Systems:Strategic Country-Level and Cluster EvaluationsEvaluating GEF Performance:Annual Performance ReportEvaluation of the Performance of the CSO NetworkLDCF/SCCF Annual Evaluation ReportsSixth Comprehensive Evaluation of the GEF: GEF in the Changing Environmental Finance LandscapeFocuses on GEF strategies and approaches, as well as its relevance and performance and demonstrated strengths in the changing environmental finance architecture.Evaluative evidence will be collected from several evaluations, such as:CSO NetworkPrivate SectorNon-grant FinancingSTARGender Equality Action PlanAdaptation to Climate Change
10 Policy, Guidance and KMPolicy, Guidance, and Methodological Development:GEF M&E PolicyTerminal Evaluation GuidelinesImpact Evaluation Guidelines and HandbookGuidance on Evaluating Gender in GEF ProgrammingKM and Learning:KM needs assessment.Develop knowledge, learning, and communications strategy for GEF-6.Review the GEF-6 KM strategy and work plan of the GEF Secretariat.Conduct a KM needs assessment to determine:The level of use of IEO productsCollect information on the most appropriate and preferred communication formatsIdentify priorities and topics for future learning productsEngage stakeholders at key points of an evaluation by developing a KM and communication plan.
11 Office Initiatives Climate-Eval Community of Practice Participation in Conferences:Evaluating Sustainable Development and NRM4th International Conference on National Evaluation CapacitiesParticipation in GEF Meetings and Evaluation Networks:Continue developing instructional and learning products to facilitate lessons learned from evaluations.Develop new training materials to be distributed during ECWs in coordination with the GEF Country Support Program.Maintain an active role in networks.Maintain an active role in networks such as:UN Evaluation GroupEvaluation Cooperation GroupResults, Measurement and Evidence Stream of the World Bank GroupInternational Development Evaluation AssociationUniversitiesResearch institutes
14 Overview Minimum M& E requirements in the GEF M & E Policy Terminal Evaluation Guidelines and ReviewsManagement response and management action recordA dynamic process.Full Agency M&E requirements are expected to be applied to GEF projects
15 M&E: Minimum Requirement 1 Design of M&E PlansConcrete and fully budgeted M&E plan by CEO endorsement for FSP and CEO approval for MSP. Project logical frameworks should align with GEF focal area results frameworks. M&E Plan should include:SMART indicatorsSpecificmeasurable,achievable and attributable,relevant and realistic, (OPS 5 found this is critical)time-bound,trackable and targetedBaseline data for M&E by CEO endorsementMid Term Reviews (where required or foreseen) and Terminal Evaluations included in planOrganizational set up and budget for M&E
16 M&E: Minimum Requirement 2 Implementation of M&E PlansProject/program monitoring and supervision will include execution of the M&E plan:Use of SMART indicators for process and implementationUse of SMART indicators for resultsBaseline for the project is fully established and data are compiled to review progressOrganizational set up for M&E is operational and its budget is spent as planned
17 M&E: Minimum Requirement 3 Project/Program Evaluations:All full sized projects and programs will be evaluated at the end of implementationEvaluations should:Be independent of project management or reviewed by GEF Agency evaluation unitApply evaluation norms and standards of the GEF AgencyAssess, as a minimum, outputs and outcomes, likelihood of sustainability, compliance with Minimum Requirements 1 & 2Contain basic project data and lessons on the evaluation itself (including TORs)Should be sent to GEF IEO within 12 months of completion of project/programGuidelines for Terminal Evaluations
18 M&E: Minimum Requirement 4 Engagement of Operational Focal PointsM&E plans should include how OFPs will be engagedOFPs to be informed on M&E activities, including Mid Term Reviews and Terminal Evaluations, receiving drafts for comments and final reportsOFPs invited to contribute to the management response (where applicable)GEF Agencies keep track of the application of this requirement in their GEF financed projects and programsOFPs can if they wish under take monitoring or evaluation of projects of country portfolio.
19 Terminal Evaluation Guidelines Purpose of terminal evaluations Track performance of GEF portfolioProvide feedback on GEF portfolio performanceSynthesize lessons that may help improve GEF functioning
20 Terminal Evaluation Guidelines Evaluation Criteria Relevance. The extent to which the activity is suited to local and national development priorities and organizational policies, including changes over timeEffectiveness. The extent to which an objective has been achieved or how likely it is to be achievedEfficiency. The extent to which results have been delivered with the least costly resources possible; also called cost effectiveness or efficacyResults/Impact. The positive and negative, and foreseen and unforeseen, changes to and effects produced by a development interventionSustainability. The likely ability of an intervention to continue to deliver benefits for an extended period of time after completion. Projects need to be environmentally as well as financially and socially sustainable
21 Terminal Evaluation Guidelines Role of Agencies Are carried out by Agencies at project completionFollow GEF IEO Terminal Evaluation GuidelinesDone 6 months (±) of project completionReviewed by Agency evaluation office ( WB, UNDP and UNEP)Submitted to the GEF IEO within 12 months of evaluation completion
22 Terminal Evaluation Reviews by the GEF IEO GEF IEO reviewsTerminal evaluations not reviewed by the Agency Evaluation OfficesRandom “spot checking” for the terminal evaluations reviewed by the Agency Evaluation OfficesPrimary reviewers prepare draft reviewsPeer reviewers provide feedbackIf required senior reviewers confirm the findingsDraft reviews shared with AgenciesAgency feedback incorporated
23 Terminal Evaluation Review The Annual Performance Report (APR) presents aggregated ratings for the portfolio on:OutcomesSustainabilitySupervisionM&EProgress to ImpactFirst presented in OPS 5, focus on GEF contributions to long term processes
24 Management Response and Follow up to Evaluations A management response is required for all evaluations and performance reports presented to the GEF Council by the GEF IEO. It is coordinated by GEF CEO with inputs from other GEF stakeholders.GEF Council takes into account both the evaluation and the management response when taken a decision.GEF IEO reports on implementation of decisions annually trough Management Action Record (MAR).IEO is available to provide information on management requestsExamples are: OPS 5 follow-up in RBM, Gender, KM