Monitoring & Evaluation in World Bank Agriculture and Rural Development Operations SASAR Monitoring & Evaluation Workshop New Delhi; June 20, 2006

Purposes of M&E Improve design or implementation during project Improve design or implementation during project Planning and allocating resources Planning and allocating resources Measure and demonstrate results Measure and demonstrate results Inform future decision-making and project designs Inform future decision-making and project designs

What Is M&E? There is a difference between M and E! Monitoring: The gathering of evidence to show what progress has been made in the implementation of programs. Focuses on inputs and outputs.Evaluation: Measuring changes in outcomes and evaluating the impact of specific interventions on those outcomes.

Complementary Roles for Monitoring and Evaluation Monitoring Routine collection of information Routine collection of information Tracking implementation progress Tracking implementation progress Measuring efficiency Measuring efficiency “Is the project doing things right ?” Evaluation Analyzing information Ex-post assessment of effectiveness and impact Confirming project expectations Measuring impacts “Is the project doing the right things?”

Steps to Design a M&E System Plan for M&E Plan for M&E Developing the Results Framework Developing the Results Framework Determine information sources and design Determine information sources and design Plan to analyze and use results Plan to analyze and use results Complete and test the system Complete and test the system Annual self-assessments and periodic external evaluation Annual self-assessments and periodic external evaluation

The M&E Plan What? What? Type of information and data to be consolidated Type of information and data to be consolidated How? How? Procedures and approaches including methods for data collection and analysis Procedures and approaches including methods for data collection and analysis Why? Why? How the collected data will support monitoring and project management How the collected data will support monitoring and project management

The M&E Plan When? When? Frequency of data collection and reporting Frequency of data collection and reporting Who? Who? Focal points and resource persons. Responsibilities and capacities. Focal points and resource persons. Responsibilities and capacities.

Institutional and Human Capacity Requirements Establishing an M&E Unit Establishing an M&E Unit Centralized/project specific Centralized/project specific Collaboration across co-implementing institutions Collaboration across co-implementing institutions Institutionalizing and Harmonizing M&E systems Institutionalizing and Harmonizing M&E systems Facilitates sector wide planning, development of policies and knowledge sharing Facilitates sector wide planning, development of policies and knowledge sharing Allocate sufficient time and resources Allocate sufficient time and resources

Data Collection & Analysis Prior to project start Prior to project start Baseline data: at an absolute minimum baseline data are required on each outcome indicator and results indicator. Baseline data: at an absolute minimum baseline data are required on each outcome indicator and results indicator. During the course of the project During the course of the project Data on implementation, physical and financial progress. Data on implementation, physical and financial progress. At critical junctures and project completion At critical junctures and project completion Data for assessing achievements and impacts. Data for assessing achievements and impacts.

Some Data Collection Methods Formal Surveys Formal Surveys Household Surveys Household Surveys Core Welfare Indicators Questionnaire (CWIQ) Core Welfare Indicators Questionnaire (CWIQ) Client Satisfaction (or Service Delivery) Surveys Client Satisfaction (or Service Delivery) Surveys Citizen Report Cards Citizen Report Cards Participatory Methods Participatory Methods Participatory M&E Participatory M&E Public Expenditure Tracking Surveys Public Expenditure Tracking Surveys Remote Sensing Remote Sensing

Project Management Information System What is it? System for collection, analysis, storing and dissemination of project information System for collection, analysis, storing and dissemination of project information Supports management in making timely and effective decisions for planning, monitoring and managing a project/program Supports management in making timely and effective decisions for planning, monitoring and managing a project/program Generally consists of accounting software and a database management system Generally consists of accounting software and a database management system

M&E in the Project Cycle Preparation Preparation M&E planning, Results Framework, baseline survey, resource allocation, reporting formats, capacity assessment M&E planning, Results Framework, baseline survey, resource allocation, reporting formats, capacity assessment Appraisal Appraisal Development of detailed M&E plan, manual of procedures, preparation of ToRs, M&E training program, agree on Results Framework Development of detailed M&E plan, manual of procedures, preparation of ToRs, M&E training program, agree on Results Framework

M&E in the Project Cycle Between end-of-negotiations and project effectiveness Between end-of-negotiations and project effectiveness M&E unit established M&E unit established Baseline completed Baseline completed Implementation & Supervision Implementation & Supervision ISR ISR Mid-term Review Mid-term Review Implementation and Completion Implementation and Completion ICR ICR Sustainability of M&E systems Sustainability of M&E systems

Necessities for Successful M&E M&E must have strong ownership and support from leaders M&E must have strong ownership and support from leaders M&E requires expert support M&E requires expert support M&E needs broad stakeholder consultation in defining and setting target indicators M&E needs broad stakeholder consultation in defining and setting target indicators M&E training is essential for success M&E training is essential for success M&E systems have to be user-friendly M&E systems have to be user-friendly