M&E Basics Miguel Aragon Lopez, MD, MPH. UNAIDS M&E Senior Adviser 12 th May 2009

Why Standardized M&E Terminology? UNCT 26 th February 2009 A common understanding of M&E terminology is critical for: –maintaining clear communication –taking a common approach

M&E Definitions: Why Standardized M&E Terminology? UNCT 26 th February 2009 Monitoring—routine tracking and reporting of priority information about a plan / program / project, its inputs and intended outputs, outcomes and impacts Measurement of progress toward achieving program/project objectives; most often involves counting what we are doing.

M&E Definitions: Why Standardized M&E Terminology? Evaluation—the rigorous, scientifically-based collection of information about plan / program / intervention activities, characteristics, and outcomes that determine the merit or worth of the program/intervention

Program Improvement Program Improvement Reporting/ Accountability Reporting/ Accountability Data Sharing with Partners Data Sharing with Partners The Purpose of M&E

M&E Definitions: Results – RBM approach UNDAF and agency programmes in terms of a hierarchy of SMART results which has five levels: –MDG related national priority/ goal (equated with impact) –UNDAF outcome, know in Moz also as pillars –Outcome of one or more agencies working together –Output usually of one agency, but possibly of more than one working together –Activity Result

SMART Results S pecific: Results must use change language – they must describe a specific future condition M easurable: Results, whether quantitative or qualitative, must have measurable indicators, making it possible to assess whether they were achieved or not A chievable: Results must be within the capacity of the UNCT and partners to achieve R elevant: Results must make a contribution to selected priorities of the national development framework T imebound: Results are never open-ended - there is an expected date of accomplishment M&E Definitions: Results – RBM approach

The chain of results: causal sequence for an intervention to achieve desired objective UNCT 26 th February Management. Training. Counseling. Logistic management. Operation research. BCC. Conference. Facilitation. etc.. Services - Access - Quality. Awareness. Knowledge. Attitude. Capacities. Competency. Opinion. Aspiration. Motivation. Behaviors. Practices. Decision. Utilization of services Quality of life Conditions:. Human. Economic. Civic. Environment MDGs:. Poverty. Morbidity. Mortality. HIV prevalence. Education. Employment. Gender equality INPUTS ACTIVITIES OUTPUTS OUTCOMES IMPACT. Infrastructure. Human. Finance. Equipment. Technology. Policy. Time. Volunteers. Partners Measure process Measure impact

PlanningImplementation Outcomes -Formative Evaluation (Planning and Assessment) -Input/Output Monitoring -Process Evaluation -Outcome Monitoring -Outcome Evaluation -Impact Monitoring -Impact Evaluation What & how well we are doing?

Baselines, targets and performance Current level of achievem ent Commitment Performance Baseline TargetAchievement

WFP Emergency Operation M&E Framework Program-based Data Population-based Survey X kg maize, X kg oil X Kg other Input (Resources) Distribution of Family ration to Women Activities ( Interventions, Services) # of family ration recipients disaggregated by gender Output Targeted women receiving full family ration % of target house Hold with adequate Food supply Outcomes Increased household food supply Average # of Meals per day by gender and age Impact Increased consumption especially W, Ch & V Ind. Measure processMeasure impact RESULTS

HIV/AIDS M&E Framework Program-based Data Population-based Biological, Behavioral & Social Data Staff Funds Materials Facilities Supplies Input (Resources) Trainings Services Education Treatments Interventions Activities ( Interventions, Services) # Staff Trained # Condoms Provided # Clients Served # Tests Conducted Output (Immediate Effects) Situation Analysis Response Analysis Stakeholder Needs Resource Analysis Collaboration plans Program Development Data Assessment & Planning Provider Behavior Risk Behavior Service Use Clinical Outcomes Quality of Life Outcomes (Intermediate Effects) Social Norms HIV prevalence STI Incidence AIDS Morbidity AIDS Mortality Economic Impact Impact (Long-term Effects) Measure processMeasure impact

M&E Definitions: Indicators An Indicator is…. a variable that measures one aspect of a program/project and useful to measure changes Indicators are measures used to monitor progress made towards the achievement of intended RESULTS, considering as the output, outcome or impact of a development intervention.

M&E Definitions: SMART Indicators Specific: indicators need to measure what they claim to measure Measurable: can be quantified and measured by some scale Achievable: can data on the indicator actually be colleted? Relevant: does it provide information that is relevant to the programme decision makers? Time-bound: when is change expected?

Strategic Planning for M&E: Setting Realistic Expectations Most Some Few* All Input/ Output Monitoring Process Evaluation Outcome Monitoring / Evaluation Levels of Monitoring & Evaluation Effort Number of Projects 15 Impact Monitoring / Evaluation

Key messages: 1.The main purpose of M&E is programme/project improvement. 2.M&E is not only about INDICATORS. 3.M&E is an essential management tool and it is present along programme/project implementation. 4.M&E starts with the planning process.

THANK YOU