MAINSTREAMING MONITORING AND EVALUATION IN EDUCATION Can education be effectively managed without an M & E system in place?

KEY QUESTIONS ABOUT OUR EDUCATION SYSTEM How is our education system doing? Are we providing the right kind of education for our children? (relevancy) Who is benefiting from the education we provide? (EFA, No child left behind) Who are we targeting in our education? (Any marginalized group) Do we have the resources we need (physical and human)?

What skills do children acquire when they leave school? (Life Skills) How are teachers/principals doing? (effectiveness) What are the crucial areas we need to focus on? (gaps, priority) What assistance do we need and in what area? Which part of the system is not working well? Etc KEY QUESTIONS ABOUT OUR EDUCATION SYSTEM

DO WE HAVE ANSWERS? Yes, I know all the answers!!!! Well, I know the answers to some but not all No, I do not know the answers but I know our system and what it needs No I do not know the answers and I need guidance and assistance But on what basis do we decide? Do we have the information to enable us, as managers, to provide answers?

MONITORING AND EVALUATION, WHAT IS IT? A process and a tool that provides the information you need to answer each area of concern about the system A system used to determine, using reliable and valid evidence, the extent to which set goals have been achieved Must be demand-driven and based on information needed by country Necessary process that helps managers to manage, plan and make sound policy decisions

Top-down approach to M&E results in narrow perception of process and lack of commitment at country level resulting in questions about sustainability Country driven engagement in M&E indicates commitment towards improving delivery of services and ownership of process Engagement in M&E and collecting information does not guarantee improve performance MONITORING AND EVALUATION, WHAT IS IT?

Value of M&E comes when information is used to improve performance M & E system used to measure the quantity, quality and targeting of the services provided (inputs and processes) as well as the output, and the outcomes and impacts of such outputs Information collected through M&E process provides opportunity to understand causes of both negative and positive performances M&E could be carried out at project, program or sector level MONITORING AND EVALUATION, WHAT IS IT?

Ownership of M&E is important in ensuring commitment rather than simply satisfying external requirement. Need a system in place to ensure collection of relevant and appropriate information No M & E in place makes it difficult to manage and achieve goals M & E system does not guarantee improvement but makes it easier to improve. IMPLEMENTING MONITORING AND EVALUATION

INSTITUTIONALIZING MONITORING & EVALUATION M & E not only put in place to monitor progress for donor funded projects, instead it should be part of normal process of trying to improve overall performance Need to ensure that M & E system in place is sustainable, and information collected is used in all aspects of operation; policy formulation/revision, planning, transparency and accountability, management including resource allocation

Successful institutionalization of M & E depends on how countries make use of the information collected (monitoring) Use of information depends on ability to analyze and evaluate information to identify key messages relating to performance (evaluation) and on need for information Current focus on M&E on information collection (monitoring) with little effort on identifying key messages (evaluation) information convey INSTITUTIONALIZING MONITORING & EVALUATION

Tool enable identification and collection of information relating directly to extent to which goals are being addressed (performance) Identifying appropriate indicators crucial in ensuring valid information is collected Indicators directly linked to objectives to be monitored Cover all dimensions of the goal being monitored IDENTIFYING RELEVANT AND APPROPRIATE INDICATORS

Mindful of number of indicators as each indicator has cost implication Information system in place in order to make indicators available Indicators make it possible to mobilize available information Indicators facilitate identification of problems and measures extent, also alerts decision makers of any possible problem areas so solutions can be identified Managing education without M&E/Indicators is like sailing a ship without a compass

SUSTAINABILITY OF M&E SYSTEMS Depend on the demand for information and what information is used for; making informed decisions Commitment from all key stakeholders towards evidence-based decisions and need for information for policy formulation, planning, resource allocation, etc. Capacity in areas of information collection, technology, analysis, evaluation Ownership by ministry of the process and not an imposed process

A key step in M&E development is setting up the goals ministry wants to pursue Complexity of M&E systems depends on the complexity of the goals and number of dimensions covered by each goal. Added to the complexity are the number of stakeholders involved in each goal and their need for information. DEVELOPING COUNTRY- DRIVEN M&E SYSTEMS

Clear Goals with clear indication of what is/are to be achieved Relevant indicators identified for each goal at appropriate levels (local, provincial, national, regional, etc.) Establish system to monitor and evaluate progress made in each goal Key stakeholders involved in addressing each goal Information each stakeholder needs to be collected in relation to each indicator

How information is used to improve performance How the monitoring is to be carried out? Who will collect the data to monitor progress in each goal? Who decides on indicators that will provide necessary information? How frequent should information be collected? KEY CONSIDERATIONS IN DEVELOPING M&E SYSTEMS

Who will be in charge of the data and its analysis? What are the timelines for reporting the data? Is there a strategy to deal with messages conveyed by information? Do countries have the capacity to sustain or mainstream M & E as part of normal process

WHY IMPORTANT TO MONITOR EDUCATION PERFORMANCE? Clarifies objectives and links activities and their resources to objectives Translates objectives into performance indicators and sets targets Compares actual results with targets Allows for reporting of progress to decision makers and alerts them to problems Provides information as basis for decision making

Helps implementation and re-designing programs and resource allocations to improve program/sector’s chances of achieving target Encourages comparison among programs and supports efficient and effective use of resources Promotes transparency and accountability in implementation and use of resources Encourages good practice in results-based management WHY IMPORTANT TO EVALUATE PERFORMANCE

AN EXAMPLE Goal – “Provide quality primary education for all by 2020” Key Issues - Access and quality Key ACCESS Considerations Key QUALITY Considerations

MAINSTREAMING MONITORING & EVALUATION IN EDUCATION Realizing the need for information at all levels of decision making Making the commitment to set up the system for M&E Ensuring sustainability of M & E system through capacity building, allocating necessary resources Move towards results-based management