Presentation is loading. Please wait.

Presentation is loading. Please wait.

MAPP Marcos C. Holanda Monitoring and Evaluation of Priority Programs Banco Interamericano de Desenvolvimento Management for Development.

Similar presentations


Presentation on theme: "MAPP Marcos C. Holanda Monitoring and Evaluation of Priority Programs Banco Interamericano de Desenvolvimento Management for Development."— Presentation transcript:

1 MAPP Marcos C. Holanda Monitoring and Evaluation of Priority Programs Banco Interamericano de Desenvolvimento Management for Development Results at Sub-national Governments

2 Banco Interamericano de Desenvolvimento RBM - MAPP RBM – Governance Strategy MAPP – Operational Instrument

3 Banco Interamericano de Desenvolvimento It is important to differentiate Planning  Projects selection Administration  Projects execution Management  Systemic coordination of projects based on results

4 Banco Interamericano de Desenvolvimento What RBM is About 1.Do less but do Better. 2.Outcomes prevail over outputs. 3.Outcomes put citizens first. Outputs put government first. 4.Outcomes as driving force to programs integration. 5.Outcomes to differentiate good from bad programs. 6.A permanent cycle of learning: Planning-Budgeting-Monitoring- Evaluation. 7.An instrument for recognition and compensation of good performance of government employees.

5 Banco Interamericano de Desenvolvimento RBM GOVERNMENT STRATEGIC OUTCOMES DEPARTMENT STRATEGIC OUTCOMES DEPARTMENT PROGRAMS DEPARTMENT OUTPUTS DEPARTMENT PROJECTS AND ACTIVITIES DEZIGN IMPLEMENTATION GOVERNMENT PLAN

6 Banco Interamericano de Desenvolvimento Requirements for a successful RBM  To have information – outcome and output indicators  To know how to use the information – information affect budget decisions  To have a budget based on results – RBM defines the budget and not the contrary  To know what it is and how to do RBM – Institutional and operational capacity to implement RBM

7 Banco Interamericano de Desenvolvimento Guidelines for RBM 1.Operational flexibility in searching for results. 2.Medium term budget. 3.Increments in the budget are based on increments in the results. 4.Look for “good or better practices” and not for “best practices”.

8 Banco Interamericano de Desenvolvimento MAPP Planning Monitoring Evaluation

9 Banco Interamericano de Desenvolvimento MAPP Application Card 1.PLANNING  Selection of Projects  Application Card MAPP Monitoring 2.MONITORING  Outputs  MAPP Monitoring Macro Evaluation a) Government Outcomes b) Integration Matrix Micro Evaluation 3.EVALUATION  Outcomes  Micro Evaluation a) Design Evaluation b) Impact Evaluation

10 Banco Interamericano de Desenvolvimento

11 Project Application Card PLANNING  Project Application Card 1.The problem to be faced. 2.The government outcomes to be targeted. 3.The department outcomes to feed the government ones. 4.The outputs to be delivered. 5.The outcomes and outputs indicators. 6.The targeted population or region. 7.The time frame of expected outcomes. 8.The sources of financing. 9.The expected efficiency (benefits-costs analysis). 10.The expected integration with others projects.

12 Banco Interamericano de Desenvolvimento Project Application Card PLANNING  Project Application Card

13 Banco Interamericano de Desenvolvimento Project Application Card PLANNING  Project Application Card

14 Banco Interamericano de Desenvolvimento Project Application Card PLANNING  Project Application Card

15 Banco Interamericano de Desenvolvimento Project Application Card PLANNING  Project Application Card

16 Banco Interamericano de Desenvolvimento MAPP Monitoring MONITORING  MAPP Monitoring

17 Banco Interamericano de Desenvolvimento MAPP Monitoramento MONITORING  MAPP Monitoramento

18 Banco Interamericano de Desenvolvimento MAPP Monitoramento MONITORING  MAPP Monitoramento

19 Banco Interamericano de Desenvolvimento MAPP Monitoramento MONITORING  MAPP Monitoramento

20 Banco Interamericano de Desenvolvimento Macro Evaluation EVALUATION  Macro Evaluation Government Outcomes IndicadoresSinalização Nota SAEB e ESPAECE ▬ Distorção Idade Série ▲ Taxa Escolar Líquida: Ensino Fundamental ▼ Taxa Escolar Líquida: Ensino Médio ▲ Taxa de Analfabetismo (>15 anos) ▲ (de 7 a 14 anos) ▬ Taxa Mortalidade Infantil ▲ Razão Mortalidade Materna ▲ Taxa Internação AVC (> 40 anos) ▼ Taxa de Roubos ▼ Taxa de Furtos ▬ Taxa de Homicídio ▼ Renda Domiciliar Per Capita (R$) ▲ Porcentagem Extrema Pobreza ▲ Índice de GINI ▲ IndicadoresSinalização Saldo de Empregos Formais (Novos Postos) ▲ Taxa de Crescimento do PIB (%) ▬ Fluxo de Comércio Exterior ▲ PIB Interior / PIB RMF (%) ▼ Consumo de Energia Residencial: Interior / RMF (%) ▲ Empregos Interior / Empregos RMF (%) ▬ IndicadoresSinalização Div / PIB (%) ▲ Div / RCL (%) ▲ Resultado Primário ▲ Custeio / RCL (%) ▲ Pessoal / RCL (%) ▲ Gastos Finalísticos / RCL (%) ▬ Investimento / RCL (%) ▼ Número de Acessos às Páginas WEB do Governo ▲ Social Outcomes Social Outcomes Economic Outcomes Economic Outcomes Governance Outcomes Governance Outcomes

21 Banco Interamericano de Desenvolvimento Macro Evaluation EVALUATION  Macro Evaluation Integration Matrix Programs Integration Matrix Government Outcome # 1 Government Outcome # 2 Government Outcome # 3 Economic Growth Program 1 Program 2 Program 3 Program 4 Program 5 Program 6 ResultBasedBudget

22 Banco Interamericano de Desenvolvimento Micro Evaluation EVALUATION  Micro Evaluation Design Evaluation Inputs Activities Outputs OutcomesImpacts Logical Framework Monitoring Outputs delivered X Planned Outcomes

23 Banco Interamericano de Desenvolvimento Micro Evaluation EVALUATION  Micro Evaluation Design Evaluation a) Education:. Primary education schooling rate. Secondary education schooling rate. 4 th grade promotion rate. b) Health:. Infant mortality rate. Cerebral Vascular Accident (CVA) admittance rate c) Living Conditions:. Proportion of urban domiciles with regular water supply. Proportion of urban domiciles with sewage d) Employment and income:. Average residential energy consumption. Formal employment quality index. Average establishments’ size e) Rural Development:.Gross value of the agricultural production per rural establishment. Proportion of energy consumption in rural areas OUTCOMESOUTPUTS a) Education:. Proportion of teachers in primary education with bachelor degrees. Proportion of teachers in secondary education with bachelor degrees. Libraries, reading rooms and computer labs per public school; and. Computer equipments per public school. b) Health:. Prop. of women assisted during the first 3 months of pregnancy. Proportion of children (2 years old or younger) assisted. Proportion of the population assisted by the Family Health Program c) Living conditions:. Urban water supply coverage rate. Urban sewage coverage rate d) Employment and income:. Secondary enrollment – total enrollment ratio. Health professionals per 1,000 inhabitants. Paved roads – municipality area ratio. e) Rural development:. Mean value of rural loans. Assisted producers per rural establishment

24 Banco Interamericano de Desenvolvimento Micro Evaluation EVALUATION  Micro Evaluation Impact Evaluation Probability (Recidivism) = F(age, gender, approach period, activity, per capita family income, guardian education, benefit) VariablesCoeficientdY/dXP Value Age Gender Approach period Activity Per Capita Family Income Guardian Education Benefit Constant Number of observations8397Pseudo R Source: IPECE Program Evaluation: Criança Fora da Rua Dentro da Escola

25 Banco Interamericano de Desenvolvimento LESSONS 1.Strategic leadership(Governor, Mayor) and operational leadership(line secretary) are crucial. 2.It is very Important a clear understanding of RBM concepts. 3.It is important to show that RBM is about opportunity and not a threat. 4.The selection of output and outcome indicators can be very tricky.

26 Banco Interamericano de Desenvolvimento LESSONS 5. It is important to explain the difference between Monitoring and Evaluation: Monitoring  Good Accounting Evaluation  Good Economics 6. Before impact evaluation, ask for design evaluation (quick evaluation) for the main Program/Project. 7. Keep the RBM policy as simple as possible. 8. RBM requires 3 P’s ( a different kind of PPP): Patience + Persistence + Passion

27 Banco Interamericano de Desenvolvimento Thanks!


Download ppt "MAPP Marcos C. Holanda Monitoring and Evaluation of Priority Programs Banco Interamericano de Desenvolvimento Management for Development."

Similar presentations


Ads by Google