1. Ariel Fiszbein, HD Chief Economist April 29, 2010 Measuring Governance: Actionable Governance Indicators in HD 1

2. Outline Context: What is governance in HD? Why measure governance? A framework for measuring governance policies and performance; Measuring dimensions of service delivery; Innovations in methodologies and tools; Resources for Task Teams. 2

3. HD outcomes The Context: Improved governance is needed to make services work Quality of social service delivery Governance: Incentives to providers Accountability for results Demand for good governance 3

4. Why Measure Governance? The Shock Factor: Measurement allows for benchmarking; Both inter- and intra-national; Does it work? Measurement allows for impact evaluation; Need to measure along the results chain to assess what works; Look inside the “black box” of service delivery: Measurement can improve project monitoring; Intermediate service delivery indicators are referred to as the “missing middle;” Indicators needed for results-based projects – can’t contract or pay without measurement. 4

5. Governance Policies and Performance Governance has two measurable dimensions: Governance policies, or “rules of the game,” that influence provider behavior; E.g. human resource policies that establish hiring, firing, and rewarding of teachers and doctors; Governance performance, or the extent to which governance policies work in practice; E.g do teachers and doctors show up for work? Governance policies and performance influence the quality of service delivery; E.g quality at the point of service; quality measurement is elusive but there is progress. 5

6. A Measurement Framework Governance Policies HR policies Budget and financial management Information Procurement rules Rules for provider entry Service Delivery Governance performance Quality Outcomes Completion rates Learning outcomes Morbidity Mortality 6

7. Measuring Policies and Performance Degree of meritocracy in hiring; Provider Absenteeism; purchase of positions. Human resources Existence of clear rules for the budget cycle; Leakage. Budget Existence of complaints mechanisms; Numbers of complaints resolved. Information Existence of an essential medicines list; Drugs: stock out rates. Procurement Requirements for operating a private facility; Frequency of inspections of private facilities. Entry 7

8. Measuring Governance: Where do we stand? 8

9. GPF Pilots in Health 9

10. GPF Pilots in Education 10 Objective: Measuring governance performance “in practice” through facilities surveys; Focus on teacher policies including: recruitment; training; compensation; performance evaluation; Pilot study underway in India: instruments are being tested at the state, district, village and school levels; full data collection in June-July 2010; Additional countries may include Nepal, Mexico and Tanzania.

11. Pilot with Global Integrity: Indicators of Information in Health and Education (examples) 11 Existence and usability of information in Healthcare and Education Is the Ministry of Education’s overall budget available to citizens? Redress mechanisms to enforce accountability Do formal processes exist to receive citizen complaints? Availability of Fiscal/Budget information Does information exist on whether school/medical facilities receive funds budgeted from state/local governments? Influence of information availability on citizen participation in local decision making Are citizens aware of basic rights to participate in formal community groups/forums?

12. Resources for Staff: Knowledge and Tools 12 Framework paper on Measuring Governance by Fiszbein, Ringold and Rogers; Database of indicators and definitions; Database of indicators and definitions GPF-funded country pilots in health and education; Social protection indicators under development; Teacher Policies Around the World (TPAW); Website and discussion paper (forthcoming).

13. Additional Resources 13 Public Expenditure Review (PER) Toolkit (On-Line); Quality of Medical Care Case Studies and Tools (On-Line); Error, Fraud and Corruption Toolkit in Social Protection (On-Line); Public Expenditure Tracking Survey and Absenteeism Guidance Notes and “One-Stop-Shop” PETS/QSDS portal (forthcoming). www.worldbank.org/hdchiefeconomist

14. Future Plans 14 Expand database of definitions (a ‘living database’); Mainstreaming data collection Summary volume based on the 5 health surveys; Expansion of TPAW in other regions; Support to teams for PETS/QSDS and absenteeism surveys (training; clinics-on-demand); Piloting new areas of data collection Information indicators building on the work with Global Integrity.

15. Thank You 15

16. 16