American Evaluation Association Anaheim, 5 November 2011 EVALUATION OF THE THE PARIS DECLARATION SECOND PHASE PARTNER COUNTRY PERSPECTIVE Case: BOLIVIA Jaime A. Garron Bozo Chief, Financing Negotiations Unit Ministry of Development Planning - Bolivia

RELEVANCE and VALUE ADDED OF EVALUATING THE PARIS DECLARATION The international agenda in development cooperation is full of political commitments… Multiple Fora + Multiple Actors = Multiple Commitments RELEVANCE of the Paris Declaration: Quantitative targets Monitoring and evaluation. To date, +130 partner countries and development partners have adhered to the Declaration ODA in Iberoamerican Countries ( ) Developing Countries Iberoamerican Countries US$ Millions

BOLIVIA AND THE PARIS DECLARATION: MONITORING AND EVALUATION Monitoring Surveys: Evaluation Phase 1: 2007Phase 2: 2010

AID EFFECTIVENESS DEVELOPMENT EFFECTIVENESS  POLICY COHERENCE FRAMEWORK: AREAS NOT DIRECTLY RELATES TO ODA: TECHNOLOGY TRANSFER, CAPACITY DEVELOPMENT, EFFFECTIVE ACCES TO MARKETS, ETC).  UNFINISHED AGENDA: AID EFFECTIVENESS. AID EFFECTIVENESS DEVELOPMENT EFFECTIVENESS  POLICY COHERENCE FRAMEWORK: AREAS NOT DIRECTLY RELATES TO ODA: TECHNOLOGY TRANSFER, CAPACITY DEVELOPMENT, EFFFECTIVE ACCES TO MARKETS, ETC).  UNFINISHED AGENDA: AID EFFECTIVENESS. The road ahead…

EVALUATION STRUCTURE NATIONAL EVALUATION TEAMS INDEPENDENT FIRM: STRATEGY ADVISORS FOR GOVERNMENT REFORM (SAX gr). INDEPENDENT FIRM: SUPPLEMENTARY STUDY ON TECHNICAL ASSISTANCE NATIONAL COORDINATION Ministry of Development Planning DONOR FOCAL POINTS The Dutch Embassy and the Spanish Cooperation Agency for Development

NATIONAL REFERENCE GROUP MINISTRY OF DEVELOPMENT PLANNING MINISTRY OF FOREIGN AFFAIRS DUTCH EMBASSY – DONOR FOCAL POINT SUBNATIONAL GOVERNMENTS: FEDERATION OF MUNICIPAL ASSOCIATIONS CIVIL SOCIETY REPRESENTATIVES: 3 ROUNDS OF MEETINGS CONSORTIUM OF NGOs – UNITAS COMMUNITY BASED REPRESENTATIVE ACADEMIA: EXECUTIVE COMMITTEE OF UNIVERSITES COMPRISING ALL MAJOR PUBLIC UNIVERSITIES

Document, analyze and assess the relevance and effectiveness of the Paris Declaration in Bolivia and its contribution to aid effectiveness and, ultimately, development outcomes, including the reduction of poverty. OVERALL Document results achieved in Bolivia, since 2005 in light of the PD. Provide inputs that can allow development partners, the Government, and stakeholders involved, to strenghten and improve development practices according to the DP. Highlight barriers and challenges that prevented aid effectriveness principles to be fully applied, and identify initiatives to overcome such scenario. To allow –through the evaluation process- that stakehokders share, exchange and possibly learn from each other’s lessons learned. OBJECTIVE

PHASES OF THE EVALUATION COVERAGE 13/20 Agencies participated 87 interviews to Civil Society, Government and Donors representatives 13 forms filled by cooperation agencies 3 focal groups 2 Workshops Field Work 4 4 Validation and data Gathering 5 5 Presentation Preparation 2 2 Instruments Design METHODOLOGY

International Framework: i) the PD within the context; ii) processes and intermediate effects, iii) impacts of development and iv) framework for general conclusions. Bolivia’s Focus: i) Role and implications of implementing agencies for effective aid; ii) Relationship between government and international cooperation: retrospective and outlook, iii) South - South cooperation, iv) Assistance for programs versus Assistance for projects, iv) Financial Operations and use of national systems, v) Social control mechanisms and accountability schemes. Witness Sector: Health Thematic Extent Three levels of government: National, Departmental (Departmental governments of La Paz and Santa Cruz) and municipal (Municipal Governments of La Paz, Sucre and Cobija). Selection of sub-national analysis sought to balance: i) regional (East and West); ii) population size (large, medium and small municipalities) and iii) Significant volume of aid commitments recorded by Subnational Governments. Spatial Extent

LEARNING PROCESS Independent evaluation. Exchange of ideas and feedback from the Core Team and the possibility of accessing the extranet of the Evaluation of the Declaration of Paris. Having a Reference Group involving main stakeholders facilitated dialogue, although not as frequent as expected South-South cooperation with the Colombian evaluation team. Political and operational support of the Government. Openness to provide information on behalf of international cooperation. Knowledge and expertise of the national evaluation team. Provided valuable inputs for developing the Action Plan to Strengthening Development Cooperation Effectiveness in Bolivia, presented in October 2011 to the Executive Branch, and Donor Community. Opportunities

LEARNING PROCESS Time frame: late start of the evaluation. Involving emerging “Non-Paris” donors in the evaluation proved to be difficult, including major South-South providers. Difference in information recording (government and donors). Lack of conceptual agreement and mutual understanding (i.e. technical cooperation). Evaluation timing matched the budgetary process (difficulty to conduct in depth interviews) Staff mobility (institutional memory) Unrecorded information led to an exhaustive revision of aid agreements (tied aid, preconditions, etc.) Lack of substantive evidence in some cases, to make a stronger case. Challenges

MAIN CONCLUSIONS The “pass-through effect” from political commitments into concrete actions in the field has proven challenging. There appears to be some “inertia” between bilateral and multilateral donors to different degrees, but also the government. Need to clarify roles. There is no clear “transmission mechanism”, many stakeholders involved. (i.e. Busan Outcome document) Having a clear and simple methodology, as well as understanding of the PD process has helped not to look for unexisting causalities. Context is crucial.

INTERNATIONAL AND NATIONAL CONTEXT NATIONAL INTERNATIONAL

MAIN CONCLUSIONS. Involving stakeholders to undertake a peer review (NRG) is very challenging, based on past behavior. Should be done more often. The PD evaluation process has paved the way for developing an Action Plan, and has strengthen the bridges for dialogue and constructive criticism with donors with respect with development cooperation implementation.

ACTION PLAN Results Based Management. – Monitoring and Evaluation – Mutual Accountability – Division of Labor – Information and Communications Technologies Capacity Development and Technical Assistance – South- South and Triangular Cooperation – Training Programs for the Public Sector (International Cooperation Management) Regulatory Framework – CSOs – Subnational autonomies – Technical Assistance – Code of Conduct (Global light – Country Heavy)

American Evaluation Association Anaheim, 5 November 2011 THANK YOU…