1.  Policy requirement – achieving 100% coverage  Unit of accountability – 20 countries of focus  Paris principles – non investment issues  An integrating.

Slides:



Advertisements
Similar presentations
HELPING THE NATION SPEND WISELY Performance audit and evaluation: common ground with Internal Audit ? The UK National Audit Office experience Jeremy Lonsdale.
Advertisements

Transparency and promotion of the CDM
IAOD Evaluation Seminar Demystifying Evaluation in WIPO- Best Practices from Initial Evaluations Geneva November, KENYA COUNTRY IP PORTFOLIO.
Comparative Study of MOPAN and EvalNet Approaches to Assessing Multilateral Organizations’ Development Effectiveness James Melanson Director, Development.
From e-Government to e-Governance: The OECD Experience Elizabeth Muller E-Government Project OECD SitExpo February 1004, Casablanca - Morocco.
Thematic evaluation on the contribution of UN Women to increasing women’s leadership and participation in Peace and Security and in Humanitarian Response.
Assessing student learning from Public Engagement David Owen National Co-ordinating Centre for Public Engagement Funded by the UK Funding Councils, Research.
Strategic Value of the HR Function Presentation by
AusAID Bilateral Donor System Country Program Evaluations included in Performance Management and Evaluation Policy (PMEP) of the Agency Part of Tier 2.
- 1 - RSPG on the Radio Spectrum Policy Program (RSPP) Brussels, 23 March 2010.
1 Professionalising Programme & Project Management Developing programme & project management capacities for UNDP and national counterparts External Briefing.
Progress Toward Impact Overall Performance Study of the GEF Aaron Zazueta GEF Evaluation Office Hanoi, March 10, 2010.
Project Monitoring Evaluation and Assessment
SASQAF South African Statistical Quality Assessment Framework
Commissioning Research and Evaluation – a commissioner’s perspective Ivan Grimes Assistant Director Southern & Eastern Regional Assembly.
CEET Conference 2008 Is Quality Assurance Improving? Rob Fearnside, Deputy Director VRQA.
“Writing our own narratives” The Global Advocacy Agenda for Young People Living with HIV.
Session 3 - Plenary on implementing Principle 1 on an Explicit Policy on Regulatory Quality, Principle 3 on Regulatory Oversight, and Principle 6 on Reviewing.
Analysis of the SNV Rwanda Gender Audit Report to Staff on Results of Gender Analysis Dr Shirley Randell AM.
Independent CRP-Commissioned External Evaluation of the CGIAR Research Program (CRP): Agriculture, Nutrition and Health (A4NH) INCEPTION REPORT AND PROPOSALS.
Instructional System Design
Building Our Curriculum
D-1 McGraw-Hill/Irwin ©2005 by the McGraw-Hill Companies, Inc. All rights reserved. Module D Internal, Governmental, and Fraud Audits “I predict that audit.
Impact assessment framework
Launch of Barcelona Principles September 2015.
Assessment on the implementation of the Mediterranean Strategy for Sustainable Development Dr Nicola Cantore Overseas Development Institute,
“Learning from Existing Evaluation Practices on the Impacts and Effects of Intellectual Property on Development” Geneva 6th/7th October 2011 Evaluation.
Irene Khan – Secretary General Building effective and responsive INGOs, the strategic role of HR: The IS Job Value Review 8 February 2008.
Taking account of culture: Lessons from Iraq Rebecca Ingram: Senior Schools Adviser, British Council Peter Fell: Consultant for.
A Comparison of 42 Local, National, and International HIA Guidelines Andrew L. Dannenberg, MD, MPH Katherine Hebert, MCRP Arthur M. Wendel, MD, MPH Sarah.
1 Mid-Term Review of the Hyogo Framework for Action Roadmap to Disaster Risk Reduction in the Americas & HFA Mid-Term Review.
Assessing The Development Needs of the Statistical System NSDS Workshop, Trinidad and Tobago, July 27-29, 2009 Presented by Barbados.
User needs Iain MacLeay – Head Energy Balances, Prices and Publications Date May 2009.
EU COMMON STRATEGIC FRAMEWORK FUNDS IN ENGLAND INITIAL PROPOSALS FROM HMG 21 NOVEMBER 2012.
Improving Outcome Measurement Scottish Annual Statistics Users Conference 29/10/09 Dr Mark McAteer Director of Governance & Performance Management.
Developing Consensus Principles and Standards for Evaluating Global and Regional Partnership Programs (GRPPs) Progress Report to the Fifth Meeting of the.
The Political Economy of Climate Finance – A Donor Perspective Malcolm Smart Senior Economic Adviser Department for International Development Governance.
The Role and Impact of Public-Private Partnerships in Education Harry Anthony Patrinos Felipe Barrera-Osorio Juliana Guaqueta The World Bank 2009.
Evaluation Seminar Czech Republic CSF and OP Managing Authorities Session 3: Mid-Term Evaluation.
Kathy Corbiere Service Delivery and Performance Commission
Quality Assessment of MFA’s evaluations Rita Tesselaar Policy and operations Evaluation Department Netherlands Ministry of Foreign Affairs.
Development of Education Quality Management System Ričardas Ališauskas Ministry of Education and Science of Lithuania Rotterdam.
Barcelona Declaration of Measurement Principles Presented June 17, 2010 Revised June 20, 2010 Final July 19, 2010 Global Alliance ICCO Institute for Public.
Capabilities Analysis Briefing for Chancellor and Senior Leaders.
Page 1 APAC ANNUAL TRAINING WORKSHOP 2011 The use of performance audit reports from AGSA 2 – 3 August 2011.
EVALUATION OF THE SEE SARMa Project. Content Project management structure Internal evaluation External evaluation Evaluation report.
Partnership Health: Evaluation and possibilities for an adapted structure Agenda item 11 Madhavi Bajekal, ONS (UK) PH coordinator Directors of Social Statistics.
Making Evaluation Work for Effective Policy Reform and Revision Chris Nelson, Director, Quality and Performance Systems Branch Sophie Davies, Manager Evaluations.
Commissioning Support Programme Post-16 Commissioning David Brown NASS Conference 9 th October 2009.
Practical Experiences - Evaluation of Program 1 Geneva January 29, 2016.
For Information only From distributor to Intelligent Funder.
Torbay Council Partnerships Review August PricewaterhouseCoopers LLP Date Page 2 Torbay Council Partnerships Background The Audit Commission defines.
Presentation at UKES and CDI, 27 and 9 April 2016 Jeremy Holland and Florian Schatz Evaluating complex change across projects and contexts: Methodological.
Building Our Plan Creating our Regional Action Plan
A PF Solutions Presentation
EVIDENCE BASED POLICY MAKING: THE CASE OF ALBANIA Michelle Jouvenal, ISTAT, Office for International Relations and Cooperation Stefano Pisani, Revenue.
Building Coalitions for Change Information, Consultation and Public Participation in Policy-making Experience from OECD countries Directorate for Public.
9/16/2018 The ACT Government’s commitment to Performance and Accountability – the role of Evaluation Presentation to the Canberra Evaluation Forum Thursday,
Internal Audit Strategy Survey Results & Discussion
Draft OECD Best Practices for Performance Budgeting
Vision.
TERMS OF REFERENCE FOR EVALUATIONS FACT SHEET TYPE LOCATION PERIOD
Producer – User Dialogue
EVIDENCE BASED POLICY MAKING: THE CASE OF ALBANIA Michelle Jouvenal, ISTAT, Office for International Relations and Cooperation Stefano Pisani, Revenue.
Quality in Evaluation: the international development experience
Background Initiated by the MDB Working Group on MfDR 2004
Efficiency and effectiveness of the GST
2.7 Annex 3 – Quality reports
Étienne Saint-Pierre, Statistics Canada
Presentation transcript:

1

 Policy requirement – achieving 100% coverage  Unit of accountability – 20 countries of focus  Paris principles – non investment issues  An integrating narrative  History 2

 After 4 years and nearly 20 CPEs – time to reflect  Does the standard methodology serves us well? ◦ Rating scales ◦ Project samples ◦ Numerous criteria  What is the audience? Are users satisfied?  International literature, analysis of past CPEs, interviews with senior executives, program managers, Evaluation Committee, representatives of bilateral development agencies, and external consultants. 3

 Option 1: Status quo – strong on accountability (external audience)  Option 2: More learning and user focus  Option 3: Totally decentralised – let programs take the lead  Overwhelming preference – Option 2 4

Revised Focus for CPEs  Better balance between learning and accountability, but retain rating scales  More focus on depth than breadth of analysis  More analysis of policy coherence across delivery channels  More thorough analysis of Relevance and Rationale (doing the right things?)  More emphasis on program than projects 5

Modifications to Design & Methodology  Greater flexibility in evaluation design and products  Use of a smaller number of evaluation criteria and simplified rating system  VfM – improved measures for Efficiency, Economy and Equity  Increased use of contribution analysis  Targeted coverage of delivery channels  Improved usefulness of recommendations 6

 Renewed emphasis on neutrality and engagement  Clarity of roles between DFATD and consultants  Improved availability of supporting documents/ data for data collection and analysis  More timely evaluations to increase their usefulness to programs 7