We think you have liked this presentation. If you wish to download it, please recommend it to your friends in any social system. Share buttons are a little bit lower. Thank you!
Presentation is loading. Please wait.
Published byCarley Gorin
Modified over 6 years ago
© 2009 Berman Group. Evidence-based evaluation RNDr. Jan Vozáb, PhD partner, principal consultant Berman Group
© 2009 Berman Group. Objectives of the evidence-based evaluation To increase impact and value added of the Cohesion Policy interventions To increase effectiveness and efficiency of interventions in terms of achieving results that make real (and desirable) changes To provide better and more reliable information for strategic management of OPs
© 2009 Berman Group. Key issues and dilemmas Evidence is always part of its context – explanation of findings is part of the evidence-based evaluation The more complex, complicated or integrated is the intervention, the more difficult is to obtain reliable, strong evidence of its effects The better is the evidence for measuring of effects, the more difficult is to cause them by the intervention itself
© 2009 Berman Group. Evaluators´ position Real issues MAs intentions Interventions / Operations Outcomes of interventions Real effects Evaluation
© 2009 Berman Group. Programming issues related to evidence-based evaluation Problem and needs identification Definition of objectives Planning of operations Set up of targets and indicators structure Implications for evaluations: Difficulties to link outcomes to the objectives and needs Difficulties to find evidence of real effects of operations (although they exist) Intervention logic
© 2009 Berman Group. Implementation issues related to evidence-based evaluation Random or non-targeted selection of projects Week coordination of operations within OP Feedback on outcomes for management purposes Costs to track evidence on results/impacts Implications for evaluation: Complicated establishing of evidence on outcomes from available data sets Lack of suitable data for evaluation – monitoring data only
© 2009 Berman Group. Methodological issues related to evidence-based evaluation Formulation of evaluation questions Use of representative data Explanation of findings in proper context Deriving conclusions, providing recommendations Implications for evaluation: Evidence based on intervention logic Availability of data Combination of qualitative and quantitative evidence
© 2009 Berman Group. Recommendations for improving evidence-based evaluation To make sure that programming is sufficiently evidence-based as a prerequisite for evaluation To strengthen vertical and horizontal intervention logic within and among OPs and partnership contract To make sure that operations aim at causes of problems and are sufficiently coherent and focused To strengthen management capacity of MAs: –To manage operations and deliver interventions –To take more responsibility for results and wider effects of interventions (not only for indicators/targets)
© 2009 Berman Group. Recommendations for improving evidence-based evaluation To strengthen analytical capacity and skills of evaluators To use evaluation in a better way to support decision-making: –Small, targeted, ad hoc evaluations –To adjust monitoring systems for evaluation purposes –To strengthen links between evaluators and professionals in thematic fields To establish or strengthen feedback on incorporation of evaluators´ findings into OP management
© 2009 Berman Group. Thank you for your attention Jan Vozáb email@example.com
Delivering as One UN Albania October 2009 – Kigali.
Evaluation of ESF Support for Roma integration Dominique Bé EURoma, 10 November 2011, Budapest.
Assessment of administrative and institutional capacity
Piedmont Region - Italy Supporting Equal DPs – The Experience of the Piedmont Region Erica Giordano.
1 EU Strategy for the Baltic Sea Region Evaluation: Setting Outcome Indicators and Targets Seminar: 15 March 2011, La Hulpe Veronica Gaffey Acting Director.
Operational Programme I – Cohesion Policy Event part-financed by the European Union European Regional Development Fund Evaluation Plan for Maltas.
POLAND Development Management System in Poland Brussels, 2 July 2010.
Intelligence Step 5 - Capacity Analysis Capacity Analysis Without capacity, the most innovative and brilliant interventions will not be implemented, wont.
Evaluating administrative and institutional capacity building
Working Together Strategic Review of Community Safety 2009.
Donald T. Simeon Caribbean Health Research Council
South Pacific Board for Educational Assessment M & E Teacher Performance Improving teaching effectiveness Capacity Building Workshop on ‘Monitoring and.
Lucila Beato UNMIL/HRPS
Fourth National Justice Modelling Workshop Criminal Justice Sector Transformation - Calculating Social & Economic Benefits 10 July 2008 Case Study Presentation.
Improving the added value of EU Cohesion policy Professor John Bachtler European Policies Research Centre University of Strathclyde, Glasgow
Evaluating Collaboration National Extension Family Life Specialists Conference April 28, 2005 Ellen Taylor-Powell, Ph.D. Evaluation Specialist University.
Enhancing Data Quality of Distributive Trade Statistics Workshop for African countries on the Implementation of International Recommendations for Distributive.
CPPE AND IFAD’s PROJECT CYCLE P. Kolsteren and P. Lefèvre.
Quality evaluation and improvement for Internal Audit
Challenge Questions How good is our operational management?
© 2020 SlidePlayer.com Inc. All rights reserved.