We think you have liked this presentation. If you wish to download it, please recommend it to your friends in any social system. Share buttons are a little bit lower. Thank you!
Presentation is loading. Please wait.
Published byCarley Gorin
Modified over 2 years ago
© 2009 Berman Group. Evidence-based evaluation RNDr. Jan Vozáb, PhD partner, principal consultant Berman Group
© 2009 Berman Group. Objectives of the evidence-based evaluation To increase impact and value added of the Cohesion Policy interventions To increase effectiveness and efficiency of interventions in terms of achieving results that make real (and desirable) changes To provide better and more reliable information for strategic management of OPs
© 2009 Berman Group. Key issues and dilemmas Evidence is always part of its context – explanation of findings is part of the evidence-based evaluation The more complex, complicated or integrated is the intervention, the more difficult is to obtain reliable, strong evidence of its effects The better is the evidence for measuring of effects, the more difficult is to cause them by the intervention itself
© 2009 Berman Group. Evaluators´ position Real issues MAs intentions Interventions / Operations Outcomes of interventions Real effects Evaluation
© 2009 Berman Group. Programming issues related to evidence-based evaluation Problem and needs identification Definition of objectives Planning of operations Set up of targets and indicators structure Implications for evaluations: Difficulties to link outcomes to the objectives and needs Difficulties to find evidence of real effects of operations (although they exist) Intervention logic
© 2009 Berman Group. Implementation issues related to evidence-based evaluation Random or non-targeted selection of projects Week coordination of operations within OP Feedback on outcomes for management purposes Costs to track evidence on results/impacts Implications for evaluation: Complicated establishing of evidence on outcomes from available data sets Lack of suitable data for evaluation – monitoring data only
© 2009 Berman Group. Methodological issues related to evidence-based evaluation Formulation of evaluation questions Use of representative data Explanation of findings in proper context Deriving conclusions, providing recommendations Implications for evaluation: Evidence based on intervention logic Availability of data Combination of qualitative and quantitative evidence
© 2009 Berman Group. Recommendations for improving evidence-based evaluation To make sure that programming is sufficiently evidence-based as a prerequisite for evaluation To strengthen vertical and horizontal intervention logic within and among OPs and partnership contract To make sure that operations aim at causes of problems and are sufficiently coherent and focused To strengthen management capacity of MAs: –To manage operations and deliver interventions –To take more responsibility for results and wider effects of interventions (not only for indicators/targets)
© 2009 Berman Group. Recommendations for improving evidence-based evaluation To strengthen analytical capacity and skills of evaluators To use evaluation in a better way to support decision-making: –Small, targeted, ad hoc evaluations –To adjust monitoring systems for evaluation purposes –To strengthen links between evaluators and professionals in thematic fields To establish or strengthen feedback on incorporation of evaluators´ findings into OP management
© 2009 Berman Group. Thank you for your attention Jan Vozáb
EU Gender Advisory Services 2010 Gender Perspective in the Cycle of Operations Gender Perspective in the Cycle of Operations.
EVALUATION as an instrument of governance for a regional social plan Dr. Annamaria Casini (sociopolitical management expert) SULMONA - 22nd October 2012.
Workshop on Sector Approaches in the Context of EU Integration Sarajevo, Bosnia and Herzegovina March 2010 Debriefing of the Workshop on Sector Approaches.
The Project Cycle Management Course presented by Simon Pluess World Alliance of YMCAs.
Quality developments in VET An overview of the work of the European Forum on Quality in VET.
Piedmont Region - Italy Supporting Equal DPs – The Experience of the Piedmont Region Erica Giordano.
1 Results Based Monitoring (RBM) It is better to be approximately right than precisely wrong - John Maynard Keynes -
Learning from Existing Evaluation Practices on the Impacts and Effects of Intellectual Property on Development Geneva 6th/7th October 2011 Evaluation Section.
Methodologies for Assessing Social and Economic Performance in JESSICA Operations Gianni Carbonaro EIB - JESSICA and Investment Funds JESSICA Networking.
Donald T. Simeon Caribbean Health Research Council.
Country Environmental Analyses and Infrastructure Juan Carlos Belausteguigoitia Lead Environmental Economist World Bank IADB; November 2007.
Thematic evaluation on the contribution of UN Women to increasing women’s leadership and participation in Peace and Security and in Humanitarian Response.
© PRIMA-EF Consortium Evaluation of Best Practice Interventions for Work-related Stress © PRIMA-EF Consortium.
Module 2: National IEA process design and organization.
Delivering as One UN Albania October 2009 – Kigali.
1 Guidance document on ex-ante evaluation 15 March 2012 Joint presentation to the ERDF and ESF Evaluation Partnership Meeting.
NBFSE Financial instruments and mechanisms of fund allocation to social economy Common meeting 5-6 th December, Milano.
1 EU Strategy for the Baltic Sea Region Evaluation: Setting Outcome Indicators and Targets Seminar: 15 March 2011, La Hulpe Veronica Gaffey Acting Director.
Cohesion Policy focus on performance experiences of the Hungarian Presidency Dr. Györgyi Nyikos Deputy State Secretary for Development Affairs Ministry.
Linda Miller consultant physiotherapist in MS 7/10/2010.
The Evaluation Unit of DG for Development and Co-operation EuropeAid invites you to the Seminar presenting results and recommendations of the evaluation.
M&E in the GEF Aaron Zazueta GEF Evaluation Office Expanded Constituency Workshop Dalat, Vietnam - April 2011.
9-Feb-141 Monitoring & Evaluation in NIE Module 20.
Knowledge Translation Toolkit Questions to be addressed regarding KT in research projects. By Yvon Allard M.Sc. Policy Analyst Métis NAHO.
European Social Fund Assessment of administrative and institutional capacity building interventions and future needs in the context of European Social.
Guidance on CLLD for local actors Key messages Paul Soto.
Effective Adaptation and How to Measure it Dr. Bonizella Biagini Head, Adaptation Operations and Strategy GEF, LDCF & SCCF.
Operating your collaboration Why would you use it?How does it work? Operating a collaboration, collaborative governance or federation is challenging. Schools.
PCMU/UNEP Key issues related to proposal development Yunae Yi Secretary of the Project Approval Group UNEP, Nairobi.
WHO Strategy on Research for Health Rob Terry – Project Manager, RPC.
© 2016 SlidePlayer.com Inc. All rights reserved.