We think you have liked this presentation. If you wish to download it, please recommend it to your friends in any social system. Share buttons are a little bit lower. Thank you!
Presentation is loading. Please wait.
Published byCarley Gorin
Modified over 2 years ago
© 2009 Berman Group. Evidence-based evaluation RNDr. Jan Vozáb, PhD partner, principal consultant Berman Group
© 2009 Berman Group. Objectives of the evidence-based evaluation To increase impact and value added of the Cohesion Policy interventions To increase effectiveness and efficiency of interventions in terms of achieving results that make real (and desirable) changes To provide better and more reliable information for strategic management of OPs
© 2009 Berman Group. Key issues and dilemmas Evidence is always part of its context – explanation of findings is part of the evidence-based evaluation The more complex, complicated or integrated is the intervention, the more difficult is to obtain reliable, strong evidence of its effects The better is the evidence for measuring of effects, the more difficult is to cause them by the intervention itself
© 2009 Berman Group. Evaluators´ position Real issues MAs intentions Interventions / Operations Outcomes of interventions Real effects Evaluation
© 2009 Berman Group. Programming issues related to evidence-based evaluation Problem and needs identification Definition of objectives Planning of operations Set up of targets and indicators structure Implications for evaluations: Difficulties to link outcomes to the objectives and needs Difficulties to find evidence of real effects of operations (although they exist) Intervention logic
© 2009 Berman Group. Implementation issues related to evidence-based evaluation Random or non-targeted selection of projects Week coordination of operations within OP Feedback on outcomes for management purposes Costs to track evidence on results/impacts Implications for evaluation: Complicated establishing of evidence on outcomes from available data sets Lack of suitable data for evaluation – monitoring data only
© 2009 Berman Group. Methodological issues related to evidence-based evaluation Formulation of evaluation questions Use of representative data Explanation of findings in proper context Deriving conclusions, providing recommendations Implications for evaluation: Evidence based on intervention logic Availability of data Combination of qualitative and quantitative evidence
© 2009 Berman Group. Recommendations for improving evidence-based evaluation To make sure that programming is sufficiently evidence-based as a prerequisite for evaluation To strengthen vertical and horizontal intervention logic within and among OPs and partnership contract To make sure that operations aim at causes of problems and are sufficiently coherent and focused To strengthen management capacity of MAs: –To manage operations and deliver interventions –To take more responsibility for results and wider effects of interventions (not only for indicators/targets)
© 2009 Berman Group. Recommendations for improving evidence-based evaluation To strengthen analytical capacity and skills of evaluators To use evaluation in a better way to support decision-making: –Small, targeted, ad hoc evaluations –To adjust monitoring systems for evaluation purposes –To strengthen links between evaluators and professionals in thematic fields To establish or strengthen feedback on incorporation of evaluators´ findings into OP management
© 2009 Berman Group. Thank you for your attention Jan Vozáb firstname.lastname@example.org
Evaluation plans for programming period in Poland Experience and new arrangements Ministry of Infrastructure and Development, Poland Athens,
RESEARCH IN VET IN SEE – CHALLENGES AND LESSONS LEARNED Jasminka Čekić Marković Centre for Education policy ERISEE Interim Agency Regional Workshop: Quality.
© Berman Group. Evolution of the Czech Regional Policy in the Context of the EU Regional Policy RNDr. Jan Vozáb, PhD external lecturer, Charles University,
Public Policy Week 2: Policy Process – Analysis. Policy Analysis Description of the content of the policy Analysis of the impact of the social, economic.
Operational Programme I – Cohesion Policy Event part-financed by the European Union European Regional Development Fund Evaluation Plan for Maltas.
Service Delivery and Performance Commission Supporting Improved Performance - Evaluation as a Pillar of Performance Management Kathy Corbiere Service Delivery.
Assessment of administrative and institutional capacity
Paul Griffiths and Roland Simon Wrap-up presentation What has the EMCDDA learned ?
Evaluating Engagement Judging the outcome above the noise of squeaky wheels Heather Shaw, Department of Sustainability & Environment Jessica Dart, Clear.
CPPE AND IFAD’s PROJECT CYCLE P. Kolsteren and P. Lefèvre.
Quality evaluation and improvement for Internal Audit Svilena Simeonova 1.
Guidance notes on the Intevention Logic and on Building a priority axis 27 September 2013.
Module 8 Guidelines for evaluating the SDGs through an equity focused and gender responsive lens: Overview Technical Assistance on Evaluating SDGs: Leave.
SESSION 3: FROM SETTING PRIORITIES TO PROGRAMMING FOR RESULTS.
1 RBM Background Development aid is often provided on a point to point basis with no consistency with countries priorities. Development efforts are often.
1 Evaluating administrative and institutional capacity building International Evaluation & Methodology Conference 6-7 May 2010 Budapest Anna Galazka European.
"The challenge for Territorial Cohesion 2014 – 2020: delivering results for EU citizens" Veronica Gaffey Acting Director EUROPEAN COMMISSION, DG for Regional.
Assessment on the implementation of the Mediterranean Strategy for Sustainable Development Dr Nicola Cantore Overseas Development Institute,
Monitoring and Evaluation of Roma projects and policies, Brussels, 30/11/2010 Evaluating the European Social Fund support to Roma inclusion: processes,
What is an effective induction (within an academic context) and how do you implement it across the whole university or college? Michael Hill Action on.
Enhancing Data Quality of Distributive Trade Statistics Workshop for African countries on the Implementation of International Recommendations for Distributive.
M&E in the GEF Carlo Carugi Senior Evaluation Officer Expanded Constituency Workshop Dakar, Senegal - July 2011.
POLAND Development Management System in Poland Brussels, 2 July 2010.
IAOD Evaluation Section, the Development Agenda (DA) and Development Oriented Activities Julia Flores Marfetan, Senior Evaluator.
Donald T. Simeon Caribbean Health Research Council.
Improving the added value of EU Cohesion policy Professor John Bachtler European Policies Research Centre University of Strathclyde, Glasgow
Policy development and monitoring for quality and equity in education Quick report.
Abu Raihan, MD, MPH Director of Program, Asia IAPB 9th GA, Hyderabad, September 2012 Symposium 6: Challenges in Monitoring.
Piedmont Region - Italy Supporting Equal DPs – The Experience of the Piedmont Region Erica Giordano.
Project “Ex-ante evaluation of programming documents and strengthening evaluation capacity for EU funds post-accession” (EUROPAID/130401/D/SER/HR) Project.
The Kirkpatrick Model organizational change Richard Lambert, Ph.D.
Bucharest, 18 February 2009 Evaluation of Structural Instruments in POLAND Stanislaw Bienias National Evaluation Unit Department of Structural Policy Coordination.
Advice on Data Used to Measure Outcomes Friday 20 th March 2009.
Evaluation of EU Structural Funds information and publicity activities in Lithuania in Implementing recommendations for Dr. Klaudijus.
Mexico’s Experience Monitoring Millennium Development Goals New York, 17 th December, 2013 Enrique Ordaz INEGI 1 Open Working Group.
Applying a HRBA to Monitoring the Implementation of the AfT: Review of Basic Principles Lucila Beato UNMIL/HRPS Lucila Beato UNMIL/HRPS Buchanan, 15/11/2012.
Bid-Writing Seminar Mena Gainpaulsingh International Fundraising Consultancy
Working Together Strategic Review of Community Safety 2009.
With the financial support of MAFAP project overview.
Lessons from Programme Evaluation in Romania First Annual Conference on Evaluation Bucharest 18 February 2008.
STRENGTHENING HEALTH SYSTEMS Anne Mills DCPP Editor London School of Hygiene and Tropical Medicine.
DISCUSSION PAPER PREPARED FOR THE WHO’S DEPARTMENT OF HUMAN RESOURCES FOR HEALTH ON BEHALF OF THE UN TASK FORCE ON IMPACT ASSESSMENT OF FELLOWSHIPS BY.
Their contribution to knowledge Morag Heirs. Research Fellow Centre for Reviews and Dissemination University of York PhD student (NIHR funded) Health.
Evaluating Physical Activity Intervention Programs Thomas Schmid, PhD Physical Activity and Health Branch CDC Atlanta, Georgia, USA.
Nine steps of a good project planning 1. The actual situation 2.. The problem and the vision 3. Formulating useful objectives 4. Organising the objectives.
ECVET WORKSHOP 2 22/23/24 November The European Quality Assurance Reference Framework.
NBFSE Financial instruments and mechanisms of fund allocation to social economy Common meeting 5-6 th December, Milano.
Challenge Questions How good is our operational management?
Evaluation of ESF Support for Roma integration Dominique Bé EURoma, 10 November 2011, Budapest.
Evaluating Complex Health Programmes Fraser Battye.
© 2017 SlidePlayer.com Inc. All rights reserved.