SJI Impact Assessment 2014 Based on Impact Assessment for Development Agencies – Learning to Value Change (Chris Roche, Oxfam, digital file 2010)

Slides:

Advertisements

Similar presentations

Gender Audit. Traditional use of audit relates to accounting: Analysis of gender budget Gender audit still evolving… -now used interchangeably with evaluation.

Advertisements

Results Based Monitoring (RBM)

1 EU Strategy for the Baltic Sea Region Evaluation: Setting Outcome Indicators and Targets Seminar: 15 March 2011, La Hulpe Veronica Gaffey Acting Director.

Introduction to Impact Assessment

Donald T. Simeon Caribbean Health Research Council

Grantee Program Plan. Components of the Program Plan Goals  Objectives  Activities  Techniques & Tools  Outcomes/Change.

Designing an Effective Evaluation Strategy

Project Monitoring Evaluation and Assessment

Results-Based Management: Logical Framework Approach

SAFER CITIES MODEL. SAFER CITIES TOOLS SAFER CITIES TRAINING MANUAL AND TOOLKIT Overall development objective is to facilitate effective strategy development.

INTEGRATING BENEFICIARY FEEDBACK INTO EVALUATION- A STRUCTURED APPROACH Presentation to UKES Conference May 2015 Theme: Theory and practice of inclusion.

RBM Communications Assessment Challenges and Opportunities in Ghana, Mali, Senegal, Tanzania and Uganda.

Results-Based Management: Logical Framework Approach

Pestalozzi Children‘s Foundation emPower 2012 Monitoring & Evaluation Lecturers: Beatrice Schulter.

Performance Management Upul Abeyrathne, Dept. of Economics, University of Ruhuna, Matara.

Participants should expect to understand: Concept of M&E Importance of gender in M&E Different steps in the M&E process Integrating gender into program/project.

CASE STUDIES IN PROJECT MANAGEMENT

Systematic analysis and synthesis in qualitative evaluation Case study evaluation of the Oxfam Novib programme in Burundi ( ) Ferko Bodnar CDI.

Monitoring Evaluation Impact Assessment Objectives Be able to n explain basic monitoring and evaluation theory in relation to accountability n Identify.

USAID’s Experience and Lessons Learned in Approaches used in Monitoring and Evaluating Capacity Building Activities Duane Muller, USAID November 7, 2008.

ISTEP: Technology Field Research in Developing Communities Instructor: M. Bernardine Dias CAs: Sarah Belousov and Ermine Teves Spring 2009.

Evaluation methods and tools (Focus on delivery mechanism) Jela Tvrdonova, 2014.

Monitoring and Evaluation in MCH Programs and Projects MCH in Developing Countries Feb 10, 2011.

Seminar on Mid Term Evaluation in Objective 1 and 2 Regions Lessons from the Mid Term Evaluation of Merseyside Objective One.

M & E: WHAT, WHY A ND HOW ? S. Venkatraman UIS-AIMS, UNESCO Bangkok.

KEYWORDS REFRESHMENT. Activities: in the context of the Logframe Matrix, these are the actions (tasks) that have to be taken to produce results Analysis.

Semester 2: Lecture 9 Analyzing Qualitative Data: Evaluation Research Prepared by: Dr. Lloyd Waller ©

Addressing methodological challenges: measuring resilience + international coherence Juliet Field Climate and Environment Dept.

The aim / learning outcome of this module is to understand how to gather and use data effectively to plan the development of recycling and composting.

Lesson 8: Effectiveness Macerata, 11 December Alessandro Valenza, Director, t33 srl.

IAOD Evaluation Section, the Development Agenda (DA) and Development Oriented Activities Julia Flores Marfetan, Senior Evaluator.

Framework for Monitoring Learning & Evaluation

1 Indicators and gender audits Juliet Hunt IWDA Symposium on Gender Indicators 15 June 2006.

Setting the Stage: Workshop Framing and Crosscutting Issues Simon Hearn, ODI Evaluation Methods for Large-Scale, Complex, Multi- National Global Health.

ASSESSMENT OF STUDENT SUPPORT SERVICES Kimberly Gargiulo, Coordinator of Assessment Office of Institutional Research and Assessment.

UNDAF M&E Systems Purpose Can explain the importance of functioning M&E system for the UNDAF Can support formulation and implementation of UNDAF M&E plans.

1 CORAT AFRICA MANAGEMENT WORKSHOP FOR IMBISA/AMECEA COMMUNICATION COORDINATORS, MAPUTO, MOZAMBIQUE.

University of Palestine Dept. of Urban Planning Introduction to Planning ( EAGD 3304 ) M.A. Architect: Tayseer Mushtaha Mob.:

UNDP-GEF Community-Based Adaptation Programme Anne-France WITTMANN CBA-Morocco Programme Manager (UNV) Tools & Tips to foster Gender Mainstreaming & Inclusion.

Impact Evaluation in Education Introduction to Monitoring and Evaluation Andrew Jenkins 23/03/14.

1 Policy Analysis for RISPO II National Workshop XXXXX 2006.

Screen 1 of 22 Food Security Policies – Formulation and Implementation Policy Monitoring and Evaluation LEARNING OBJECTIVES Define the purpose of a monitoring.

Independent Evaluation Group World Bank November 11, 2010 Evaluation of Bank Support for Gender and Development.

Regional Policy Result Orientation of future ETC Programes Veronica Gaffey Head of Evaluation & European Semester 23 April 2013.

Monitoring and Evaluation

111 CINDI PMER Workshop March, 2007 By Simon Opolot © 2007 Office of the Premier, KwaZulu-Natal Province, Private Bag X9037 Telecom House, 2nd Floor,

Monitoring and Evaluation in MCH Programs and Projects MCH in Developing Countries Feb 24, 2009.

M E T R Monitoring and Evaluation for Timely Responses “Measuring the right things in the right way at the right time” Briefing for Discussion at FEMA,

Support the spread of “good practice” in generating, managing, analysing and communicating spatial information Evaluating and Reflecting on the Map-making.

Monitoring and Evaluation in MCH Programs and Projects MCH in Developing Countries Feb 9, 2012.

27/04/2017 Strengthening of the Monitoring and Evaluation system for FTPP/FTTP in FAO /SEC December 2015 FTPP/FTFP Workshop, Bishkek, Kyrgyzstan.

Enhancing capacity in the Child & Youth sector through situated supported distance learning Building Capacity through a Participatory Institutional Assessment.

Monitoring and evaluation Objectives of the Session  To Define Monitoring, impact assessment and Evaluation. (commonly know as M&E)  To know why Monitoring.

ICT4D: Evaluation Dr David Hollow DSV, University of Stockholm.

Evaluation What is evaluation?

Monitoring and Evaluation Systems for NARS organizations in Papua New Guinea Day 4. Session 10. Evaluation.

Module 8 Guidelines for evaluating the SDGs through an equity focused and gender responsive lens: Overview Technical Assistance on Evaluating SDGs: Leave.

THEME:EMPOWERING FACILITY MANAGEMENT AND HEALTHCARE TECHNOLOGY IN KENYA TITLE: Monitoring and Evaluation as a tool for quality assurance and control.

Gender-Sensitive Monitoring and Evaluation

Gender-Sensitive Monitoring and Evaluation

Monitoring and Evaluation Systems for NARS Organisations in Papua New Guinea Day 3. Session 7. Managers’ and stakeholders’ information needs.

Business Environment Dr. Aravind Banakar –

Business Environment Dr. Aravind Banakar –

Business Environment

Business Environment

Business Environment

Business Environment

Evaluation Jacqui McDowell.

SUSTAINABLE MICRO-FINANCE for WOMEN’S EMPOWERMENT

Integrating Gender into Rural Development M&E in Projects and Programs

Presentation transcript:

SJI Impact Assessment 2014 Based on Impact Assessment for Development Agencies – Learning to Value Change (Chris Roche, Oxfam, digital file 2010)

Impact Assessment Sustained changes in people’s lives brought about by a particular intervention

Attribution “One of the critical questions that impact assessment traditionally sets out to answer is what caused any identified change. For most projects this means trying to determine if the changes that have occurred would have happened anyway, and the degree to which an observed change can be attributed to a given project or programme. This is notoriously difficult.”

Purpose To demonstrate past impact and to improve future practice

Objectives and Indicators Impact is the indicator to overall objective Outcome is the indicator to specific objectives In SJI’s case indicators are for the most part not defined (some organic agriculture and GNH indicators, CSOFF) -> Impact assessment exercise will help defining those indicators (participatory) for future planning/programming/project design

Objectives and Indicators For example: Specific objective: - Minimization of waste -> To what extent has it been achieved? Outcome indicator(s): - What are the outcomes that contributed to this change? - What outcomes can be attributed to the project? - What outcomes can be attributed to external factors? - Any negative/unintended (postive or negative) impacts of this change?

Impact Assessment Team SJI team! Internal training/capacity development exercise (no external evaluators/facilitators) External support from Dr. Gonsalves and Dr. Marchetti in design of impact assessment Other capacity development required?

Units/Levels of Assessment Individual Household Group/CBO Community/village Local CSO Institution

Participants Men, women, youth, rich, poor, beneficiaries, non- beneficiaries, project staff, donors, local government…

Research Tools Surveys Interviews Workshops/discussions Direct observation Participatory research Case studies/stories

Research Tools -> Importance of using several research tools and participants for cross- checking (triangulation)!

Research Method Quantitative method Specific objective: - Minimization of waste -> To what extent has it been achieved?  Ranking on scale between 1-10 before and after programme/project implementation (with or without project)  Will at the same time generate baseline info

Research Method Qualitative method Outcome indicator(s): - What are the outcomes that contributed to this change? - What outcomes can be attributed to the project? - What outcomes can be attributed to external factors? - Any negative/unintended (postive or negative) impacts of this change?  Semi-structured questions

Research Method Qualitative method Other questions: - Suggestions for improvement of the programme/project (relevance, efficiency, effectiveness, impact, sustainability) - Potential for replication, upscaling to other parts of the district/beyond - Potential for policy uptake/impact (integration into local government policy)  Semi-structured questions

Research Method Relevance: Real problems, needs, priorities of target group and beneficiaries, contextual appropriateness (policies) Efficiency:Benefits compared to resources spent Effectiveness:Results contribution to achievement of specific objectives Impact: Projects contribution to overall objective Sustainability:Benefits of project persisting after donor support, institutional and financial sustainability

Research Tools “Methods should evolve and be adapted based on a mutual analysis of their strengths and weaknesses; and one should monitor the extent to which the information gathered actually has an impact - for instance, whether it leads to change in the policies or practice of the project or organisation being assessed and whether it is meaningful to all parties.”

Communication Tools Community feedback Presentations and workshops with staff Multistakeholder workshops Report Case studies/stories Radio Video Etc.

Task of the Day For each SJI programme/project:  Determine units/levels of assessment  Determine participants  Determine research tools  Determine timelines

SJI Internal Impact Assessment Multiple impact assessments: i) SJI internal, ii) SJI partners/beneficiaries, iii) external evaluator, iv) donors Sometime next week Purpose: To conduct internal impact assessment and test out research tools