MOST SIGNIFICANT CHANGE Youth Focused Monitoring and Evaluation System.

Slides:



Advertisements
Similar presentations
Outcome mapping in child rights-based programming
Advertisements

P D S A REVIEW ACT PLAN STUDY DO Plan Continuous Improvement
Intelligence Step 5 - Capacity Analysis Capacity Analysis Without capacity, the most innovative and brilliant interventions will not be implemented, wont.
Experience is the Best Teacher: Patient and Family Advisors at the Forefront of Provider Education Caroline Moore, MPH, Barbara Sarnoff Lee, LICSW, and.
The Most Significant Change Technique (MSC) Dr Jessica Dart Clear Horizon.
Plan © Plan Using the Most Significant Change ( MSC) technique for actual program improvement (New way towards a downward accountability and collective.
Gender Equity in Sport for Social Change Monitoring & Evaluation CASABLANCA 2007.
Theory of Change, Impact Monitoring, and Most Significant Change EWB-UK Away Weekend – March 23, 2013.
Initiating & Sustaining a Mentoring Program Dr. Virginia Strand- Fordham University Jodi Hill-Lilly, MSW & Tracy Davis, MSW Connecticut Department of Children.
Ray C. Rist The World Bank Washington, D.C.
Quality Systems for Quality Teachers:
® © 2005, CARE USA. All rights reserved. A System for Measuring Impact Organizational Performance and Learning November 2, 2010.
Defining and Measuring the Social Impact of Clean Cooking Solutions March 16, 2015.
Challenge Questions How good is our strategic leadership?
PRESENTATION The Structured Dialogue. What? A participative process for young people and decision-makers to discuss and elaborate recommendations jointly.
1 Qualitative Evaluation Terms Coding/categorization The process of condensing qualitative data through the identification of common themes. Data Matrix.
Monitoring Evaluation Impact Assessment Objectives Be able to n explain basic monitoring and evaluation theory in relation to accountability n Identify.
PARTICIPATORY AGRICULTURAL RESEARCH Review for South Africa and KZN E Kruger. KwaNalu CoP, 5,6 August 2014 PARTICIPATORY AGRICULTURAL RESEARCH.
Investing in Change: Funding Collective Impact
Needs Assessment: Collecting information, making decisions, and accomplishing results Ryan Watkins, Ph.D. George Washington University Maurya West Meiers.
Performance Measurement and Analysis for Health Organizations
The Evaluation Plan.
Monitoring :Thailand’s Experiences Session 2: Monitoring: Processes, Potentials, Tools and Instruments Global Dialogue of Agencies and Ministries for International.
HSA 171 CAR. 1436/ 7/4  The results of activities of an organization or investment over a given period of time.  Organizational Performance: ◦ A measure.
1 RBM Background Development aid is often provided on a point to point basis with no consistency with countries priorities. Development efforts are often.
Reflect and Revise: Evaluative Thinking for Program Success Tom DeCaigny and Leah Goldstein Moses.
Fundamentals of Evaluation for Public Health Programs ROBERT FOLEY, M.ED. NIHB TRIBAL PUBLIC HEALTH SUMMIT MARCH 31,
Working Definition of Program Evaluation
Monitoring and Evaluation of Public- Private Dialogues Jesse Biddle Center for International Development State University of New York And Benjamin Herzberg.
August 7, Market Participant Survey Action Plan Dale Goodman Director, Market Services.
Framework for Monitoring Learning & Evaluation
Mobilizing Assets for Community Driven Development Coady International Institute 2012 Coady International Institute 2011.
Sub-Regional Workshop for GEF Focal Points in West and Central Africa Accra, Ghana, 9-11 July 2009 Tracking National Portfolios and Assessing Results.
Monitoring & Evaluation Presentation for Technical Assistance Unit, National Treasury 19 August 2004 Fia van Rensburg.
Monitoring & Evaluation: The concepts and meaning Day 9 Session 1.
MAINSTREAMING MONITORING AND EVALUATION IN EDUCATION Can education be effectively managed without an M & E system in place?
Creating a S.I.M.P.L.E. & Comprehensive Assessment Plan for Residence Life and Housing Dr. Mike Fulford Emory University Student Affairs Assessment Conference.
Monitoring and Evaluation (M&E) If one goal of your project is to have real impacts on farmers through high quality technical research, then you will need.
Monitoring and Evaluation of GeSCI’s Activities GeSCI Team Meeting 5-6 Dec 2007.
Introduction to Social Audits. Assessing Social Performance Process Results Audit ToolsRating Tools Intent & Design Internal Systems/ Activities OutputsOutcomes.
Performance Indicators Table for Youth Substance Abuse & Use Prevention September 15, 2005 Ottawa, Ontario Wanda Jamieson & Tullio Caputo.
Monitoring and Evaluation
Impact Measurement why what how Atlanta. Today Imperatives Questions Why Now? Significant Challenges Breakthroughs in the field CARE’s Long-Term.
Consultant Advance Research Team. Outline UNDERSTANDING M&E DATA NEEDS PEOPLE, PARTNERSHIP AND PLANNING 1.Organizational structures with HIV M&E functions.
Results Based Management in Practice – Experiences and learning By Kai Matturi Knowledge & Learning Adviser Mary Banda, 37, in her field in May Mary.
Principles of Project Design and Management Moving from Program to Project in 3 Easy Chapters.
Developing a Framework In Support of a Community of Practice in ABI Jason Newberry, Research Director Tanya Darisi, Senior Researcher
Illinois Department of Children & Family Service/Chicago State University STEP Program - NHSTES May THE STEP PROGRAM Supervisory Training to Enhance.
Support the spread of “good practice” in generating, managing, analysing and communicating spatial information Evaluating and Reflecting on the Map-making.
Managing change while improving asset management performance Wayne Francisco.
Application of Human Rights Principles in Results Based Management Muhammad Usman Akram, Evaluation Advisor Adapted from RBM training held for UNDP BRC.
1 The project is financed from the European Union funds within the framework of Erasmus+, Key Action 2: Cooperation for innovation and the exchange of.
Brief Introduction Dr R Vincent: 1 Most Significant Change: using stories to assess impact.
Making it Count! Program Evaluation For Youth-Led Initiatives.
Capacity Development Results Framework A strategic and results-oriented approach to learning for capacity development.
SOCIAL PERFORMANCE MANAGEMENT Collecting clients data for enhancing client satisfaction and retention.
Module 9 Monitoring and Evaluation Tuesday, Oct 14, 2013 Ngo Thi Loan and John Carter.
Developing a Monitoring & Evaluation Plan MEASURE Evaluation.
Dr. Anubha Rajesh, Early Education Services, ICF January 13, 2016 Invest in Young Children: National Conference on Mother- tongue Based Multilingual Early.
Monitoring and Evaluation Systems for NARS organizations in Papua New Guinea Day 4. Session 10. Evaluation.
MOST SIGNIFICANT CHANGE PROCESS
Rebecca McQuaid Evaluation 101 …a focus on Programs Rebecca McQuaid
Monitoring and Evaluation Systems for NARS Organisations in Papua New Guinea Day 3. Session 9. Periodic data collection methods.
Module 2 Basic Concepts.
Is there another way besides accreditation?
Intro slide to all of these:
Results of the Organizational Performance
System of Profound Knowledge
Capturing stories of change and The Most Significant Change technique
Integrating Gender into Rural Development M&E in Projects and Programs
Presentation transcript:

MOST SIGNIFICANT CHANGE Youth Focused Monitoring and Evaluation System

Monitoring and Evaluation What? How?

Key Types of M&E in YMF project Impacts Outcomes Most Significant change, Satisfaction ranking, rolling baseline, financial diary and evaluations Results Monitoring and Evaluation for program effectiveness Outputs Inputs Activities -Group quality tools -MIS -Satisfaction ranking Implementation, Progress/process Monitoring (Means and Strategies

M&E for youth Promoting true participation Giving youth voice to define and measure their own impact Making it fun for youth rather than making it theoretical and difficult Baseline survey needs to be adapted to capture youth related data i.e. floating youth, youth’s income pattern, youth poverty dynamics, support to the family etc. Adaptation is the key to measure…

Most Significant Change is… a form of participatory monitoring and evaluation a way to collects stories that represent meaningful and profound changes a systematic process that analyzes and selects the “most significant” story from ones collected from the field

When is MSC an appropriate tool? Projects that are… complex and produce diverse outcomes has numerous organizational layers focused on social changes that may not be tangible participatory in ethos designed with repeated contact between field staff and participants

Ten Steps to Implementing MSC Raising interest and getting buy-in Defining domains of change Defining the reporting period Collecting SC stories Selecting the most significant of the stories Feeding back results of selection process Verifying the stories Quantifying the stories Using secondary analysis and meta- monitoring Revising the system

Story telling… …is different from report writing! Beginning Turning point Resolution

Why is MSC useful? Provides a richer picture of what’s happening Encourages analysis Helps to focus on the key impact Uses a bottom-up approach without externally predefined outcomes Tells us about unexpected change Gets different perspectives of what has changed Specify domains to reflect changes in gender equity Self-identified by the story-tellers

Logical Framework ActivitiesExpected outcomes Actual Results Emergent outcomes story Reflection Process Revise Logic

Change Domains in YMF Quality of youth lives Leadership, participation and social status Sustainability of the groups as a collective force Other changes i.e. negative change or change not captured in other domain. In your opinion… …what was the most significant… …change that took place… …in the quality of your ‘change domain` …over the last three months? In your opinion… …what was the most significant… …change that took place… …in the quality of your ‘change domain` …over the last three months?

MSC cycle for YMF project 225 stories for 3 countries YSL groups 90 stories selected Field Agent 60 stories selected Youth Advisory Board 30 stories per year (10 stories for each country) Project Steering committee Feedback to the groups

Satisfaction Ranking PRA based tool increases high level of participation due to nature of the tool Measures both level of knowledge and satisfaction Youth identify the attributes by the degree of importance and level of satisfaction The tool provides youth perspectives on actions against gaps and helps youth to do self evaluation.

SATISFACTION WITH YSL FEATURES Attributes deemed most important to youth – Loans – Savings – FA/ CV support – Group meetings and rules – Social Fund High level of satisfaction with key features of the model and able to save and take credit. Some dissatisfaction (but isolated) with – Some CV’s performance – Amount of Social Fund contribution (decision making) – Lack of rules on penalties (discipline)

Questions ??? ? ? ? ? ? ? ? ? ? ? ? ? ? ?