Using Ripple Effects Mapping to Determine Community Capitals Outcomes Debra Hansen Lorie Higgins Mary Emery.

Slides:



Advertisements
Similar presentations
Program Evaluation. Overview and Discussion of: Objectives of evaluation Process evaluation Outcome evaluation Indicators & Measures Small group discussions.
Advertisements

Continuous Improvement Professional Learning Community Framework What does it look like? What does it look like? Module Two.
Scottish Learning and Teaching Strategies Support Group Academy Scotland - Enhancement and Engagement 24 May 2007.
What impact do students’ unions have? James Hutchinson, CEO University of Exeter Students’ Guild Jo Thomas, CEO University of Birmingham Guild of Students.
Open All Areas Partners: difficult to find them (internal and external) and to get them to commit, different goals, coordination of the cooperation, different.
Understanding effectiveness from the perspective of NGOs working in Cambodia By Rhonda Chapman A paper for the Measuring Effectiveness Conference, “Communities.
Mapping the Impacts of Extension Programs Lynette Flage, Ph.D. Northeast District Director North Dakota State University Extension Scott Chazdon, Ph.D.
Theory of Change, Impact Monitoring, and Most Significant Change EWB-UK Away Weekend – March 23, 2013.
1 Theory of Change Chesapeake Bay Funders Network Program Evaluation Training Workshop OMG Center for Collaborative Learning January 9-10, 2008.
Karen L. Mapp, Ed.D. Deputy Superintendent, Boston Public Schools
Area Officer Skills for Care – Surrey
0 Understanding Diversity ©2008, University of Vermont and PACER Center Understanding Diversity PCL Module 10.
Professional Growth= Teacher Growth
1 Qualitative Evaluation Terms Coding/categorization The process of condensing qualitative data through the identification of common themes. Data Matrix.
RIPPLE EFFECT MAPPING (REM)
Program Planning Presented by: Saskatchewan Literacy Network March 2007.
Monitoring Evaluation Impact Assessment Objectives Be able to n explain basic monitoring and evaluation theory in relation to accountability n Identify.
Voices of Youth Teams: How to Create Successful Partnerships for Community Action November, 2003 Camille Dumond, M.A. Youth Researcher HeartWood Institute.
Pathways through Participation: investing in research leading to action Véronique Jochum (NCVO) Diane Warburton (Involve) 7 December 2010, SRA annual conference.
Involving the Whole Organization in Creating or Restructuring a Volunteer Program Louise DeIasi DeCava Consulting.
Results-Based Management
Session 3 Designing the process. Question How to organize a participatory planning process?
Performance Measures AmeriCorps Project Director Training Saratoga, NY October 7 th – 9 th, 2013.
Indicators of Success -- Applying the TOC What will change? You must be able to test your theory!
The Evaluation Plan.
WELCOME BACK!! WEDNESDAY. Response to Feedback Awesome!!! Hmmm… Increased collaboration Michael’s presentation Logic model work Coordinators who understand.
Monitoring and Evaluation in MCH Programs and Projects MCH in Developing Countries Feb 10, 2011.
Reflect and Revise: Evaluative Thinking for Program Success Tom DeCaigny and Leah Goldstein Moses.
Capacity development: Research rooted in community partner voice September 24, 2012 Patrick M. Green, Ed.D. Director, Center for Experiential Learning.
Strategic Prevention Framework Overview Paula Feathers, MA.
Impact evaluation: External and internal stakes Impact evaluation seminar - 2 to 6 December, Phnom Penh.
THE KEY TO CLOSING THE ACHIEVEMENT GAP The key to predictable results in improving student achievement requires connecting curriculum, assessment and instruction.
Evaluation framework: Promoting health through strengthening community action Lori Baugh Littlejohns & Neale Smith David Thompson Health Region, Red Deer,
Evaluation. HPS is a “change” process that takes place within a school community A key consideration is that the change needs to be sustainable.
EVALUATION APPROACHES Heather Aquilina 24 March 2015.
Julie R. Morales Butler Institute for Families University of Denver.
Prepared by the North Dakota State Data Center July HNDECA and ECCS Evaluation Dr. Richard Rathge Professor and Director North Dakota State Data.
Development Hypothesis or Theory of Change M&E Capacity Strengthening Workshop, Maputo 19 and 20 September 2011 Arif Rashid, TOPS.
Engaging Present and Future Members The Taskforce for Reimagining the Episcopal Church Contents of “TREC Engagement Kit” 1.Contents 2.Design Principles.
Monitoring & Evaluation: The concepts and meaning Day 9 Session 1.
W HAT IS M&E  Day-to-day follow up of activities during implementation to measure progress and identify deviations  Monitoring is the routine and systematic.
Presents: Information for participants: Your microphone will be muted for the formal presentation. If your audio portion the presentation is not working,
Mapping the logic behind your programming Primary Prevention Institute
Monitoring and Evaluation
Presentation to the BANKSETA Recognition of Prior Learning (RPL) with a Focus on RPL in the Workplace Carmel Marock and Candice Harrison-Train 14 March.
The Logic Model An Outcomes-Based Program Model. What is a Logic Model? “a systematic and visual way to present and share your understanding of the relationships.
Idaho Principal Evaluation Process Tyson Carter Educator Effectiveness Coordinator Idaho State Department of Education
Monitoring and Evaluation in MCH Programs and Projects MCH in Developing Countries Feb 24, 2009.
Evaluating your EQUIP Initiative Helen King. Objectives To enable teams to develop a shared understanding of the purpose, use and stakeholders for evaluation;
Developing a Framework In Support of a Community of Practice in ABI Jason Newberry, Research Director Tanya Darisi, Senior Researcher
SOCIAL SCIENCE RESEARCH METHODS. The Scientific Method  Need a set of procedures that show not only how findings have been arrived at but are also clear.
GSS as a Professional Learning Community. What do we already know about PLC’s?
Program Evaluation Principles and Applications PAS 2010.
Monitoring and Evaluation in MCH Programs and Projects MCH in Developing Countries Feb 9, 2012.
Gathering Information: Monitoring your Progress. What does it mean to monitor your progress? Monitoring your initiative can help you weigh your actions.
Evaluating Engagement Judging the outcome above the noise of squeaky wheels Heather Shaw, Department of Sustainability & Environment Jessica Dart, Clear.
© 2011 Regents of the University of Minnesota. All rights reserved. Ripple Effect Mapping: A Participatory Strategy for Measuring Program Impacts Presented.
© 2011 Regents of the University of Minnesota. All rights reserved. Ripple Effects Mapping: A Participatory Strategy for Measuring Program Impacts Presented.
RE-AIM Framework. RE-AIM: A Framework for Health Promotion Planning, Implementation and Evaluation Are we reaching the intended audience? Is the program.
Antimicrobial Stewardship in LTC Roadmap to a Successful Start Jamie Moran, MSN, RN, CIC Quality Improvement Consultant Qualis Health.
A Template for Stakeholder Dialogue. Purpose To move its students to greater success with college and career readiness and in other state priorities the.
PRACTICED BASED RESEARCH Overview 25 th November 2013.
SWOT Analysis Strengths, Weaknesses, Opportunities, and Threats.
Building Strong Library Associations | Library Associations in Society: An Overview DAY 1 Session 3 What is the context of Library Associations in your.
Community Conversations during Responsible Business Week 2016.
Instructional Leadership Supporting Common Assessments.
Monitoring and Evaluation Systems for NARS organizations in Papua New Guinea Day 4. Session 10. Evaluation.
SLP Training Day 3 30th September 2016
Monitoring and Evaluation Systems for NARS Organisations in Papua New Guinea Day 3. Session 9. Periodic data collection methods.
Determine Grant Impacts through Ripple Effects Mapping
Presentation transcript:

Using Ripple Effects Mapping to Determine Community Capitals Outcomes Debra Hansen Lorie Higgins Mary Emery

Session Overview Background – Elements and how it has been used CCF Discussion – Advantages and disadvantages

Purposes Intended and unintended results of a program, intervention or collaborative for individuals, groups, sectors or communities.

Purposes Can be Post-program (summative) or Mid-program (formative)

Benefits Easy to use process for reflection (which is important but not always done!) Captures impact of complex or evolving work Captures intended and unintended impacts Participatory and appreciative approach that engages stakeholders and builds self-efficacy Group validation of results

Why it’s helpful Direct, Indirect and Delayed Impacts Collaboratives and high engagement programs often build social capital, but don’t get credit for it. Strengthened social capital is a necessary pre-condition for other impacts. Ripple effects may not be evident for months or even years.

Leadership Programs (WA, ID, ND, MN) Bridges out of Poverty Training (ID) Business Retention & Expansion (MN) Master Gardener Program (MN, WA) 4-H and Social Capital (Multi-state grant) Hometown Competitiveness (NE) Program Examples

Process Steps Identify the intervention Schedule the event & invite participants Hold group mapping session Follow-up interviews Cleaning, Coding, Analysis

Why Does it Work? Blending Effective Theory and Practice  Appreciative Inquiry Interviews  Mind Mapping  Community Capitals Framework

Three Approaches Compared One Ripple at a Time Theming 1 st, Ripple 2 nd Community Capitals Round robin Invite others to add to what is being shared One ripple story at a time is recorded Code to CCF Round robin to list what happened Develop themes Ripples identified Start by listing impacts Code to CCF on spider graph, starting with short-term impacts

Appreciative Inquiry Interview  Tell me a story about how you have used the information from the program?  Is there anything that resulting from the program that you are proud to share?  List an achievement or a success you had based on what you learned.

Mind Mapping The Whole is Greater than the Sum of the Parts

Ririe Idaho Horizons

Hugo, MN Business Retention and Expansion

Coding and Reporting Data management strategies Effective communication with participants, stakeholders and decision makers

Coding to CCF – One Ripple

Outcomes per Capital Community Capitals Short-term outcomes Medium-term outcomes Long-term outcomes Natural26217 Cultural Human Social Political Financial Built Short = something learned | Medium = action taken | Long = change

Coding to CCF – Theme First

Coding to right to CCF

Benefits Easy to use to use process for reflection (which is important but not always done!) Captures impacts of complex and evolving Captures intended and unintended impacts Participatory and appreciative approach that engages stakeholders and builds self-efficacy Group validation of results

Limitations Risk of bias in participant selection and data collection Participants may not have complete information about a program or program outcomes Potential for inconsistency in implementation

Suggestions Use same facilitator, recorder and “mapper” Develop a facilitator guide with prompts and probes

Suggestions Recognize that one organization isn’t trying to take all credit for all change. Follow-up when information isn’t available during mapping sessions (e.g., $ amounts of grants) or key stakeholders are absent

Lessons Learned Effort into recruitment and explaining the process Choose a good setting – not too informal Balance between breadth and depth External facilitators, not program staff Emergent method – important that it stays that way

Discussion Questions What programs might use this method? What concerns do you have about using Ripple Effect Mapping? What are a dvantages and disadvantages of the different approaches? What would you do differently?