Kathy Keeley Northland Foundation Strengthening Communities April 14, 2011 Writing Result Measures and Program Evaluation

Agenda 4/14/2011 The Keeley Group Welcome Review Technology Overview and Definitions Writing Result Measures and Examples Program Evaluation  Definitions and Purpose  Methods  Using with Results Methods Webinar Feedback – Please complete SurveyMonkey form 2

Technology 4/14/2011 The Keeley Group 3 Mute & Unmute Phone *5 We ask that everyone leave their phone on mute until question and answer time to avoid outside noises. Asking Questions Please use the chat to the right of your screen for any questions. We hope to have time to respond. If Cut Off – what to do If you have technical difficulties we have loaded this PowerPoint on our website that you can follow along with.

Writing Result Measures 4/14/2011 The Keeley Group 4

Results /Outcomes 4/14/2011 The Keeley Group 5 Results are also called Outcomes. Impact – Benefit to the client. Beyond the numbers who attend your program or services. Answers “what is different because of what you do?” NOT “what you do

Not A Strategy 4/14/2011 The Keeley Group 6 Outcome is: Healthy Babies Youth Ready for College Sense of connection to social issues in our community Strategy is: Train mothers in illness prevention model Educational Reform in High Schools Rewrite all plays to focus on current social issues in the city

Not Outputs 4/14/2011 The Keeley Group 7 Not how many people served What is the benefit to the client because they got help from your organization?

Why Important? 4/14/2011 The Keeley Group 8 Mission Right programs and services Demonstrate a return on investment Consistent message for donors

Definition of Result Measure 4/14/2011 The Keeley Group 9 Outcome – Benefit from what you do Indicator – Measure of your impact on the outcome Target – Number you are trying to achieve Example Public Safety (Outcome) 50% (target) emergency calls will be responded to within 3 minutes (indicator)

Steps to Create 4/14/2011 The Keeley Group Who is the customer? Decide who you intend to benefit from what you do? 2. How do they benefit? Identify exactly how you want them to benefit because of what you do--Outcomes. Examples: skills, behavior, knowledge, circumstances, attitudes, enjoyment…… 3. Select measurable indicators for each Outcome. Review for ability to communicate your story and ease of data collection 4. Decide 3-5 year targets for each indicator.

Results Must 4/14/2011 The Keeley Group 11 Communicate Story – Be compelling Be affordable to measure Have a baseline of data

Examples 4/14/2011 The Keeley Group 12 Healthy Children 80% of children will be immunized before kindergarten. Employed Individuals with Living Wage 50% of program graduates will obtain a job that pays at least $12 an hour. Audience Participation 50% of audience will participate in audience talk back sessions. New Audience Development 25% of audiences will be composed of young professionals Eliminating Homelessness 50% of homeless individuals will obtain permanent housing Outcome Target Indicator

Results - Outcomes 4/14/2011 The Keeley Group 13 What to Measure  Feelings – not very effective  Learning - Increased knowledge  Increased skills – new skills to apply  Effectiveness – change in life circumstances

Examples 4/14/2011 The Keeley Group 14 Improving Parenting Skills 50% of families receiving case management achieve goals established in plan. Children Reading at/or above 60% of children improve reading as measured by X

Program Evaluation 4/14/2011 The Keeley Group 15

Program Evaluation 4/14/2011 The Keeley Group 16 Making Decisions  Funding –Accountable, Cuts, New Funding  Improve Program  Respond customer satisfaction  Measure against Strategic Plan  Board and Management Dashboard

Before 4/14/2011 The Keeley Group What do you want to know – really know? 2. Who is the audience? 3. What kinds of information is needed?  Strengths and Weaknesses  Outcomes vs. Outputs – what happened  Client experience – customer satisfaction How will you collect? Timeline What can you afford?

Types of Evaluation 4/14/2011 The Keeley Group 18 Goals – Client, Program, Funding  Surveys (follow-up)  Interviews  Documentation Review Outcomes – what has been achieved  Survey  Database Records  Sample Interviews Process – how program works  Focus Groups  Interviews

Data Base Resources 4/14/2011 The Keeley Group 19 Vista Share Sales Forces – Filemaker Pro Access Excel Spreadsheet Trade Association in Sector

Resources 4/14/2011 The Keeley Group 20 Program Managers Guide Methods Review PowerPoint Slides ces.shtml ces.shtml

Wrap-up 4/14/2011 The Keeley Group 21 Please complete the SurveyMonkey webinar feedback form. You will be receiving an shortly. Feedback form link: