Simple Common Sense Plain Language Minimum Paper Useful
Results-Based Accountability 2 parts: Population Accountability About the well-being of whole populations For Communities – Cities – Provinces – Nations Performance Accountability About the well-being of client populations For Programs – Agencies - & Service Systems
Results-Based Accountability Common Language Common Sense Common Ground
The Language Trap MODIFIERS Measurable Urgent Priority Targeted Incremental Core Qualitative Programmatic Performance Strategic Goal Benchmark Result Indicator Measure Target Objective Too many terms. Too few definitions. Too little discipline.
Definitions TerminologyDefinitionExample RESULT or OUTCOMEA condition of well-being for children, adults, families or communities Children born healthy Children ready for school, Safe communities INDICATOR or BENCHMARK A measure which helps quantify the achievement of a result Rate of low-birthweight babies, % ready to learn, Unemployment rate PERFORMANCE MEASUREA measure of how well a program, agency or service system is working 1.How much did we do? 2.How well did we do it? 3.Is anybody better off? Customer Results
From Ends to Means RESULT or OUTCOME INDICATOR or BENCHMARK PERFORMANCE MEASURE Population Performance Ends Means
Exercise 1.Safe Community 2.Crime Rate 3.Average Police response time 4.An educated workforce 5.Adult literacy rate 6.Families have jobs/income above the LICO 7.% families with jobs/income above the LICO 8.% of participants in job training who get jobs above LICO Result Indicator Performance Measure Result Indicator Result Indicator Performance Measure
Population Accountability For Whole Populations in a Geographic Area
Georgia Policy Council for Children & Families Results 1.Healthy Children 2.Children Ready for School 3.Children Succeeding in School 4.Strong Families 5.Self Sufficient Families
Peel Counts... Community Investment Strategy: Investing for Resilience Priority Results 1.Seniors: Seniors are healthy, connected & functioning to their best ability 2.Persons with Disabilities: Persons with disabilities are fully included and reach their full potential 3.Violence & Abuse: Residents live free from violence & abuse, especially women & children 4.Mental Health: Persons living with meant illness (or at risk) are connected & thrive
Peel Counts... 5.Newcomers & Immigrants: Newcomers & immigrants thrive & are fully included in community life 6.Families: Families have the ability to support & help one another succeed 7.Children & Youth: Children & Youth reach their full potential 8.Poverty: Residents experience less poverty, hunger & have access to affordable housing 9.Social Inclusion: Neighbourhoods have residents that are actively engaged & connected to their community
City of London Strategic Plan 2011-2014 Results: A Strong Economy A Vibrant and Diverse Community A Green and Growing City A Sustainable Infrastructure A Caring Community
Community Results 1.Children & Youth are Strong & Connected 2.Our Community is Safe 3.Our Community is Vibrant 4.Our Residents are Healthy 5.People are Connected
Population Accountability Step 1: Identify the Population Question: What population are you concerned about?
Population Accountability Step 2: Identify the Results Question: What are the conditions of well-being for the population you identified?
Determining Indicators: The Leaky Roof Experience: Measure: Story Behind the baseline: Partners: What Works? Action Plan: Turning the Curve
Getting from Talk to Action POPULATION RESULTS EXPERIENCE INDICATORS BASELINES ______________________ STORY BEHIND THE BASELINES PARTNERS STRATEGY & ACTION PLAN Turned Curve Trend WHAT WORKSCRITERIA
The 7 Population Accountability Questions 1.What are the quality of life conditions we want for the children, adults & families who live in our community? 2.What would these conditions look like if we could see them? 3.How can we measure these conditions? 4.How are we doing on the most important of these measures? 5.Who are the partners that have a role to play in doing better? 6.What works to do better, including no-cost & low-cost ideas? 7.What do we propose to do?
Choosing Indicators Communication Power Does the indicator communicate to a broad range of audiences? Proxy Power Does the indicator say something of central importance about the result? Does the indicator bring along the data HERD? Data Power Quality data available on a timely basis
Choosing Indicators Worksheet Candidate Indicators Communication Power Proxy Power Data Power Measure 1 Measure 2 Measure 3 Measure 4 Measure 5 Measure 6 Measure 7 High Low Medium High Medium Low Medium High Low Medium High Medium Low High Medium High
Separating Indicators Primary Indicators 3-5 “Headline” Indicators What this result “means” to the community Meets the Public Square Test Secondary Indicators Everything else that is any good (nothing wasted!) Used later in the Story Behind the Curve Data Development Agenda New data Data in need of repair (quality, timeliness, etc.)
The Matter of Baselines History Forecast H L M OK? Turning the Curve
Alcohol-Related Traffic Fatalities U.S. Total MADD
Teen Pregnancy Rates, 1990-1994 Tillamook County, Oregon
Developmental Vulnerability at Age 5 % of Children Below the Most Vulnerable Cut-Point on 2 or More EDI Domains Haldimand & Norfolk Regional Best Start Network
Exercise #1 Turn the Curve: Population Well-Being Starting Points (5 minutes) Timekeeper & reporter Geographic area Two hats (yours plus partner’s) Baseline (10 minutes) Pick a quality of life result or indicator curve to turn Forecast (to 2013) – ok or not ok? Story behind the baseline (15 minutes) Causes & forces at work Information & research agenda part 1 – causes What works? (What would it take?) What could work to do better? Each partners contribution No-cost/low-cost ideas Information & research agenda part 2 – what works Report – convert notes to one page
Performance Accountability For Programs, Agencies & Services Systems
“All performance measures that have ever existed for any program in the history of the universe involve answering two sets of interlocking questions.”
Performance Measures QuantityQuality HOW MUCH did we do? (#) HOW WELL did we do it? (%)
Performance Measures EFFORT How hard did we try? EFFECT Is anyone better off?
Performance Measures HOW MUCHWELL EFFORT EFFECT
Not All Performance Measures are Created Equal MOST Important LEAST Important Is anyone better off? How well did we do it? Also very important
The Matter of Control LEAST Control MOST Control Is anyone better off? How well did we do it? Partnerships needed to improve performance
The Matter of Use 1.The first purpose of performance measurement is to improve performance 2.Avoid the performance measurement punishment trap Create a healthy organizational environment Start small Build bottom-up & top-down simultaneously
Comparing Performance 1.To Ourselves First – Can we do better than our own history? 2.To Others – When it is fair apples/apples comparison 3.To Standards – When we know what good performance is Reward? Punish?
The Matter of Baselines Goal Line Target or Standard Your Baseline Create targets only when they are FAIR + USEFUL Instead: Count anything better than baseline as progress Avoid publicly declaring targets year by year if possible
Choosing Headline Measures & Data Development Agenda Is anyone better off? #1 Headline #1 DDA
Separating the Wheat from the Chaff Is anyone better off?
Getting from Talk to Action CUSTOMERS PERFORMANCE MEASURES BASELINES How much did we do? How well did we do it? Is anyone better off? STORY BEHIND THE BASELINES PARTNERS STRATEGY & ACTION PLAN Turned Curve Trend WHAT WORKSCRITERIA
The 7 Performance Accountability Questions 1.Who are our customers? 2.How can we measure if our customers are better off? 3.How can we measure if we are delivering services well? 4.How are we doing on the most important of these measures? 5.Who are the partners that have a role to play in doing better? 6.What works to do better, including no-cost & low-cost ideas? 7.What do we propose to do?
Exercise #2 Turn the Curve: Program Performance Starting Points (5 minutes) Timekeeper & reporter Geographic area Two hats (yours plus partner’s) Baseline (10 minutes) Choose 1 measure to work on – from the lower right quadrant Forecast (to 2013) – OK or not OK? Story behind the baseline (15 minutes) Causes & forces at work Information & research agenda part 1 – causes What works? (What would it take?) What could work to do better? Each partners contribution No-cost/low-cost ideas Information & research agenda part 2 – what works Report – convert notes to one page
How Population & Performance Accountability Fit Together
The Linkage Between Population & Performance Population Accountability Healthy Births (rate of low birth-weight babies) POPULATION RESULTS Stable Families (rate of child abuse/neglect) Children Succeeding in School (% at grade level in reading + math) Performance Accountability # of investigations completed # initiated within 24 hours of report # repeat Abuse/Neglect % repeat Abuse/Neglect CUSTOMER RESULTS Contribution Relationship Alignment of Measures Appropriate Responsibility
Presenting Info in Context Population Accountability Result: to which you contribute most directly Indicators: Story: Partners: What would it take?: Your Role: Performance Accountability Program: Performance Measures: Story: Partners: Action Plan to get better: Every time you present your program, use a two-part approach
Step 1 Form a Steering Committee (Best Start Network) Create Neighbourhood Networks Identify Results Select Indicators and create Data Development Agenda Collect and analyze data Create and Promote Report Begin turn the curve activity Sustain project and update report regularly Encourage community action Step 2 Step 7 Step 6 Step 5 Step 4 Step 3 Step 10 Step 9 Step 8 Network Assessment Cycle Do turn the curve exercise for each Result Haldimand & Norfolk Regional Best Start Network
Literacy Service Planning Table Agenda 1.New Data 2.New Story Behind the Curves 3.New Partners 4.New Information on What Works 5.New Information on Financing 6.Changes to Action Plan & Budget 7.Adjourn
Different Kinds of Progress 1.Data a)Population indicators – Actual turned curves: movement for the better away from the baseline b)Program performance measures: customer progress and better services » How much did we do? » How well did we do it? » Is anybody better off? 2.Accomplishments: Positive activities, not included above 3.Anecdotes: Stories behind the statistics that show how individuals are better off
What’s Next? A Basic Action Plan for RBA Track 1: Population Accountability Establish results Establish indicators, baselines & charts on the wall Create an indicators report card Set tables (action groups) to turn curves Track 2: Performance Accountability Performance measures and charts on the wall for programs, agencies, service systems Use 7 Questions supervisor by supervisor and program by program in management, budgeting and strategic planning
RBA in a Nutshell 2 – kinds of accountability plus language discipline 3 – kinds of performance measures 7 – questions from ends to means in less than an hour 2∙3∙72∙3∙7
Discussion Questions 1.What aspects of Results Based Accountability do you use in the Literacy Service Planning process now? 2.How can you use Results Based Accountability in the Literacy Service Planning process going forward? 3.How can the use of Results Based Accountability help with achieving service coordination?
Reflection What learnings and reflections do I have from this session? What are some potential actions for my Regional Network?
References 1.Friedman, Mark Trying Hard is Not Good Enough: How to Produce Measurable Improvements for Customers & Communities (FPSI Publishing 2005) 2.www.resultsleadership.orgwww.resultsleadership.org 3.www.resultsaccountability.comwww.resultsaccountability.com 4.www.raguide.orgwww.raguide.org 5.www.peelcounts.ca