The Fiscal Policy Studies Institute www.raguide.org www.resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org Results-Based Accountability.

Slides:



Advertisements
Similar presentations
Outcome Based Accountability (OBA) The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Books & DVDs amazon.com resultsleadership.org.
Advertisements

Outcome Based Accountability
Outcome Based Accountability Fiscal Policy Studies Institute Santa Fe, New Mexico WEBSITES BOOK ORDERS
Outcome Based Accountability Fiscal Policy Studies Institute Santa Fe, New Mexico WEBSITES BOOK ORDERS
Results/Outcomes Based Accountability Based on the Work of Mark Friedman Trying Hard is Not Good Enough (Working smarter not harder)
Making Your Work Count: Results Based Accountability in Community Schools Karen Finn, Senior Consultant
Results/Outcomes Based Accountability
1 Facilitators: Lorna McCue and Pam Kinzie, HC Link Guest Presenter: Andrew Taylor, Taylor Newbury Consulting Results-Based Accountability for community.
Results-Based Accountability (RBA) The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.
How Do Current United Way and Region of Peel Investments Align with the Population Results?
The Simplest Way TO IMPLEMENT RBA POPULATION ACCOUNTABILITY 1. Pick an important indicator curve 2. Run the Population Turn the Curve Exercise 3. Take.
UNLEASH the POWER of the Results-Based Accountability.
Outcome Based Accountability ‘From Talk to Action’ David Burnby
Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.
Swimming in a Fishbowl: Holding your agency accountable for its work Karen Finn, Senior Consultant
RBA 101 – OBA 101 Some NEW AND REVISED SLIDES 30 AUG 2013 FPSI RBA OBA Facebook.
Results-Based Accountability (RBA) The Fiscal Policy Studies Institute Coreassets.com Book - DVD Orders amazon.com.
Results Accountability The Fiscal Policy Studies Institute Santa Fe, New Mexico Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com.
RBA Results-Based Accountability The Fiscal Policy Studies Institute Book - DVD Orders amazon.com resultsleadership.org.
Results Based Accountability Basics A Half Day Presentation
RBA Results-Based Accountability The Fiscal Policy Studies Institute Book - DVD Orders amazon.com resultsleadership.org.
1 Welcome! Building Assets of People, Families and Communities “What Do Outcomes Have to do with It?” Jessie Ball duPont Fund October 28-30, 2008.
The Fiscal Policy Studies Institute Book - DVD Orders amazon.com resultsleadership.org Results-Based Accountability.
I N N O V A T I O N Results-Based Accountability Discovery Communities TA Institute April 1, 2008.
RBA Results-Based Accountability The Fiscal Policy Studies Institute Book - DVD Orders amazon.com resultsleadership.org.
Results-Based Accountability (AKA: Outcome-Based Accountability or OBA) The Fiscal Policy Studies Institute Santa Fe, New Mexico Websites raguide.org resultsaccountability.com.
“If I include you, you will be my partner.
Turning the curve: children’s services and outcomes based accountability Jacky Tiotto Deputy Director, Government Office planning and performance support,
Results Based Accountability is made up of two parts: Performance Accountability about the well-being of CUSTOMER POPULATIONS For Programs – Agencies –
I N N O V A T I O N The Charter Oak Group, LLC Rev. 1 (12/31/11) RBA Overview for Connecticut Nonprofits and Communities.
RBA Results-Based Accountability The Fiscal Policy Studies Institute Book - DVD Orders amazon.com resultsleadership.org.
RBA Africa Supplemental Slides. Next Generation Contracting.
1 Outcomes Focussed Practice; the Paradigm shift in Public Services Rob Hutchinson, CBE April 2007 Based on Results Based Accountability
CHCORG610B Mange Change in a community sector organisation CHCCS503A Develop, implement and review services and programs to meet client needs
RBA Results-Based Accountability The Fiscal Policy Studies Institute Book - DVD Orders amazon.com resultsleadership.org.
Outcomes-Based Accountability “Turning the Curve” The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders.
RBA Results-Based Accountability The Fiscal Policy Studies Institute Book - DVD Orders amazon.com resultsleadership.org.
RBA Results-Based Accountability The Fiscal Policy Studies Institute Book - DVD Orders amazon.com resultsleadership.org.
PERFORMANCE ACCOUNTABILITY. Results-Based Accountability is made up of two parts: Performance Accountability is about the well-being of CUSTOMER POPULATIONS.
Results-Based Accountability (RBA) The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.
RBA Results-Based Accountability The Fiscal Policy Studies Institute Book - DVD Orders amazon.com resultsleadership.org.
RBA Results-Based Accountability The Fiscal Policy Studies Institute Book - DVD Orders amazon.com resultsleadership.org.
Results Based Accountability Basics An Introduction to RBA Standard Training Slides Sponsored by the Ministry of Social Development.
RBA Results-Based Accountability The Fiscal Policy Studies Institute Book - DVD Orders amazon.com resultsleadership.org.
RBA Results-Based Accountability The Fiscal Policy Studies Institute Book - DVD Orders amazon.com resultsleadership.org.
Results Based Accountability Basics An Introduction to RBA Standard Training Slides Sponsored by the Ministry of Social Development.
RBA Results-Based Accountability The Fiscal Policy Studies Institute Book - DVD Orders amazon.com resultsleadership.org.
RBA Results-Based Accountability The Fiscal Policy Studies Institute Book - DVD Orders amazon.com resultsleadership.org.
RBA Results-Based Accountability The Fiscal Policy Studies Institute Book - DVD Orders amazon.com resultsleadership.org.
Zen and the Art of Results Based Accountability Stephen Mondy and Merissa Barden Centacare Broken Bay CSSA NSW/ACT Branch Workshop 18 August 2010 © Centacare.
RBA Results-Based Accountability The Fiscal Policy Studies Institute Book - DVD Orders amazon.com resultsleadership.org.
RBA Results-Based Accountability The Fiscal Policy Studies Institute Book - DVD Orders amazon.com resultsleadership.org.
Service Accountability for programs, agencies and service systems.
RBA Results-Based Accountability The Fiscal Policy Studies Institute Book - DVD Orders amazon.com resultsleadership.org.
Results Based Accountability. Overview of Results Based Accountability The context of the development of Results Based Accountability in New Zealand An.
Results Based Accountability The Fiscal Policy Studies Institute Santa Fe, New Mexico 1.
Results Accountability The Fiscal Policy Studies Institute Santa Fe, New Mexico Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com.
RBA Results-Based Accountability TM The Fiscal Policy Studies Institute resultsaccountability.com raguide.org Book - DVD Orders amazon.com resultsleadership.org.
RBA Results-Based Accountability The Fiscal Policy Studies Institute resultsaccountability.com raguide.org Book - DVD Orders amazon.com resultsleadership.org.
Results Accountability The Fiscal Policy Studies Institute Santa Fe, New Mexico Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com.
Results Based Accountability Workshops Older People Co-ordinators 20 th, 22 nd & 30th June 2011 Ffynnon Knowledge Management & Business Change Programme.
RBA Results-Based Accountability The Fiscal Policy Studies Institute TM Book - DVD Orders amazon.com resultsleadership.org.
Tackling Health Inequalities using Outcome Based Accountability with a focus on BME communities David Burnby This presentation is.
Achieving Outcomes – Choosing Targets and Making a Difference Lynne Dean DH/CSIP.
Book & DVD Orders amazon.com clearimpact.com
Performance Accountability Types of Measures found in each Quadrant
The Fiscal Policy Studies Institute
The Fiscal Policy Studies Institute
Results Based Accountability
RBA Results-Based Accountability
Presentation transcript:

The Fiscal Policy Studies Institute Book - DVD Orders amazon.com resultsleadership.org Results-Based Accountability ™ RBA TRAINING FOR TRAINERS AND COACHES DAY 1

RBA/OBA Ends vs. Means Exercise The Fiscal Policy Studies Institute Santa Fe, New Mexico Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org

INSTRUCTIONS On a blank sheet of paper Ends vs. Means Exercise Step 2. Draw a line from the upper left point to the lower right point. Step 3. Draw a line from the upper right point to the lower left point. Step 4. Draw a horizontal line connecting the bottom two points. Step 5. Mark another point approximately 1 inch below the middle of the horizontal line. Step 6. Connect the upper left point to this new point Step 7. Connect the upper right point to this new point. Like this. Step 1. Draw 4 points that represent the 4 corners of a box or square, about two inches on a side.

What do you have? A Star !!!

Question If I asked you to draw a star would you need the step-by-step instructions? Of course not ! So what’s the point?

And Start Seeing Stars ! Give people the ends and let them figure out the means.

Bonus Question How many stars were on the previous page? 28 How many guessed between 26 and 30?

RBA / OBA is about starting with ends and working backward to means. And the closing point…. So, for example, Ask people to turn the curve on CHILD ABUSE RATES….. Ask people to turn the curve on SCHOOL ATTENDANCE RATES… Ask people to turn the curve on RATES OF AIR OR WATER POLLUTION…. AND LET THEM FIGURE OUT “HOW.”

THANKS ! ’s

1.Why is this work important? 2. Population vs. Performance Accountability and Common Language 3. Population Accountability 4a. Performance Accountability 4b. Putting Population and Performance Accountability together Creating a Results Accountability Presentation Simple, Common Sense, Plain Language, Minimum Paper, Useful (2a) Pop vs. Perf Accountability (2b) Language Trap (3b) Definitions (4a) Example of Results (7-9) (Leaking Roof (10) Results Acct. Talk to Action (11) One turn the curve story (15-16) 4 Quadrants – types of perf measures (27) Perf. Acct. Talk to Action 7 Questions (28) Relationship between Pop and Perf. Acct (30b). Every time you make a presentation (31b) Training for Trainers and Coaches

TRAINING FOR TRAINERS AND COACHES TEACHING ROUND 1 WHY ARE WE HERE? WHY ARE YOU HERE? WHY IS THIS WORK IMPORTANT? OR What is the dissatisfaction driving people to consider new ways of working? Why do you believe in this work enough to want to teach it to others? TELL A STORY Pages 2b, 32b

SIMPLE COMMON SENSE PLAIN LANGUAGE MINIMUM PAPER USEFUL

3 - kinds of performance measures. How much did we do? How well did we do it? Is anyone better off? RBA in a Nutshell 2 – kinds of accountability Population accountability Performance accountability 7 - questions from ends to means in less than an hour. plus language discipline Results & Indicators Performance measures Baselines & Turning the Curve

TRAINING FOR TRAINERS AND COACHES TEACHING ROUND 1 WHY ARE WE HERE? WHY ARE YOU HERE? WHY IS THIS WORK IMPORTANT? OR What is the dissatisfaction driving people to consider new ways of working? Why do you believe in this work enough to want to teach it to others? TELL A STORY

Fiscal Policy Studies Institute Santa Fe, New Mexico TRAINING FOR TRAINERS AND COACHES TEACHING ROUND2 Population vs. Performance Accountability Common Language Pages 2b, 3b, 4a

Results Accountability is made up of two parts: Performance Accountability about the well-being of CLIENT POPULATIONS For Programs – Agencies – and Service Systems Population Accountability about the well-being of WHOLE POPULATIONS For Communities – Cities – Counties – States - Nations

THE LANGUAGE TRAP Too many terms. Too few definitions. Too little discipline Benchmark Target IndicatorGoal Result Objective Outcome Measure Modifiers Measurable Core Urgent Qualitative Priority Programmatic Targeted Performance Incremental Strategic Systemic Lewis Carroll Center for Language Disorders Measurable urgent systemic indicators Core qualitative strategic objectives Make up your own jargon.

DEFINITIONS Children born healthy, Children ready for school, Safe communities, Clean Environment, Prosperous Economy Rate of low-birthweight babies, Percent ready at K entry, crime rate, air quality index, unemployment rate 1. How much did we do? 2. How well did we do it? 3. Is anyone better off? RESULT or OUTCOME INDICATOR or BENCHMARK PERFORMANCE MEASURE A condition of well-being for children, adults, families or communities. A measure which helps quantify the achievement of a result. A measure of how well a program, agency or service system is working. Three types: Population Performance Children born healthy Rate of low-birthweight babiesPercent ready at K entry Children ready for school crime rate Safe communities air quality index Clean Environment unemployment rate Prosperous Economy INDICATOR RESULT PERFORMANCE MEASURE Population Performance = Customer Results

1. Safe Community 2. Crime Rate 3. Average Police Dept response time 4. People live in safe, stable affordable housing 5. % paying more than 30% of income for housing 6. People have living wage jobs and income 7. % of people with living wage jobs and income 8. % of participants in job training who get living wage jobs IS IT A RESULT, INDICATOR OR PERFORMANCE MEASURE? RESULT INDICATOR PERF. MEASURE RESULT INDICATOR RESULT INDICATOR PERF. MEASURE

A tall woody plant with lots of branches and leaves Tree Arbol Fred Tree

I think that I shall never see a poem lovely as a TALL WOODY PLANT WITH LOTS OF BRANCHES AND LEAVES The need for labels for ideas

Translation Guide/Rosetta Stone Not the Language Police Ideas 1. A condition of well-being for children, adults, families & communities etc. Group 1Group 2Group 3 etc. RESULTOUTCOMEGOAL TRANSLATION Back to the Idea

Fiscal Policy Studies Institute Santa Fe, New Mexico TRAINING FOR TRAINERS AND COACHES Lunch

Fiscal Policy Studies Institute Santa Fe, New Mexico TRAINING FOR TRAINERS AND COACHES TEACHING ROUND2 Population vs. Performance Accountability Common Language Pages 2b, 3b 4a

Fiscal Policy Studies Institute Santa Fe, New Mexico TRAINING FOR TRAINERS AND COACHES SORTING EXERCISE

Fiscal Policy Studies Institute Santa Fe, New Mexico TRAINING FOR TRAINERS AND COACHES POPULATION ACCOUNTABILITY TURN THE CURVE EXERCISE

Performance measure Population Indicator

Creating a Working Baseline from Group Knowledge Now Indicator or Performance Measure 75% Not OK? Backcasting Forecasting

Turn the Curve Exercise: Population Well-being 5 min:Starting Points - timekeeper and reporter - geographic area - two hats (yours plus partner’s) 10 min:Baseline - pick a result and a curve to turn - forecast (to 2016) – OK or not OK? 15 min:Story behind the baseline - causes/forces at work - information & research agenda part 1 - causes 15 min:What works? (What would it take?) - what could work to do better? - each partners contribution - no-cost / low-cost ideas - information & research agenda part 2 – what works 10 min:Report convert notes to one page Two pointers to action

ONE PAGE Turn the Curve Report: Population Result: _______________ Indicator (Lay Definition) Indicator Baseline Story behind the baseline (List as many as needed) Partners (List as many as needed) Three Best Ideas – What Works No-cost / low-cost Sharp Edges Off the Wall

Turn the Curve Exercise – Lessons From talk to action in less than an hour Look what you did! Talk to action in less than 1 hour! What did you learn? How was this different from other processes? What worked and what didn’t work? Why did we ask for: a. Baseline with forecast b. Story before what works c. No cost / low cost d. Two hats e. Results before indicators f. Crazy idea 3. Do you think a lay audience could understand the reports? 4. How many think you could lead this exercise with a small group?

HOMEWORK: 1. Self Assessment (Page 53) 2. Reading RBA/OBA Facebook Selected Essays Collective Impact Using RBA Appendix C other language (page 153) Prevention Services (page 100) 3. Hardest Question(s) "How do we….?" 4. Check out the RBA Facebook Discussion Group

Fiscal Policy Studies Institute Santa Fe, New Mexico TRAINING FOR TRAINERS AND COACHES TEACHING ROUND 3 POPULATION ACCOUNTABILITY Pages 2b, 10a, 11 or 12a plus 1 story

1.Why is this work important? 2. Population vs. Performance Accountability and Common Language 3. Population Accountability 4a. Performance Accountability 4b. Putting Population and Performance Accountability together Creating a Results Accountability Presentation Simple, Common Sense, Plain Language, Minimum Paper, Useful (2a) Pop vs. Perf Accountability (2b) Language Trap (3b) Definitions (4a) Example of Results (7-9) (Leaking Roof (10) Results Acct. Talk to Action (11) One turn the curve story (15-16) 4 Quadrants – types of perf measures (27) Perf. Acct. Talk to Action 7 Questions (28) Relationship between Pop and Perf. Acct (30b). Every time you make a presentation (31b) Training for Trainers and Coaches

Results Accountability is made up of two parts: Performance Accountability about the well-being of CLIENT POPULATIONS For Programs – Agencies – and Service Systems Population Accountability about the well-being of WHOLE POPULATIONS For Communities – Cities – Counties – States - Nations

Community Outcomes for Christchurch, NZ ● A Safe City ● A City of Inclusive and Diverse Communities ● A City of People who Value and Protect the Natural Environment ● A Well-Governed City ● A Prosperous City ● A Healthy City ● A City for Recreation, Fun and Creativity ● A City of Lifelong Learning ● An Attractive and Well-Designed City Example of results for all residents

Ottawa Population Results 1. Ottawa has a prosperous economy. 2. Ottawa residents are physically and mentally healthy. 3. Ottawa’s environment is clean and sustainable. 4. Ottawa’s communities are safe and welcoming. 5. Ottawa’s families are safe, stable, and supportive. 6. Ottawa’s children and young people achieve their potential. 7. Ottawa’s elders and people with disabilities and live with dignity and independence in settings they prefer. 8. Ottawa has open, effective, and inclusive government. DRAFT

CARDIFF, WALES Community Outcomes 1. People in Cardiff are healthy 2. Cardiff has a clean attractive and sustainable environment 3. People in Cardiff are safe and feel safe 4. Cardiff has a thriving and prosperous economy 5. People in Cardiff achieve their full potential. 6. Cardiff is a great place to live, work and play. 7. Cardiff has a fair, just and inclusive society.

VERMONT Population Outcomes (S.293) 1. Vermont has a prosperous economy. 2. Vermonters are healthy. 3. Vermont’s environment is clean and sustainable. 4. Vermont’s communities are safe and supportive. 5. Vermont’s families are safe, nurturing, stable, and supported. 6. Vermont’s children and young people achieve their potential. 7. Vermont’s elders and people with disabilities and people with mental conditions live with dignity and independence in settings they prefer. 8. Vermont has open, effective, and inclusive government at the State and local levels.

Leaking Roof (Results thinking in everyday life) Experience Measure Story behind the baseline (causes) Partners What Works Action Plan Inches of Water BASELINE ? Fixed Not OK Turning the Curve Action Plan # 2

Results / Outcomes Indicators Baseline & Story

45 people per day 75 people per day people per day MADD

Rebound

Christchurch, New Zealand Number of Graffiti Sites FY 2002 to FY 2010

Hull, UK "Woundings"

Fiscal Policy Studies Institute Santa Fe, New Mexico TRAINING FOR TRAINERS AND COACHES TEACHING ROUND 3 POPULATION ACCOUNTABILITY Pages 2b, 10a, 11 or 12a plus 1 story

HOMEWORK: 1. Self Assessment (Page 53) 2. Reading RBA/OBA Facebook Selected Essays Collective Impact Using RBA Appendix C other language (page 153) Prevention Services (page 100) 3. Hardest Question(s) "How do we….?" 4. Check out the RBA Facebook Discussion Group

Results Accountability Fiscal Policy Studies Institute Santa Fe, New Mexico TRAINING FOR TRAINERS AND COACHES DAY 2

TOUGHEST QUESTIONS

The Simplest Way TO IMPLEMENT RBA POPULATION ACCOUNTABILITY 1. Pick an important indicator curve 2. Run the Population Turn the Curve Exercise 3. Take action Repeat PERFORMANCE ACCOUNTABILITY 1. Pick an important performance measure curve 2. Run the Performance Turn the Curve Exercise 3. Take action Repeat

The RULE

RESULTS BASED BUDGETING Do we need it? Is it working? POPULATION ACCOUNTABILITY PERFORMANCE ACCOUNTABILITY

1. Ask each program to assign someone to become the in-house RBA expert. (Treat this like a technical support function like an in-house computer expert.) 2. Have these people practice and get good at selecting performance measures and running the Turn the Curve Exercises. 3. Create a network of in-house experts so they can support each other, learn how to do joint RBA training and coaching. 4. Ask the in-house experts to review the RBA Self- Assessment Questionnaire (and create a score if useful) on a regular basis. RBA expert in each unit

Alternative to Traditional Evaluation Methods: DEMONSTRATING a CONTRIBUTION to complex change efforts… requires 3 elements: A Curve to Turn 1 We tried a bunch of stuff that had a credible chance of making a difference … 2 …and it had a timely relationship to…. 3 …. a turn in the curve. c FPSI

Next Generation Contracting Contract Provisions Provision 1. Specify the 3 to 5 most important performance measures (from the How well did we do it? and Is anyone better off? categories). Provision 2. Specify that the contractor will use a continuous improvement process (the RBA 7 Questions). Provision 3. Specify how the funder and contractor will work in partnership to maximize LR customer results (quarterly meetings using the 7 questions as the agenda). Provision 4. Specify that the funder will work with the funding community to simplify and standardize contracting and performance reporting.

Provision 5: : Clear articulation of role in population/community well-being using the language of contribution not attribution. Provision 6: 10% for quality management and administration. Provision 7: Multi-year funding using 3 year rolling contracts Provision 8: Use of targets that are fair and useful. Provision 9: Fund flexibility and virtual funding pool: transfer of up to 10% across line items and program lines. Provision 10: Request for Results: Getting past the sometimes negative effects of competitive RFP contracting or tendering. Next Generation Contracting Contract Provisions

Fiscal Policy Studies Institute Santa Fe, New Mexico TRAINING FOR TRAINERS AND COACHES PERFORMANCE ACCOUNTABILITY

Select 3 to 5 Performance Measures ACROSS THE BOTTOM OF THE ORG CHART – 60 – 20 Rule

Performance Accountability For Programs, Agencies and Service Systems Fiscal Policy Studies Institute Santa Fe, New Mexico

Results Accountability is made up of two parts: Performance Accountability about the well-being of CLIENT POPULATIONS For Programs – Agencies – and Service Systems Population Accountability about the well-being of WHOLE POPULATIONS For Communities – Cities – Counties – States - Nations

“All performance measures that have ever existed for any program in the history of the universe involve answering two sets of interlocking questions.”

How Much did we do? ( # ) How Well did we do it? ( % ) Quantity Quality Program Performance Measures

Effort How hard did we try? Effect Is anyone better off? Program Performance Measures

Effort Effect How Much How Well Program Performance Measures

How much service did we deliver? Program Performance Measures How well did we deliver it? How much change / effect did we produce? What quality of change / effect did we produce? Quantity Quality Effect Effort Output Input

How much did we do? Program Performance Measures How well did we do it? Is anyone better off? Quantity Quality Effect Effort # %

How much did we do? Education How well did we do it? Is anyone better off? Quantity Quality Effect Effort Number of students Student-teacher ratio Number of high school graduates (completion or certificate rate) Percent of high school graduates (completion or certificate rate)

How much did we do? Education How well did we do it? Is anyone better off? Quantity Quality Effect Effort Number of students Student-teacher ratio Percent of 9 th graders who enter college or employment after graduation Number of 9 th graders who enter college or employment after graduation

How much did we do? Pediatric Practice How well did we do it? Is anyone better off? Number of children treated Percent of patients waiting less than 30 min in the waiting room Quantity Quality Effect Effort # children fully immunized (in the practice) % children fully immunized (in the practice)

How much did we do? Drug/Alcohol Treatment Program How well did we do it? Is anyone better off? Number of persons treated Percent of staff with training/ certification Number of clients off of alcohol & drugs - at exit - 12 months after exit Percent of clients off of alcohol & drugs - at exit - 12 months after exit Quantity Quality Effect Effort

How much did we do? Fire Department How well did we do it? Is anyone better off? Number of responses Response Time Quantity Quality Effect Effort # of fires kept to room of origin % of fires kept to room of origin

How much did we do? General Motors How well did we do it? Is anyone better off? # of production hrs # tons of steel Employees per vehicle produced # of cars sold $ Amount of Profit $ Car value after 2 years Quantity Quality Effect Effort Source: USA Today 9/28/98 % Market share Profit per share % Car value after 2 years

How much did we do? Not All Performance Measures Are Created Equal How well did we do it? Is anyone better off? Least Important Quantity Quality Effect Effort Most Important Least Most Also Very Important Quality

How much did we do? The Matter of Control How well did we do it? Is anyone better off? Quantity Quality Effect Effort Least Control PARTNERSHIPS Most Control

How much did we do? Performance Accountability Types of Measures found in each Quadrant How well did we do it? Is anyone better off? # Clients/customers served # Activities (by type of activity) % Common measures e.g. client staff ratio, workload ratio, staff turnover rate, staff morale, % staff fully trained, % clients seen in their own language, worker safety, unit cost % Skills / Knowledge (e.g. parenting skills) # % Attitude / Opinion (e.g. toward drugs) # % Behavior (e.g.school attendance) # % Circumstance (e.g. working, in stable housing) # % Activity-specific measures e.g. % timely, % clients completing activity, % correct and complete, % meeting standard Point in Time vs. 2 Point Comparison # %

LR UR Primary v. Secondary Direct v. Indirect Internal v. External Baseline & Story

Watermain Breaks per year London Ontario

Christus Saint Vincent's Medical Center Santa Fe, NM Turned curve on high end ER Use Etre Kathy

How much did we do? Service: __________________________________ How well did we do it? Is anyone better off? Primary customers # studentspatients persons trained Primary activity # hours of instruction diagnostic testsjob coursesalarms responded to If your service works really well, how are your customer's better off? # students who graduate patients who fully recover fires kept to room of origin % Unit cost Workload ratio % of ___x___ that happen on time persons who get jobs School HospitalJob Training Fire Department customers served

Fiscal Policy Studies Institute Santa Fe, New Mexico TRAINING FOR TRAINERS AND COACHES SELECTING PERFORMANCE MEASURES DEMONSTRATION & EXERCISE

How much did we do? Choosing Headline Measures and the Data Development Agenda How well did we do it? Is anyone better off? Quantity Quality Effect Effort # Measure # Measure # Measure # Measure # Measure # Measure # Measure #1 Headline #2 Headline #3 Headline #1 DDA #2 DDA #3 DDA % Measure % Measure % Measure % Measure % Measure % Measure % Measure # Measure # Measure # Measure # Measure # Measure # Measure # Measure % Measure % Measure % Measure % Measure % Measure % Measure % Measure

How to Measure: - Capacity Building - Vibrant Neighborhoods - Developed Countries etc. See "Trying Hard…" pages

Performance measure Population Indicator FPSI

Fiscal Policy Studies Institute Santa Fe, New Mexico TRAINING FOR TRAINERS AND COACHES USING PERFORMANCE MEASURES Turn the Curve Exercise

Creating a Working Baseline from Group Knowledge Now Indicator or Performance Measure 75% Not OK? Backcasting Forecasting

Turn the Curve Exercise: Program Performance 5 min:Starting Points - timekeeper and reporter - identify a program to work on - two hats (yours plus partner’s) 10 min:Performance measure baseline - choose 1 measure to work on – from the lower right quadrant - forecast (to 2016) – OK or not OK? 15 min:Story behind the baseline - causes/forces at work - information & research agenda part 1 - causes 15 min:What works? (What would it take?) - what could work to do better? - each partners contribution - no-cost / low-cost ideas - information & research agenda part 2 – what works 10 min:Report convert notes to one page Two pointers to action

Program: _______________ Performance Measure (Lay definition) Performance Measure Baseline Story behind the baseline (List as many as needed) Partners (List as many as needed) Three Best Ideas – What Works No-cost / low-cost ONE PAGE Turn the Curve Report: Performance Sharp Edges Off the Wall

Turn the Curve Exercise – Lessons From talk to action in less than an hour Look what you did! Talk to action in less than 1 hour! What did you learn? How was this different from other processes? What worked and what didn’t work? Why did we ask for: a. Baseline with forecast b. Story before what works c. No cost / low cost d. Two hats e. Results before indicators f. Crazy idea 3. Do you think a lay audience could understand the reports? 4. How many think you could lead this exercise with a small group?

Fiscal Policy Studies Institute TRAINING FOR TRAINERS AND COACHES TEACHING ROUND 4 PERFORMANCE ACCOUNTABILITY CONNECTING POPULATION & PERFORMANCE ACCOUNTABILITY

1.Why is this work important? 2. Population vs. Performance Accountability and Common Language 3. Population Accountability 4a. Performance Accountability 4b. Putting Population and Performance Accountability together Creating a Results Accountability Presentation Simple, Common Sense, Plain Language, Minimum Paper, Useful (2a) Pop vs. Perf Accountability (2b) Language Trap (3b) Definitions (4a) Example of Results (7-9) (Leaking Roof (10) Results Acct. Talk to Action (11) One turn the curve story (15-16) 4 Quadrants – types of perf measures (27) Perf. Acct. Talk to Action 7 Questions (28) Relationship between Pop and Perf. Acct (30b). Every time you make a presentation (31b) Training for Trainers and Coaches

How much did we do? Performance Accountability Types of Measures found in each Quadrant How well did we do it? Is anyone better off? # Clients/customers served # Activities (by type of activity) % Common measures e.g. client staff ratio, workload ratio, staff turnover rate, staff morale, % staff fully trained, % clients seen in their own language, worker safety, unit cost % Skills / Knowledge (e.g. parenting skills) # % Attitude / Opinion (e.g. toward drugs) # % Behavior (e.g.school attendance) # % Circumstance (e.g. working, in stable housing) # % Activity-specific measures e.g. % timely, % clients completing activity, % correct and complete, % meeting standard Point in Time vs. 2 Point Comparison

LR UR Primary v. Secondary Direct v. Indirect Internal v. External Baseline & Story

Contribution relationship Alignment of measures Appropriate responsibility THE LINKAGE Between POPULATION and PERFORMANCE POPULATION ACCOUNTABILITY Healthy Births Rate of low birth-weight babies Children Ready for School Percent fully ready per K-entry assessment Self-sufficient Families Percent of parents earning a living wage CUSTOMER RESULTS # persons receiving training Unit cost per person trained # who get living wage jobs % who get living wage jobs PERFORMANCE ACCOUNTABILITY POPULATION RESULTS Job Training Program

Fiscal Policy Studies Institute TRAINING FOR TRAINERS AND COACHES TEACHING ROUND 4 PERFORMANCE ACCOUNTABILITY CONNECTING POPULATION & PERFORMANCE ACCOUNTABILITY

How much did we do? Performance Accountability Types of Measures found in each Quadrant How well did we do it? Is anyone better off? # Clients/customers served # Activities (by type of activity) % Common measures e.g. client staff ratio, workload ratio, staff turnover rate, staff morale, % staff fully trained, % clients seen in their own language, worker safety, unit cost % Skills / Knowledge (e.g. parenting skills) # % Attitude / Opinion (e.g. toward drugs) # % Behavior (e.g.school attendance) # % Circumstance (e.g. working, in stable housing) # % Activity-specific measures e.g. % timely, % clients completing activity, % correct and complete, % meeting standard Point in Time vs. 2 Point Comparison

LR UR Primary v. Secondary Direct v. Indirect Internal v. External Baseline & Story

Contribution relationship Alignment of measures Appropriate responsibility THE LINKAGE Between POPULATION and PERFORMANCE POPULATION ACCOUNTABILITY Healthy Births Rate of low birth-weight babies Children Ready for School Percent fully ready per K-entry assessment Self-sufficient Families Percent of parents earning a living wage CUSTOMER RESULTS # persons receiving training Unit cost per person trained # who get living wage jobs % who get living wage jobs PERFORMANCE ACCOUNTABILITY POPULATION RESULTS Job Training Program

1.Why is this work important? 2. Population vs. Performance Accountability and Common Language 3. Population Accountability 4a. Performance Accountability 4b. Putting Population and Performance Accountability together Creating a Results Accountability Presentation Simple, Common Sense, Plain Language, Minimum Paper, Useful (2a) Pop vs. Perf Accountability (2b) Language Trap (3b) Definitions (4a) Example of Results (7-9) (Leaking Roof (10) Results Acct. Talk to Action (11) One turn the curve story (15-16) 4 Quadrants – types of perf measures (27) Perf. Acct. Talk to Action 7 Questions (28) Relationship between Pop and Perf. Acct (30b). Every time you make a presentation (31b) Training for Trainers and Coaches

Fiscal Policy Studies Institute Santa Fe, New Mexico TRAINING FOR TRAINERS AND COACHES NAME-MOTTO-MASCOT LAST SHOT AT HARD QUESTIONS NEXT STEPS EVALUATION & CERTIFICATES

Next Steps: 1. What’s 1 thing I could personally do with what I learned these two days? 2. What’s 1 thing I would like to ask city government to do to support this work? p. 37

CLOSING

3 - kinds of performance measures. How much did we do? How well did we do it? Is anyone better off? RBA in a Nutshell 2 – kinds of accountability Population accountability Performance accountability 7 - questions from ends to means in less than an hour. plus language discipline Results & Indicators Performance measures Baselines & Turning the Curve

Resources Book - DVD Orders amazon.com resultsleadership.org RBA Facebook Group

THANK YOU ! Book - DVD Orders amazon.com resultsleadership.org