Performance Measurement: Defining Results Tutorial #1 for AmeriCorps

Slides:



Advertisements
Similar presentations
Focusing an Evaluation Ben Silliman, Youth Development Specialist NC 4-H Youth Development.
Advertisements

Introduction to Performance Measurement for Senior Corps Project STAR Support and Training for Assessing Results Recorded 9/10/2007.
Tools and training for volunteer and service programs The Resource Center.
Overview of Performance Measurement. Learning Objectives By the end of the module, you will be able to: Describe what performance measurement is, and.
Foster Grandparent Program
Performance Measurement: Not just for breakfast anymore Performance Measurement and the Strategic Plan Senior Corps Virtual Conference August 2012.
1 Managing to Outcomes Creating a Result-Driven Culture September 15, 2010 Jewel Bazilio-Bellegarde, CNCS Ken Terao and Anna Marie Schmidt, Project STAR.
1 Performance Measurement Builder [Your Name] [Your Organization] [Contact Information] [todays date:]
1 Performance Measurement Builder [Your Name] [Your Organization] [Contact Information] [todays date:]
1 Instruments and Data Collection New Mexico AmeriCorps April 20, 2006 Sue Hyatt, Project STAR Coach.
1 Creating Strong Reports New Mexico AmeriCorps April 20, 2006 Sue Hyatt, Project STAR Coach.
Introduction to Performance Measurement for AmeriCorps*VISTA
The Project Plan and Performance Measures Tutorial #3 for AmeriCorps*VISTA.
Educational Specialists Performance Evaluation System
Using Data to Measure and Report Program Impact Anne Basham, MFA MEMconsultants.
VISTA Program Overview [insert name of your VISTA Project here]
Evaluation at The Prince’s Trust Fire Service Prince's Trust Association meeting 18 th February 2010 Subtitle.
Performance Measures. AmeriCorps Performance Measures – Why? This is how you tell your story – your “elevator” speech: “My members do this ”
Grantee Program Plan. Components of the Program Plan Goals  Objectives  Activities  Techniques & Tools  Outcomes/Change.
2014 AmeriCorps External Reviewer Training Assessing Need, Theory of Change, and Logic Model.
Service Agency Accreditation Recognizing Quality Educational Service Agencies Mike Bugenski
1 Why is the Core important? To set high expectations – for all students – for educators To attend to the learning needs of students To break through the.
CA Performance Measurement Worksheet (PMW)
2014 AmeriCorps State and National Symposium How to Develop a Program Logic Model.
Community Planning Training 1-1. Community Plan Implementation Training 1- Community Planning Training 1-3.
Promoting Increased School Stability & Permanence
How to Develop the Right Research Questions for Program Evaluation
JIC ABET WORKSHOP No.4 Guidelines on: II Faculty Survey Questionnaire.
2014 AmeriCorps External Reviewer Training
Performance Measurement and Evaluation Basics 2014 AmeriCorps External Reviewer Training.
1 Module 4: Designing Performance Indicators for Environmental Compliance and Enforcement Programs.
Student Learning Objectives The SLO Process Student Learning Objectives Training Series Module 3 of 3.
Organization Mission Organizations That Use Evaluative Thinking Will Develop mission statements specific enough to provide a basis for goals and.
1. 2 Why is the Core important? To set high expectations –for all students –for educators To attend to the learning needs of students To break through.
Performance Measures AmeriCorps Project Director Training Saratoga, NY October 7 th – 9 th, 2013.
Data Quality Review: Best Practices Sarah Yue, Program Officer Jim Stone, Senior Program and Project Specialist.
1 Introduction to Evaluating the Minnesota Demonstration Program Paint Product Stewardship Initiative September 19, 2007 Seattle, WA Matt Keene, Evaluation.
Fundamentals of Evaluation for Public Health Programs ROBERT FOLEY, M.ED. NIHB TRIBAL PUBLIC HEALTH SUMMIT MARCH 31,
Working Definition of Program Evaluation
1 Using a Statewide Evaluation Tool for Child Outcomes & Program Improvement Terry Harrison, Part C Coordinator Susan Evans, Autism Project Specialist.
EVALUATION RESEARCH. Evaluation Research  How do we begin?  What are the different types of evaluation research?  How do these different types fit.
Introduction to Evaluation January 26, Slide 2 Innovation Network, Inc. Who We Are: Innovation Network National nonprofit organization Committed.
The Logic Model An Introduction. Slide 2 Innovation Network, Inc. Who We Are National nonprofit organization Committed to evaluation as a tool for empowerment.
Performance Measurement 201: Best practices in performance measure design & implementation Ia Moua, Deputy Director, Grants & Program Development Patrick.
TRACKING AND REPORTING PROGRESS AND CONTINUOUS IMPROVEMENT AmeriCorps Program Directors’ Kickoff: 2015 –
Boston Geneva San Francisco Seattle Beginning the Evaluation Journey with FSG KCIC Boot Camp March 24, 2010 Prepared for:
Julie R. Morales Butler Institute for Families University of Denver.
ISM 5316 Week 3 Learning Objectives You should be able to: u Define and list issues and steps in Project Integration u List and describe the components.
Program Assessment Training September 29, Learning Objectives By participating in this session, you will develop a better understanding of: how.
September 2007 Survey Development Rita O'Sullivan Evaluation, Assessment, & Policy Connections (EvAP) School of Education, University of North Carolina-Chapel.
Children grow up in a safe and supportive environment Families are stronger and healthier, leading to greater success and personal development for children.
Healthy Futures Performance Measures Session. Session Overview Combination of presentation and interactive components Time at the end of the session for.
Capacity Building: The Heart of VISTA. By the end of this session, you will be able to:  Recognize the role VISTA members play as capacity builders to.
Education Performance Measures Session. Session Overview Combination of presentation and interactive components Time at the end of the session for Q&A.
Using Logic Models to Create Effective Programs
Outcome-based Planning and Evaluation Gloria Latimer, Ed.S, Director of Community Programs Jason Vahling, M.P.H., Community Program Specialist.
Office of Service Quality
1 YOUTHBUILD EVALUATION Building evidence about the effect of YouthBuild on the young people it serves August 17, 2011 Washington, D.C.
Performance Measurement 101. Performance Measurement Performance Measurement is: –The ongoing monitoring and reporting of program accomplishments and.
Are we there yet? Evaluating your graduation SiMR.
Jayne Schaefer, BA Workforce Programs Manager Mather LifeWays Evanston, Illinois Toward Building a Sustainable Long-Term Care Workforce: LEAP.
[Presentation location] [Presentation date] (Confirm ABT logo) Building Bridges and Bonds (B3): An introduction.
Increased # of AI/AN receiving in- home environmental assessment and trigger reduction education and asthma self-management education Increased # of tribal.
Selection Criteria and Invitational Priorities School Leadership Program U.S. Department of Education 2005.
Logic Models How to Integrate Data Collection into your Everyday Work.
Minnesota Alliance With Youth
Module 5 HAIL Research This module provides an overview of how researchers will collect data with both Independent Living Specialist(ILS) and consumers.
Presented by: Community Planning & Advocacy Council.
General Notes Presentation length - 10 – 15 MINUTES
Presentation transcript:

Performance Measurement: Defining Results Tutorial #1 for AmeriCorps Performance Measurement: Defining Results Tutorial #1 for AmeriCorps*VISTA

This tutorial will cover: Uses of Performance Measurement Performance Measurement Requirements Introduction to the Project Plan Performance Measurement Six Steps What are Results? Output, Intermediate Outcome, End Outcome Results Examples Additional Resources

Uses of Performance Measurement Internal program assessment and improvement Fundraising Communicating with stakeholders Project monitoring and technical assistance Corporation reports and publications

Performance Measurement Requirements

Performance Measurement Requirements One project plan containing one or more goals

Performance Measurement Requirements One project plan containing one or more goals Identify activities and results for each goal

Performance Measurement Requirements One project plan containing one or more goals Identify activities and results for each goal Results are written as outputs, intermediate outcomes, or end outcomes

Performance Measurement Requirements One project plan containing one or more goals Identify activities and results for each goal Results are written as outputs, intermediate outcomes, or end outcomes Label 3-5 of these results as “performance measures”

Performance Measurement Requirements One project plan containing one or more goals Identify activities and results for each goal Results are written as outputs, intermediate outcomes, or end outcomes Label 3-5 of these results as “performance measures” One Output

Performance Measurement Requirements One project plan containing one or more goals Identify activities and results for each goal Results are written as outputs, intermediate outcomes, or end outcomes Label 3-5 of these results as “performance measures” One Output One Intermediate Outcome

Performance Measurement Requirements One project plan containing one or more goals Identify activities and results for each goal Results are written as outputs, intermediate outcomes, or end outcomes Label 3-5 of these results as “performance measures” One Output One Intermediate Outcome One End Outcome

Performance Measurement Requirements One project plan containing one or more goals Identify activities and results for each goal Results are written as outputs, intermediate outcomes, or end outcomes Label 3-5 of these results as “performance measures” One Output One Intermediate Outcome One End Outcome Identify indicators, targets, and instruments for each performance measure

AmeriCorps*VISTA Project Plan Column A Goals, Activities, and Results Column B Date(s) Column C Project Reporting GOAL 1   Activities Results Outputs Intermediate Outcomes End Outcomes GOAL 2  Activities  Results GOAL 3 Etc.

AmeriCorps*VISTA Project Plan Column A Goals, Activities, and Results Column B Date(s) Column C Project Reporting GOAL 1   Activities Results Outputs Intermediate Outcomes End Outcomes GOAL 2  Activities  Results GOAL 3 Etc.

AmeriCorps*VISTA Project Plan Column A Goals, Activities, and Results Column B Date(s) Column C Project Reporting GOAL 1   Activities Results Outputs Intermediate Outcomes End Outcomes GOAL 2  Activities  Results GOAL 3 Etc.

AmeriCorps*VISTA Project Plan Column A Goals, Activities, and Results Column B Date(s) Column C Project Reporting GOAL 1   Activities Results Outputs Intermediate Outcomes End Outcomes GOAL 2  Activities  Results GOAL 3 Etc.

Performance Measurement Six Steps Performance measurement is a six-step process for regularly measuring your program results.

1. Develop Logic Model & Project Plan Performance Measurement Six Steps 1. Develop Logic Model & Project Plan

1. Develop Logic Model & Project Plan Performance Measurement Six Steps 1. Develop Logic Model & Project Plan The logic model describes your AmeriCorps*VISTA project. Use it to identify your project activities and what you will measure to gauge the success of your project.

1. Develop Logic Model & Project Plan Performance Measurement Six Steps 1. Develop Logic Model & Project Plan 2. Develop PM Plan

1. Develop Logic Model & Project Plan Performance Measurement Six Steps 1. Develop Logic Model & Project Plan Identifying your data sources and data collectors. Determine a timeline for data collection, analysis, and reporting 2. Develop PM Plan

1. Develop Logic Model & Project Plan 3. Develop and Test Instruments Performance Measurement Six Steps 1. Develop Logic Model & Project Plan 2. Develop PM Plan 3. Develop and Test Instruments

1. Develop Logic Model & Project Plan Performance Measurement Six Steps 1. Develop Logic Model & Project Plan Adapt existing instruments or develop your own; pilot test to make sure instruments collect valid, appropriate information 2. Develop PM Plan 3. Develop and Test Instruments

1. Develop Logic Model & Project Plan Performance Measurement Six Steps 1. Develop Logic Model & Project Plan 2. Develop PM Plan 3. Develop and Test Instruments 4. Collect Data

1. Develop Logic Model & Project Plan Performance Measurement Six Steps 1. Develop Logic Model & Project Plan Go out and collect your data (e.g., fill out attendance sheets, administer surveys, conduct interviews) 2. Develop PM Plan 3. Develop and Test Instruments 4. Collect Data

1. Develop Logic Model & Project Plan Performance Measurement Six Steps 1. Develop Logic Model & Project Plan 2. Develop PM Plan 5. Analyze Data 3. Develop and Test Instruments 4. Collect Data

1. Develop Logic Model & Project Plan Performance Measurement Six Steps 1. Develop Logic Model & Project Plan Aggregate and analyze data; generate summary info (totals, averages, etc) 2. Develop PM Plan 5. Analyze Data 3. Develop and Test Instruments 4. Collect Data

1. Develop Logic Model & Project Plan Performance Measurement Six Steps 6. Report Results 1. Develop Logic Model & Project Plan 2. Develop PM Plan 5. Analyze Data 3. Develop and Test Instruments 4. Collect Data

Write progress report; include your performance measurement results Performance Measurement Six Steps 6. Report Results 1. Develop Logic Model & Project Plan Write progress report; include your performance measurement results 2. Develop PM Plan 5. Analyze Data 3. Develop and Test Instruments 4. Collect Data

1. Develop Logic Model & Project Plan Performance Measurement Six Steps 1. Develop Logic Model & Project Plan 6. Report Results 2. Develop PM Plan 5. Analyze Data 3. Develop and Test Instruments 4. Collect Data

1. Develop Logic Model & Project Plan Performance Measurement Six Steps 1. Develop Logic Model & Project Plan 6. Report Results Continuous Program Improvement 2. Develop PM Plan 5. Analyze Data 3. Develop and Test Instruments 4. Collect Data

1. Develop Logic Model & Project Plan Performance Measurement Six Steps 1. Develop Logic Model & Project Plan 6. Report Results Continuous Program Improvement 2. Develop PM Plan 5. Analyze Data 3. Develop and Test Instruments 4. Collect Data

What Are Results?

What Are Results? Outputs and outcomes your AmeriCorps*VISTA project hopes to achieve by engaging in service activities

What Are Results? Outputs and outcomes your AmeriCorps*VISTA project hopes to achieve by engaging in service activities Outputs: Services delivered and products completed by VISTA members

What Are Results? Outputs and outcomes your AmeriCorps*VISTA project hopes to achieve by engaging in service activities Outputs: Services delivered and products completed by VISTA members Outcomes: Changes or benefits that occur as a result of services delivered

What Are Results? Outputs and outcomes your AmeriCorps*VISTA project hopes to achieve by engaging in service activities Outputs: Services delivered and products completed by VISTA members Outcomes: Changes or benefits that occur as a result of services delivered Intermediate Outcomes: Changes that are short of the “final” result you hope to achieve each year

What Are Results? Outputs and outcomes your AmeriCorps*VISTA project hopes to achieve by engaging in service activities Outputs: Services delivered and products completed by VISTA members Outcomes: Changes or benefits that occur as a result of services delivered Intermediate Outcomes: Changes that are short of the “final” result you hope to achieve each year End Outcomes: The most significant changes that your AmeriCorps*VISTA project hopes to achieve each year

Scenario for Example Results Community-based organization (CBO) has existing mentoring program, but faces challenges in recruiting and retaining volunteer mentors. CBO unable to deliver high-quality service to youth. VISTA members will serve with CBO to develop system to recruit, train and support volunteer mentoring program.

Outputs Position descriptions for volunteer mentors Written procedures for screening volunteer mentors Tracking database Training curriculum for new volunteer mentors Written procedures to provide ongoing support to volunteer mentors Agency staff complete training in new systems and procedures Outputs answer the question, “How much service did we do?” They do NOT answer the question, “What changed as a result of the service?”

Intermediate Outcomes Trained agency personnel demonstrate understanding of how to use new system and procedures (new knowledge and skills). Agency personnel use new systems and procedures to recruit, train, and support volunteer mentors (changes in behavior). Intermediate outcomes are important milestones on the way to achieving end outcomes. Achieving intermediate outcomes can lead to attaining end outcomes.

End Outcomes More youth are served by volunteer mentors under the new system than were served under the previous system (increased organizational capacity). More youth experience a close and stable relationship with a caring adult, because a greater proportion of volunteer mentors complete their service commitments (improved quality of service). End outcomes are changes that reflect the overarching goals of your AmeriCorps*VISTA project.

Additional Resources: Contact your CNCS State Office Contact Project STAR www.projectstar.org 1-800-548-3656 star@aiweb.com