1 A QTS Web Training Writing Consumer Education & Referral Outcomes.

Slides:



Advertisements
Similar presentations
A Systems Approach To Training
Advertisements

Program Evaluation. Overview and Discussion of: Objectives of evaluation Process evaluation Outcome evaluation Indicators & Measures Small group discussions.
Grantee Program Plan. Components of the Program Plan Goals  Objectives  Activities  Techniques & Tools  Outcomes/Change.
Kathy Keeley Northland Foundation Strengthening Communities April 14, 2011 Writing Result Measures and Program Evaluation.
Corry Bregendahl Leopold Center for Sustainable Agriculture Ames, Iowa.
Edit the text with your own short phrases. To change the sample image, select the picture and delete it. Now click the Pictures icon in the placeholder.
Developing a Logic Model
The Lumina Center Grantseeking Workshop Series Presents Outcomes & Evaluations April 20, 2006.
Title I Needs Assessment and Program Evaluation
Washington State Prevention Summit Analyzing and Preparing Data for Outcome-Based Evaluation Using the Assigned Measures and the PBPS Outcomes Report.
Developing Earmark Grant Performance Measures: Grant Proposal Section 3 Deanna Khemani.
Community Planning Training 1-1. Community Plan Implementation Training 1- Community Planning Training 1-3.
HOW VOLUNTEERS MAKE A DIFFERENCE: Identifying and Measuring Volunteer Outcomes Montgomery County May 2015 Pam Saussy and Barry Seltser, Pro Bono Consultants.
Develop Systematic processes Mission Performance Criteria Feedback for Quality Assurance Assessment: Collection, Analysis of Evidence Evaluation: Interpretation.
Molly Chamberlin, Ph.D. Indiana Youth Institute
How to Develop a Project Evaluation Plan Pat Gonzalez Office of Special Education Programs
1 Writing Outcomes Produced by Non-Instructional Subcommittee of Assessment Committee.
Measuring for Success Module Nine Instructions:
How to Focus and Measure Outcomes Katherine Webb-Martinez Central Coast and South Region All Staff Conference April 23, 2008.
1 Qualitative Evaluation Terms Coding/categorization The process of condensing qualitative data through the identification of common themes. Data Matrix.
Family/Whānau Caregiver Assessment and Approval Engaging with families to achieve better outcomes for children and young people.
Assessment of Staff Needs and Satisfaction in an Evergreen Environment David Green NC Cardinal Consultant State Library of North Carolina.
Program Planning & Evaluation Begin with the End in Mind Dr. Dallas L. Holmes Specialist Institutional Research Utah State University Extension.
Impact Evaluation: Initiatives, Activities, & Coalitions Stephen Horan, PhD Community Health Solutions, Inc. September 12, 2004.
Edward M. Haugh Jr. ESC Consultant. III. Recommendations for Applying Outcomes Planning to ESC  I. Introduction to Outcomes Planning II. A Sample ESC.
The Evaluation Plan.
Logic Models Handout 1.
Program Evaluation and Logic Models
Fundamentals of Evaluation for Public Health Programs ROBERT FOLEY, M.ED. NIHB TRIBAL PUBLIC HEALTH SUMMIT MARCH 31,
Evaluation Assists with allocating resources what is working how things can work better.
2004 National Oral Health Conference Strategic Planning for Oral Health Programs B.J. Tatro, MSSW, PhD B.J. Tatro Consulting Scottsdale, Arizona.
Military Family Services Program Participant Survey Training Presentation.
Note to evaluator… The overall purpose of this presentation is to guide evaluators through the completion of step 7 of the UFE checklist and to “level.
Outcome Based Evaluation for Digital Library Projects and Services
You’ve Got What It Takes: Peer Training and Mentoring for Staff Development You’ve Got What It Takes: Peer Training and Mentoring for Staff Development.
Introduction to Evaluation January 26, Slide 2 Innovation Network, Inc. Who We Are: Innovation Network National nonprofit organization Committed.
Multi-Agency Planning in Practice Skill development workshop.
Logic Models and Theory of Change Models: Defining and Telling Apart
Ways to Assess Family Engagement Outcomes Wendy Allen
 How do we begin?  What are the different types of evaluation research?  How do these different types fit together?  What purpose do they serve?
Director of Evaluation and Accountability Manager, UW’s Grand Rapids, Michigan Robert McKown, CIRS Director of Evaluation and Accountability Sherri.
Julie R. Morales Butler Institute for Families University of Denver.
Prepared by the North Dakota State Data Center July HNDECA and ECCS Evaluation Dr. Richard Rathge Professor and Director North Dakota State Data.
Creating a S.I.M.P.L.E. & Comprehensive Assessment Plan for Residence Life and Housing Dr. Mike Fulford Emory University Student Affairs Assessment Conference.
 Read through problems  Identify problems you think your team has the capacity and interest to solve  Prioritize the problems and indicate the.
12 Tips for Mentoring Excellence Adapted by Dr. Reynaldo Ramirez, Jr.
Family Resource and Youth Services Centers: Action Component Plan.
Communicating Impact Elizabeth Coke Haller School Health Team Leader Program Development and Services Branch Division of Adolescent and School Health.
THIS PRESENTATION IS INTENDED AS ONE COMPLETE PRESENTATION. HOWEVER, IT IS DIVIDED INTO 3 PARTS IN ORDER TO FACILITATE EASIER DOWNLOADING AND VIEWING,
Mapping the logic behind your programming Primary Prevention Institute
Collecting and Using Data ROMA Data for Management and Accountability.
The P Process Strategic Design
Community Planning 101 Disability Preparedness Summit Nebraska Volunteer Service Commission Laurie Barger Sutter November 5, 2007.
GET READY 1 Task 1: Assemble and Orient an Outcome Measurement Workgroup Workgroup: Task 3: Develop Timeline Task 4: Distribute your game plan to Key Players.
Illinois Department of Children & Family Service/Chicago State University STEP Program - NHSTES May THE STEP PROGRAM Supervisory Training to Enhance.
Project Design Jennifer Coffey OSEP May 4,
ROMA In a Nutshell. Results-Oriented Management & Accountability  An accountability process used to report outcomes achieved  A conceptual framework.
Does Your HHW Education Program Work? Workshop on Program Evaluation – Evaluation Logic Model NAHMMA Conference September 22, 2006 Tacoma, WA Trudy C.
Are we there yet? Evaluating your graduation SiMR.
Childhood Neglect: Improving Outcomes for Children Presentation P21 Childhood Neglect: Improving Outcomes for Children Presentation Measuring outcomes.
Developing Smart objectives and literature review Zia-Ul-Ain Sabiha.
State Development Information and tips to develop the Annual Work Plan 1.
Middle Managers Workshop 2: Measuring Progress. An opportunity for middle managers… Two linked workshops exploring what it means to implement the Act.
Assessment of Advising Linda Taylor, PhD, LPC, NCC September 9, 2011.
ADRCs Do What? Using Logic Models to Document and Improve ADRC Outcomes Glenn M. Landers.
Logic Models How to Integrate Data Collection into your Everyday Work.
Evaluating the Quality and Impact of Community Benefit Programs
D2L Refresher Upload content into the Content section in a D2L course
Logic Models and Theory of Change Models: Defining and Telling Apart
Outcomes Based Evaluation
Presentation transcript:

1 A QTS Web Training Writing Consumer Education & Referral Outcomes

2 Things to know You have control of the power point on your own computer The trainer will tell you when to go to the next slide Please mute your phone unless you have a question or comment If we should get disconnected by phone, call back in If you experience difficulty with the PowerPoint while on line, let the facilitator know.

3 Details…. You were sent the PowerPoint with the URL Attendance will be taken at the conclusion of the call If you need additional assistance, please work with your Quality Assurance Training & Support Specialist

4 Who’s here? Referral Specialist CCR&R Program Director/Supervisor Other

5 What we will do… Review expectations of 2.B.1.c and 2.C.1.a Writing consumer education and referral specific outcomes

6 Results Accountability Guidebook Results Accountability Guidebook Child Care Resource Referral, Oregon State University Family Policy Program & Oregon Child Care Research Partnership, Pratt, Clara, and Weber Bobbie, Chapters 2, 3, and 6 _guidebook_10-00.pdf. _guidebook_10-00.pdf

7 2.B.1.c An outcome based plan drives your services Appropriate outcomes, indicators, activities, and inputs Evaluation tool used to measure indicators Compilation of that data (Based on what you are collecting, how do you know you’ve achieved the outcome?)

8 2.C.1.a Outcome Based Evaluation Tools measure movement toward outcomes Surveying clients (minimum 20% response rate) Compiles and analyzes data Uses survey results to inform services

9 Performance Measurement includes answering the following ?s: What are the planned activities, outputs, and intended outcomes? Does the program achieve its planned activities and outputs? Does the program achieve its intended outcomes and results? Results Accountability Guidebook, pg. 82

10 Logic Model Results Accountability Guidebook, pgs. 18

11 What’s the difference? Activity: Use CCR&R database to link families with providers appropriate to family needs Output: 256 families received referrals in the month of May. 97% of clients received between 5 and 10 child care options. (database) Outcome: Increased knowledge of child care options that meet family needs Indicator: 75% of parents responding to the follow up survey report an increase in knowledge of child care options that meet their needs (survey)

12 What is an outcome? Answer this question: What is it you want to happen to clients who call your referral line? Writing outcomes may be easier than you think.

13 Outcomes are the program’s results for people & communities Contribute to the achievement of longer term goals Describe a desired state of knowledge, attitude, skills, behaviors, or circumstances Outcomes are observable, measurable, and achievable Results Accountability Guidebook, pg. 24

14 Outcomes seek to… Increase Decrease Maintain Results Accountability Guidebook, pg. 24

15 Outcomes can be Initial Increased knowledge of the characteristics of high quality child care Longer term Increased family satisfaction with child care Results Accountability Guidebook, pg. 24

16 So that… Key Activity: Provide information about the characteristics of high quality child care, so that Outcome 1: Parent knowledge of characteristics of high quality child care increases, so that Outcome 2: Parents use knowledge of characteristics of high quality child care in their child care search, so that Outcome 3: Parents choose high quality child care arrangement, so that Outcome 4: Parents are satisfied with child care arrangement, so that Outcome 5: There is an increased probability of continuity of care for the child, so that Ultimate goal: Increased family sufficiency and ability to achieve personal goals is achieved. Results Accountability Guidebook, pg. 85

17 Examples of consumer ed & referral specific outcomes Selected initial outcomes – Increased knowledge of child care options that meet family needs – Increased access to high quality child care options that meet family needs Selected longer term outcomes – Increased family self-sufficiency and ability to achieve person goals Results Accountability Guidebook, pg. 43

18 Writing Outcomes Key Activity: Providing clients with written material and consultation about the differences between regulated and non-regulated child care. 1) Identify the target group 2) What is the action verb? 3) What is the result 1) Parents who call the referral line 2) Increase 3) An understanding of the difference between regulated and non-regulated care

19 Combine the 3 to make a statement After consultation with a referral counselor, parents will have increased knowledge of the difference between regulated and non-regulated care. Does this statement… Identify the target group? Identify the desired change in knowledge? Is it specific?

20 Key Activity: Provide information about quality indicators to each client What is the intended outcome? To write the outcome statement… 1) Identify the target audience 2) What is the action word 3) What is the desired result?

21 Now you try Think of a key activity you engage in on a daily basis Identify the target group impacted by this activity What is the action verb? What is the result? Combine the 3 to make an outcome statement

22 A common error The confusion between – Outcomes – Activities

23 The difference… Outcome Increased knowledge of child care options that meet family needs Activity Use CCR&R database to link families with providers appropriate to family needs

24 An outcome might have multiple activities associated with it. For instance, what activities do we engage in to…. Increase parents’ understanding of quality child care characteristics

25 Another common error The difference between – Outcomes – Outputs

26 The difference Outcome Increased knowledge of the characteristics of high quality child care Output Volume: Number of families who received written materials describing characteristics of high quality child care Quality: Parent satisfaction with consultations and educational materials about quality child care characteristics

27 Another example Outcome Increased knowledge of child care options that meet family needs Output Volume: Number of families who received child care referrals Quality: Accuracy of referrals received by families

28 Assessing outcomes Increased family knowledge of child care options that meet family needs Does the outcome state who will change? Does the outcome state the nature of the change or benefit due to contact with the CCR&R? Is it measurable? Is it specific and can it be clearly understood? Is it realistic and feasible? Is it something the CCR&R can control?

29 How about this one? 100% of families contacting the CCR&R for referrals will receive written materials describing characteristics of high quality child care Does the outcome state who will change? Does the outcome state the nature of the change or benefit due to contact with the CCR&R? Is it measurable? Is it specific and can it be clearly understood? Is it realistic and feasible? Is it something the CCR&R can control?

30 Remember Outcomes… Focus on the program’s results for families Describe a desired state of knowledge, attitude, skills, behaviors, or circumstances Are observable, measurable, and achievable Should be written in an active way: increase, decrease, maintain

31 Implement these strategies to avoid common errors Understand terminology – Areas of particular confusion outcomes vs. activities; outcomes vs. outputs; indicators vs. outputs Start with a logic model – What do you want to accomplish? (outcome) – How will you know if it has happened? (indicator) Proceed realistically Choose outcomes that are realistically achievable and measurable

32 What we wanted to do Review expectations of 2.B.1.c and 2.C.1.a Practice identifying and writing outcome statements Answer your questions

33 Wrapping up Attendance – Please STAY ON the line until everyone’s name is called. – If your name is NOT called and/or you are sharing the connection with someone else, please stay on the line after everyone has gone We need: Your name, and Agency ID

34 Contact Info Questions: OR ( )