Improving Impact Statements Using Survey Data 2016 Extension Conference Jeff Buckley, Jennifer Cantwell, January 14, 2016.

Slides:

Advertisements

Similar presentations

Program Evaluation: What is it?

Advertisements

A Vehicle to Promote Student Learning

One of the most important aspects of any CME activity is evaluation, or outcomes measurement. CME Compliance: Evaluation Measuring the educational outcomes.

Classroom Assessment Techniques for Early Alert of Students At Risk Carleen Vande Zande, Ph.D. Academic Leaders Workshop.

Proposal Development Guidelines for Signature Grantee Semi-Finalists The Covenant Foundation.

Using Logic Models in Program Planning and Grant Proposals The Covenant Foundation.

Writing Effective Impact Statements Communicating the Public Value of K-State Research and Extension Presented by Department of Communications Pat Melgares.

Bridging Research, Information and Culture An Initiative of the Research and Planning Group for California Community Colleges Your Name Your Institution.

Simple Survey Resources Jeff Buckley, Jennifer Cantwell, Casey Mull, Whitney Cherry, Julie Dillard, Nicole Crawson.

Simple Survey Resources: Templates, Tabulation & Impact Jeff Buckley, Jenna Daniel, & Casey Mull.

Does It Work? Evaluating Your Program

Dennis McBride, Ph.D. The Washington Institute (253) Goal Driven Logic Models.

Evaluation is a professional and ethical responsibility and is a core part of PHN professional practice Commitment to evaluation helps build the PHN intelligence.

Programming Techniques and Skills for Advisory Leaders Ralph Prince and Roger Rennekamp, Ph.D. University of Kentucky Cooperative Extension Service.

1 CCLI Proposal Writing Strategies Tim Fossum Program Director Division of Undergraduate Education National Science Foundation Vermont.

Rest of Course Proposals & Research Design Measurement Sampling Survey methods Basic Statistics for Survey Analysis Experiments Other Approaches- Observation,

How to Write Goals and Objectives

Community Planning Training 1-1. Community Plan Implementation Training 1- Community Planning Training 1-3.

1 Classroom-Based Research: How to Be a Researcher in Your Classroom Basic Skills Initiative Teaching and Learning Workshop October 2009 Darla M. Cooper.

How to Focus and Measure Outcomes Katherine Webb-Martinez Central Coast and South Region All Staff Conference April 23, 2008.

Camping & Environmental Education Institute 2/25/15

Program Planning & Evaluation Begin with the End in Mind Dr. Dallas L. Holmes Specialist Institutional Research Utah State University Extension.

PROGRAM PLANNING, IMPLEMENTATION & EVALUATION The Service Delivery Model Link Brenda Thompson Jamerson, Chair Services to Youth Facet May 8-12, 2013.

Section III Major & Annual Objectives Program Logic in Program Development Black Box Program Delivery just assembles inputs, delivers, measures outputs.

Designing effective self marketing tools

Simple Survey Resources: Templates, Tabulation, & Impact for Novices National Urban Extension Conference May 5, 2015 Jeff Buckley, Jennifer Cantwell, Casey.

Connected Learning with Web 2.0 For Educators Presenter: Faith Bishop Principal Consultant Illinois State Board of Education

Logic Models Handout 1.

Prepared by SOCCCD Office of Human Resources

Fundamentals of Evaluation for Public Health Programs ROBERT FOLEY, M.ED. NIHB TRIBAL PUBLIC HEALTH SUMMIT MARCH 31,

Evaluation Assists with allocating resources what is working how things can work better.

Evelyn Gonzalez Program Evaluation. AR Cancer Coalition Summit XIV March 12, 2013 MAKING A DIFFERENCE Evaluating Programmatic Efforts.

Comp 20 - Training & Instructional Design Unit 6 - Assessment This material was developed by Columbia University, funded by the Department of Health and.

Kirkpatrick’s Levels of Evaluation

Mission Statement, Goals & Objectives HSC 489. Mission Statement GOALS Objectives.

Logic Models and Theory of Change Models: Defining and Telling Apart

Julie R. Morales Butler Institute for Families University of Denver.

Prepared by the North Dakota State Data Center July HNDECA and ECCS Evaluation Dr. Richard Rathge Professor and Director North Dakota State Data.

Institute for Financial Literacy © Three Elements to a Successful Financial Literacy Education Program Leslie E. Linfield, Esq. October 29, 2008.

Healthy Halls School Wellness Program. 2 Why Healthy Halls School Wellness Program There is a problem in Georgia:  Nearly 40 percent of children in Georgia.

 Read through problems  Identify problems you think your team has the capacity and interest to solve  Prioritize the problems and indicate the.

Evaluation Tools and Models Northern Plains CCC Program Comprehensive Cancer Control 2008 Annual Grantee Meetings May 14th, 2008 Atlanta, GA.

The Logic Model An Outcomes-Based Program Model. What is a Logic Model? “a systematic and visual way to present and share your understanding of the relationships.

WASHINGTON STATE UNIVERSITY EXTENSION Evaluation Based Program Development This material was developed in partnership with Rutgers's University and Lydia.

Using Logic Models in Program Planning and Grant Proposals The Covenant Foundation.

The Professional Development Plan for License Renewal in Wisconsin Goal Writing Workshop.

1 A QTS Web Training Writing Consumer Education & Referral Outcomes.

Fiver Foundation TOC Cari Kupec-do not reproduce without permission.

Adrienne DiTommaso, MPA, CNCS Office of Research and Evaluation

Planning Evaluation Setting the Course Source: Thompson & McClintock (1998) Demonstrating your program’s worth. Atlanta: CDC/National Center for Injury.

Readings n Text: Riddick & Russell –Ch1 stakeholders – p10 –Ch 2 an evaluation system –Proposal p25-36 – Ch 4 – Lit Review n Coursepack –GAO report Ch.

Proposal Development Guidelines for Signature Grantee Semi-Finalists The Covenant Foundation.

4-H Simple Evaluation Templates Revamped: Gathering Data for Program Improvement and Impact Reporting 2015 NAE4-HA Jeff Buckley, Kasey Bozeman, Jennifer.

1 Key Roles of River Basin Planners Integrators of Knowledge and People Trade-offs analysts and presenters Communicators and Facilitators CORE COMPETENCIES.

Rest of Course Proposals & Research Design Measurement Sampling

I NTRODUCTION TO E VALUATION CSU Evaluation Team.

Simple Surveys: From Program Objectives to Impact Statements in 90 Minutes 2016 Extension Conference Jeff Buckley & Jennifer Cantwell January 13, 2016.

Defining Our Work: Faculty Assignment Documents Elaine Bowen Health Specialist, F & H.

Assessment/Evaluation Make evaluation a central part of planning – not an afterthought 1) Determine Needs 2) Determine Desired Outcomes 3) Determine Activities.

true potential An Introduction to the First Line Manager Programme’s CMI Qualifications.

ADRCs Do What? Using Logic Models to Document and Improve ADRC Outcomes Glenn M. Landers.

Allison Nichols, Ed.D. Extension Specialist in Evaluation.

Using Logic Models in Program Planning and Grant Proposals

BEST PRACTICES IN LIBRARY INSTRUCTION FORUM November 7, 2007

Determine Grant Impacts through Ripple Effects Mapping

Resources Program Activities Outputs Outcomes Impact Assessment +

Using Logic Models in Project Proposals

Why now? New requirement for all RACs in the next Request for Applications (RFA) Improve communications among all participants Increased need to identify.

Presentation transcript:

Improving Impact Statements Using Survey Data 2016 Extension Conference Jeff Buckley, Jennifer Cantwell, January 14, 2016

Topics we will cover….. Why are impact statements important? Who reads impact statements? Parts of an Impact Statement Resources for Improvement – Top 10 Criteria – Examples submitted to National Database Collecting Outcome Data – Survey Templates – Data Tabulation Templates

Impact Statements are important….. Inform Legislators (money!) Media (awareness, visibility) Your Boss (Do you like your job?) Document your professional accomplishments (Do you want respect?) National recognition (Do you want to get promoted?)

What should an impact statement tell the reader?

An impact statement is….. A reportable, quantifiable difference or potential difference a program makes in real people’s lives.

Types of impact Behavior change Attitude change Improvement in situation Economic value or efficiency Environmental quality Social well- being Health & well- being

An impact statement is NOT: List of outputs (activities or programs) Number of participants Number of resources distributed Number of phone calls received/made

Resources for Improvement Your Colleagues - Grammar/Style Resources for Improvement – PDC Feedback – Top 10 Criteria – Examples submitted to National Database (Note 4-H Topics)

Parts of an Impact Statement 1.Summary 2.Situation 3.Response 4.Impact

Summary Don’t forget to include this! Short overview of the all parts – situation, response, impact

Situation What problem are you trying to solve? How do you know it’s a problem? (Include statistics, preferably specific to your county.)

Response What did you do to solve it? Short and sweet – don’t need to know the whole process Describe program objectives Who’s the audience? When/where did you deliver the program? With whom did you collaborate?

Impact/Result What happened? Number of participants Include quotes Program Outcomes – What was the benefit?

Collecting Outcome Data – Survey Templates – Data Tabulation Templates

Outcomes What are some of the outcomes you hope to report in your impact statements?

The tools you need are here!

Our Survey Tools  Survey Templates  Likert Style - Pretest and/or Posttest  Likert Style - Retrospective Post then Pre  Combination Knowledge & Likert  Kid-friendly format  Data Tabulation Spreadsheets  Translate numbers into words

Program Outcomes Short-term Outcomes – Increase in Knowledge or Skill – Demonstration of Knowledge or Skill – Change in Behavioral Intention As a result of intervention, I plan to….

Simple Survey Templates – Likert Style Standard Likert Questionnaire – Can be used as pretest/posttest or posttest only – Data Tabulation Spreadsheet & Directions Retrospective Post-Then-Pre – Administered after intervention – Data Tabulation Spreadsheet & Directions

Combination Knowledge & Likert Style Quiz-style / Program or Topic Based Include quiz-type questions (matching, definitions, true/false, etc.) Can also include Likert Style questions Pre and posttest or posttest only

Resources Handout “Verbs for Writing Measurable Objectives” Packet – Building Capacity in Evaluating Outcomes

Let’s develop some questions for gathering impact Develop 2 to 4 questions that you can ask your 4-H’ers that will measure… Knowledge Change in behavior Change in attitude

Demonstration of knowledge… Because of this class I can… Identify the three steps/crops/…. I learned more about… I know the best way to I know about the risks of…

Change in behavior… Because of this class I… I intend to… (eat more/drink less/ I want to learn more about… I will tell my family about…

Change in attitude… Because of this class I… Am more aware of issues related to… I am more interested in…

QUESTIONS??

To Access Templates, go to… For more information contact: University of Georgia, State 4-H Office Jeff Buckley, Jennifer Cantwell,