Utilizing the LOGIC MODEL for Program Design and Evaluation

Slides:



Advertisements
Similar presentations
Case #7 Evaluating the Impact of a k-12 Laptop Program
Advertisements

Program Design Roger A. Rennekamp, Ph.D. Extension Professor and Specialist in Program and Staff Development Department of Community and Leadership Development.
How to Evaluate Your Health Literacy Project Jill Lucht, MS Project Director, Center for Health Policy
No Child Left Behind The Basics Of Title 1 Every Child - Now! Focus on the critical nature of doing what’s right and what’s needed – today - to help every.
PRESENTED BY: MARY SAGAR CHERYL BECKER BECCA BRITT Read to Succeed! Tutoring Program Chandler Public Library November 14, 2013 AzLA Conference.
Dennis McBride, Ph.D. The Washington Institute (253) Goal Driven Logic Models.
Logic modeling. “Would you tell me, please, which way I ought to go from here?” “That depends a good deal on where you want to get to.” said the Cat.
Reality Check For Extension Programs Deborah J. Young Associate Director University of Arizona Cooperative Extension.
+ Monitoring, Learning & Evaluation Questions or problems during the webinar?
Impact: Improved life chances for marginalised girls in Malawi AoC trained in learner-centred participatory teaching methods, SRH needs of girls, literacy,
Moyock Middle School School Improvement Plan Results and Next Steps.
FOR YOUTH DEVELOPMENT FOR HEALTHY LIVING FOR SOCIAL RESPONSIBILITY PUTTING SUCCESS INTO WORDS Y Readers Charlotte, NC | Y READERS | ©2012 YMCA OF GREATER.
Community Planning Training 1-1. Community Plan Implementation Training 1- Community Planning Training 1-3.
Program Evaluation Debra Spielmaker, PhD Utah State University School of Applied Sciences, Technology & Education - Graduate Program Advisor USDA-NIFA,
How to Develop the Right Research Questions for Program Evaluation
How to Focus and Measure Outcomes Katherine Webb-Martinez Central Coast and South Region All Staff Conference April 23, 2008.
Activities Outcomes – Impact Short Term Medium Term Long Term Problem statement: New York City teen pregnancy rates are higher than the national average,
Reflection  Do a self assessment (Report about: Duration, Risk assessment, Participation, Outcomes) Follow up  Motivate students to undertake action.
Logic Models Handout 1.
Program Evaluation and Logic Models
Model mod·el noun \mä-d ə l\ 1:Structural design. 2:A usually miniature representation of something; a pattern of something to be made. 3:An example for.
Comp 20 - Training & Instructional Design Unit 6 - Assessment This material was developed by Columbia University, funded by the Department of Health and.
Logic Models and Theory of Change Models: Defining and Telling Apart
Juggling the Program Management Ball 1. One day thou art an extension educator… The next day thou art a county director or district extension director…how.
LCES Advisory Leadership System… The role of advisory leadership councils in Extension’s programming process.
Julie R. Morales Butler Institute for Families University of Denver.
Prepared by the North Dakota State Data Center July HNDECA and ECCS Evaluation Dr. Richard Rathge Professor and Director North Dakota State Data.
Model Name Transition Project Learning Network Workshop 3 IYF Transition Project.
Family Resource and Youth Services Centers: Action Component Plan.
Community Planning Training 5- Community Planning Training 5-1.
Reducing Summer Learning Loss: Promising Approaches for Summer Learning Programs Philanthropy New York February 4, 2010.
Lincoln Community Learning Centers A system of partnerships that work together to support children, youth, families and neighborhoods. CLC.
1 What will the work look like per quarter to help reach the goal? School wide goal: In order to increase student achievement Brown School will use a balanced.
Basic Program Logic RESOURCES/INPUTS The ingredients you need to implement your program! YOUR PROGRAM What you do to achieve your departmental goals! RESULTS/IMPACT.
My Presentation Cherry welch ECE 497 Child Development Capstone
Getting to Outcomes: How to do strategic planning with your CRP Theresa Costello National Resource Center for Child Protective Services May 25, 2007.
Logic modeling. “Would you tell me, please, which way I ought to go from here?” “That depends a good deal on where you want to get to.” said the Cat.
Trident Public Health District Heather A. Zwiker Health Educator.
Logic Models Performance Framework for Evaluating Programs in Extension.
A Hierarchy for Targeting Outcomes and Evaluating Their Achievement S. Kay Rockwell Professor and Evaluation Specialist Agricultural.
Program Design Global Health Fellowship St Luke’s/Roosevelt New York.
Allison Nichols, Ed.D. Extension Specialist in Evaluation.
Logic Models How to Integrate Data Collection into your Everyday Work.
Designing Effective Evaluation Strategies for Outreach Programs
Outcomes, Goals, and Objectives
Learning Outcomes Awareness Created Knowledge Gained Attitudes Changed
Youth investment center
Grant Champions Workshop Logic Model Development
Using Logic Models in Program Planning and Grant Proposals
Annual Title I Meeting: Hahntown and Stewartsville Elementary Schools
Short term Medium term Long term
Linden Elementary Title I Parent Night
Outcomes and Evidence Based Programming
Logic Models and Theory of Change Models: Defining and Telling Apart
Logic modeling.
SUCCESSFUL MEASURING JAMES HARDIN, DIRECTOR, HEALTH IMPACT
HPS Process and Outcomes
Roswell North Elementary School
Logic modeling.
Thank you for Coming to Open House.
Resources Activity Measures Outcomes
Annual Title I Meeting and Benefits of Parent and Family Engagement
Logic modeling.
Using Logic Models in Project Proposals
La Mesa-Spring Valley Schools
BOOTCAMP SOCIAL INNOVATION ACCELERATOR TO CREATE LASTING CHANGE
Roswell North Elementary School
Logic modeling.
2019 Title I Annual Parent Meeting
Presentation transcript:

Utilizing the LOGIC MODEL for Program Design and Evaluation Susan J. Barkman Purdue University

LOGIC MODEL - a graphic representation that shows the relationships between what we put in (inputs), what we do (outputs), and what results (outcomes)

Logical Linkages: Series of If-Then Relationships IF THEN IF THEN IF THEN IF THEN INPUTS OUTPUTS OUTCOMES Program invests time & money Resource inventory can be developed Families will know what is available will access services will have needs met

L O G I C M O D E L INPUTS OUTPUTS OUTCOMES - IMPACT PROGRAM DESIGN AND PLANNING INPUTS OUTPUTS OUTCOMES - IMPACT Activities Participation LEARNING ACTION IMPACT What do we need to achieve our goals? What do we have to do to ensure our goals are met? Who needs to - participate - be involved? - be reached? What do we think the participants will know, feel or be able to do after the program? How do we think participants will behave or act differently after the program? What kind of impact can result if the participants behave or act differently? Workshops Meetings Camps Curriculum Publications Media Web site Projects Field Days Staff Volunteer Time Money Materials Equipment Technology Partners Number Characteristics Reactions Awareness Knowledge Attitudes Skills Aspirations Behavior Practice Decisions Policies Social Action Social Economic Civic Environmental MEASURING PROGRAM IMPACT

SITUATION - Needs Assessment The originating condition Understanding the situation what is the underlying problem, causes, effects, who is involved?

TARGETED OUTCOMES The “change in participants” you would expect to see as a result of participating in the program. OK, you decided on a program to evaluate. But, before you begin to design your evaluation instrument or select an existing instrument, you need to make sure you know what the targeted outcome(s) are for your program. An outcome is defined as the”change in the participants” you would expect to see as a result of participating in the program. In other words – what are the participants going to: know, feel or do differently after the program Remember, identifying your outcomes should be part of the program planning process. If you CAN NOT clearly identify your targeted outcomes, how is your program going to achieve them and how are you going to measure them . Not having clearly defined targeted outcomes is the biggest people make. So what do these outcomes look like and how to we measure them. what are the participants going to: know, feel or do different after the program

OUTCOMES LEARNING ACTION IMPACT Awareness Created Knowledge Gained What do we think the participants will know, feel or be able to do after the program? How do we think participants will behave or act differently after the program? What kind of impact can result if the participants behave or act differently? Awareness Created Knowledge Gained Attitudes Changed Skills Developed Aspirations Sparked Behavior Changed Practice Adopted Decisions Made Policies Changed or Adopted Social Action Initiated Social Impact Economic Impact Civic Impact Environmental Impact Susan Barkman- Purdue University

OUTPUTS Activities - What do we have to do to insure our goals are met? workshops meetings test plots & field days publications web site projects Susan Barkman- Purdue University

OUTPUTS Participation - Who needs to participate, be involved, be reached? number characteristics reactions Susan Barkman- Purdue University

INPUTS - What do we need to achieve our goals? staff volunteers time money materials equipment technology partners Susan Barkman- Purdue University

SO WHAT ! So how does this work in real work with children, youth and families?

1. Determine what OUTCOMES you want your program to achieve. LEARNING OUTCOMES Improve the science and math literacy of participants. Develop a more positive attitude towards science, math and school in general in 80% of participants.

1. Determine what OUTCOMES. you want your program to. achieve 1. Determine what OUTCOMES you want your program to achieve. (continued) ACTION OUTCOMES Improve classroom behavior of Summer Intensive participants. Improve the behavior of the parents towards their children.

2. Determine your OUTPUTS – who needs to participate and what are the components (activities) of the program.

PARTICIPATION First – 3rd grade students who have failed the ISTEP test or recommended by teacher Parent Helpers who will work 5 days/week (10 – 4pm) – need to be parents of participants Parents of participants will attend parenting classes

ACTIVITIES Summer Intensive Program 5 days (11-4pm) 100 contact hours Follow-up Group Meetings once a month through the rest of year (2-4 hours) 38 contact hours School Enrichment once a week, 45 minutes during school year 28.5 contact hours

ACTIVITIES Parent Helpers hire and train parents of SI classroom helpers Parenting Classes once a week for 6 weeks

3. Determine what INPUTS – are needed to make the program run.

INPUTS Volunteers at least 3 volunteers per day in SI Parent Helpers 1 parent hired for every 5 youth in program (1:5 )

INPUTS Project Director 1 FTE in summer months and .75 FTE in other months School Corporation helps recruit students, provides bus transportation and classroom space CES coordinates program and supervises Project Director

NOW WHAT ! HOW DO I KNOW MY PROGRAM ACHIEVED IT’S OUTCOMES?

OUTCOME INDICATOR The observable, measurable characteristics or changes that represent achievement of an outcome. Susan Barkman- Purdue University

Improve science and math literacy Outcomes Indicator - Improvement in science and math grades in Fall prior to SI program and in Fall after program Data Source - Report cards Outcome Indicator- participant is able to perform science process skills as observed by teacher Data Source – Science Observation Checklist

Develop a more positive attitude towards science, math and school in general Outcomes Indicator - Improvement in attitudinal score on pre/post assessment tool Data Source - Attitudinal Instrument Outcome Indicator- participant have a decrease in absenteeism from school year before and after program Data Source – School Attendance Records

WORKSHEETS & CHECKLISTS Logic Model Worksheet # 1 Checklist for Your Program Logic Model and Outcomes Outcome Indicator Worksheet # 2 Checklist for Outcome Indicators