Using Logic Models to Create Effective Programs

Slides:



Advertisements
Similar presentations
Evaluating Program Success Cherie McCraw Born to Read Institute November 2001.
Advertisements

Proposal Development Guidelines for Signature Grantee Semi-Finalists The Covenant Foundation.
Using Logic Models in Program Planning and Grant Proposals The Covenant Foundation.
Healthy Smile – Healthy You! Providing & Sustaining Oral Health Access for Older Adults Governor’s Conference 2013 Presented by Donna Bileto, MA, CIRS-A.
How to Evaluate Your Health Literacy Project Jill Lucht, MS Project Director, Center for Health Policy
Using Logic Models for Program Planning and Evaluation
1 Theory of Change Chesapeake Bay Funders Network Program Evaluation Training Workshop OMG Center for Collaborative Learning January 9-10, 2008.
Linking Actions for Unmet Needs in Children’s Health
Purpose of Project  To assess the state of oral health within Douglas County  To develop a strategic plan, utilizing the data obtained from the assessment,
Healthy Child Development Suggestions for Submitting a Strong Proposal.
New Employee Orientation
Developing a Logic Model
Dennis McBride, Ph.D. The Washington Institute (253) Goal Driven Logic Models.
New Employee Orientation (Insert name) County Health Department.
The Lumina Center Grantseeking Workshop Series Presents Outcomes & Evaluations April 20, 2006.
Logic Models. A logic model is your program ROAD MAP. Where are you trying to go? How are you trying to get there? What will tell you that you’ve arrived?
2014 AmeriCorps State and National Symposium How to Develop a Program Logic Model.
Key Terms for Monitoring and Evaluation. Objectives Explain the difference between monitoring and evaluation. Introduce the most common M&E terms. Review.
LOGIC MODELS AND OUTCOME MEASUREMENT United Way Community Investment Process Training.
Molly Chamberlin, Ph.D. Indiana Youth Institute
EXCELLENCE AND SUSTAINABILITY BUILDING COMMUNITY CONNECTIONS.
FosterEd: Santa Cruz County Judge Denine Guy, Superior Court of Ca., Santa Cruz County, Juvenile Division Mark Holguin, Family and Children’s Services.
Integrating Service Needs for Homeless Children in a Medical Home Christine Achre, MA, LCPC.
How to Develop the Right Research Questions for Program Evaluation
Logic Models Ron Hale Office of Health Promotion & Community Health Improvement April 7, 2008 Las Vegas, NM.
Creating a service Idea. Creating a service Networking / consultation Identify the need Find funding Create a project plan Business Plan.
OKLAHOMA QUALITY IMPROVEMENT COLLABORATIVE INTERIM TRAINING Marlene Mason MCPP Healthcare Consulting, Inc. October 28, 2010.
Edward M. Haugh Jr. ESC Consultant. III. Recommendations for Applying Outcomes Planning to ESC  I. Introduction to Outcomes Planning II. A Sample ESC.
Organization Mission Organizations That Use Evaluative Thinking Will Develop mission statements specific enough to provide a basis for goals and.
Performance Measures AmeriCorps Project Director Training Saratoga, NY October 7 th – 9 th, 2013.
The Evaluation Plan.
1 United Way of Mat-Su Community Plan Education Children & Youth Achieve Their Potential School Readiness Academic Completion Career & Life Skills Preparedness.
Preparing for the Main Event Using Logic Models as a Tool for Collaboratives Brenda M. Joly Leslie M. Beitsch August 6, 2008.
Fundamentals of Evaluation for Public Health Programs ROBERT FOLEY, M.ED. NIHB TRIBAL PUBLIC HEALTH SUMMIT MARCH 31,
Evaluation Assists with allocating resources what is working how things can work better.
Objectives 1. Children will be supported in an integrated way through the establishment of a Start Right Community Wrap- Around Programme in the target.
Model mod·el noun \mä-d ə l\ 1:Structural design. 2:A usually miniature representation of something; a pattern of something to be made. 3:An example for.
Ingham Healthy Families. History: Why Healthy Families America? Michigan Home Visiting Initiative Exploration & Planning Tool (Fall 2013)  Ingham County.
The Logic Model An Introduction. Slide 2 Innovation Network, Inc. Who We Are National nonprofit organization Committed to evaluation as a tool for empowerment.
Healthy Families America Overview. Healthy Families America Developed in 1992 by Prevent Child Abuse America Evidence-based home visiting model 400 Affiliated.
Juggling the Program Management Ball 1. One day thou art an extension educator… The next day thou art a county director or district extension director…how.
1 CIL-NET, a project of ILRU – Independent Living Research Utilization CIL-NET Presents… 1 Outcome Measures for CILs A National Onsite Training Logic Models.
Julie R. Morales Butler Institute for Families University of Denver.
Prepared by the North Dakota State Data Center July HNDECA and ECCS Evaluation Dr. Richard Rathge Professor and Director North Dakota State Data.
Nancy L. Weaver, PhD, MPH Department of Community Health School of Public Health Saint Louis University 16 July 2010 LOGIC MODEL FUNDAMENTALS.
Program Evaluation for Nonprofit Professionals Unit 1 Part 2: Evaluation and The Logic Model.
Logic Models as Tools for Developing Performance Measures Presented by JoAnn A. Smith, MPH Community Health Administration Grants Monitoring and Program.
Innovation Network, Inc. Program Logic Model Program Planning Communication Evaluation.
Evaluation of the Indiana ECCS Initiative. State Context Previous Early Childhood System Initiatives –Step Ahead –Building Bright Beginnings SPRANS Grant.
Presentation to: Presented by: Date: Developing Shared Goals in Public Health, Coalition Building, and District Partnership Success Chronic Disease University.
1 Nemours Health Planning and Evaluation Collaborative Learning Session I: Designing Effective Health Programs.
Using Logic Models in Program Planning and Grant Proposals The Covenant Foundation.
 2007 Johns Hopkins Bloomberg School of Public Health Section B Logic Models: The Pathway Model.
Outcome-based Planning and Evaluation Gloria Latimer, Ed.S, Director of Community Programs Jason Vahling, M.P.H., Community Program Specialist.
Getting to Outcomes: How to do strategic planning with your CRP Theresa Costello National Resource Center for Child Protective Services May 25, 2007.
Performance Measurement 101. Performance Measurement Performance Measurement is: –The ongoing monitoring and reporting of program accomplishments and.
Setting Goals And Achieving Outcomes Presented by Terry Tolan and John Roden.
Introduction to Monitoring and Evaluation. Learning Objectives By the end of the session, participants will be able to: Define program components Define.
The PDA Center is funded by the US Department of Education Office of Special Education Programs Stories from the Field and from our Consumers Building.
Increased # of AI/AN receiving in- home environmental assessment and trigger reduction education and asthma self-management education Increased # of tribal.
Public Health for Dummies Kristin McCartney, MPH, RD, LD Extension Specialist-Public Health Family Nutrition Program.
Assessment/Evaluation Make evaluation a central part of planning – not an afterthought 1) Determine Needs 2) Determine Desired Outcomes 3) Determine Activities.
OSP REBECCA JOOSTENS, ELIZABETH KLYNSTRA, MARSHA THOMAS.
ADRCs Do What? Using Logic Models to Document and Improve ADRC Outcomes Glenn M. Landers.
Using Logic Models in Program Planning and Grant Proposals
Short term Medium term Long term
SUCCESSFUL MEASURING JAMES HARDIN, DIRECTOR, HEALTH IMPACT
BOOTCAMP SOCIAL INNOVATION ACCELERATOR TO CREATE LASTING CHANGE
Centers of Excellence for Childhood Obesity
Presentation transcript:

Using Logic Models to Create Effective Programs 

The Value of using Logic Models Program planning tool that links outcomes with outputs, inputs, stakeholders, and activities Engages stakeholders Clarifies program theory ~ fills in gaps Fosters ownership of the program Builds common understanding ~ especially about the relationship between goals, actions, and results.

What is a logic model? Program planning tool that links outcomes with outputs, inputs, stakeholders, and activities Activities Stakeholders Inputs Outputs Outcomes

What’s that mean? Activities = actions Stakeholders = people or organizations Inputs = resources Outputs = quantity of products or services Outcomes = specific benefits

If… And… Then…? Inputs Activities Outputs Outcomes Stake-holders IF you have evidence-based activities, access to them, and IF services are provided and used as planned, then The vision of benefits for clients may be achieved. IF you use resources and work with stakeholders, and

What’s that look like? Program planning tool that links outcomes with outputs, inputs, stakeholders, and activities Activities Stakeholders Inputs Outputs Outcomes outreach education screening treatment clients clinics hospitals schools faith-based funds staff volunteers supplies equipment # of people: served taught screened treated knowledge skills attitudes behavior condition status

How do I start? Program Goal = the overall change you want to see Increase positive birth outcomes for pregnant teens Target = the population you want to affect All, or by age group, race/ethnicity, socioeconomic level Objective = time + amount + target + strategy By 2010, at least 90% of pregnant Monterey County teens will enter into prenatal care in the first trimester. Strategy = a systematic plan of action Increase early entry to prenatal care for pregnant teens

Where do I want to end up? Outcomes! Short-term = Teens increase knowledge of prenatal nutrition & health guidelines Mid-term = Teens maintain proper nutrition, health choices, and health guidelines Long-term = Teens deliver healthy babies

Outcomes are a measure of change So what’s different? Outcomes are a measure of change New knowledge Increased skills Changed attitudes or values Modified behaviors or practices Changed conditions

What’s reasonable outcome? Consider timeframe Consider resources and partners Consider other/external factors that may influence outcome achievement Consider your contributions to a larger change Be ambitious but don’t set yourself up.

Types of Outcomes Often easiest if organize along levels of change Client/individual Family/community Systemic Organizational

Indicators Indicators are the specific, measurable characteristics or changes that represent achievement of an outcome. Indicators answer the question: How will I know it?

Indicators Direct Meaningful Useful Practical to collect Sometimes more than one is needed

Indicators measure Outcomes # or % of medical providers adhering to new assessment, education, and prevention protocols # or % increase in clients who have a PCP # and type of providers in network Outcomes Medical providers demonstrate accurate health assessment, education and prevention activities Increased access to primary care physicians Increased provider participation in network

Program Goal: Improve oral health care for low-income children Example Logic Model Program Goal: Improve oral health care for low-income children Resources Activities Outputs Outcomes

Before Logic Modeling, clarify program’s rationale Continuation of existing program Expansion of existing program Existing program with modifications New program

Then clarify Logic Model timeframe… A program cycle A calendar year A grant period The time you believe it will take to show meaningful results

… and Scope Geographic area Service area Client population Logic Model Scope Geographic area Service area Client population

Resources: What inputs are dedicated to the program? Human resources (staff at the clinic) Facilities (clinic) Equipment & supplies Partners (referral agencies, funders) Technology (data management)

Program Goal: Improve oral health care for low-income children Example Logic Model Program Goal: Improve oral health care for low-income children Resources Dental Clinic Coordinator Community Health Director Staff dentist Staff pediatrician Medical providers Money for supplies Activities Training Develop curriculum Two, one-hour trainings to medical providers in oral health assessment Two, one-hour cultural competency trainings for medical providers Outreach Order dental supplies for packets Make up packets Distribute to parents at end of each visit Outputs Training # of two-hour trainings held # of one-on-one trainings held # of medical providers trained Outreach # of parents/children receiving packets Outcomes Medical providers demonstrate accurate oral health assessment, education and prevention activities More children receive high-quality oral health assessment, education and prevention activities during well-child visits Parents/children are more knowledgeable about oral health and caring for children’s teeth Reduced incidence of caries in children at the community health center Often stakeholders

Activities: What is the program doing? Think first about components: Outreach Training Consultation Staff Development Partnership Development

Program Goal: Improve oral health care for low-income children Example Logic Model Program Goal: Improve oral health care for low-income children Resources Dental Clinic Coordinator Community Health Director Staff dentist Staff pediatrician Medical providers Money for supplies Activities Training Develop curriculum Two one-hour didactic trainings to medical providers in oral health assessment One-on-one training to medical providers on oral health Outreach Order dental supplies for packets Make up packets Distribute to parents at end of each visit Outputs Outcomes

Activities: What is the program doing? Outreach: Develop coalitions Communications (press releases, brochures) Create social networks

Activities: What is the program doing? Training: Hire curriculum development team Develop training curriculum Recruit training team Recruit participants Provide training sessions

Outputs: What is the program producing? Usually quantifiable measure of program activities # of training workshops held # of participants attending each workshop # of partnerships formed # of policy briefings conducted # of press packets disseminated

Program Goal: Improve oral health care for low-income children Example Logic Model Program Goal: Improve oral health care for low-income children Resources Dental Clinic Coordinator Community Health Director Staff dentist Staff pediatrician Medical providers Money for supplies Activities Training Develop curriculum Two one-hour didactic trainings to medical providers in oral health assessment One-on-one training to medical providers on oral health Outreach Order dental supplies for packets Make up packets Distribute to parents at end of each visit Outputs Training # of two-hour trainings held # of one-on-one trainings held # of medical providers trained Outreach # of parents/children receiving packets Outcomes

Chain of Outcomes Short term: are the most direct results of activities and outputs, generally achievable in one year. Intermediate: link a program’s short-term outcomes to long-term outcomes. Long term: result from the achievement of short and intermediate term outcomes and often take a longer time to achieve.

Program Goal: Improve oral health care for low-income children Chain of Outcomes Program Goal: Improve oral health care for low-income children Activities Training Develop curriculum Two one-hour didactic trainings to medical providers in oral health assessment One-on-one training to medical providers on oral health Outreach Order dental supplies for packets Make up packets Distribute to parents at end of each visit Outputs Training # of two-hour trainings held # of one-on-one trainings held # of medical providers trained Outreach # of parents/children receiving packets Short-Term Outcomes Medical providers demonstrate accurate oral health assessment, education and prevention activities Parents/children are more knowledgeable about oral health and caring for children’s teeth Inter.-Term Outcomes More children receive high-quality oral health assessment, education and prevention activities during well-child visits Long-Term Outcomes Reduced incidence of caries in children receiving care from the community health center Usually knowledge change Usually an action Usually a condition

Recap: The Value of Using Logic Models Engages stakeholders. Clarifies program theory and fills in the gaps. Builds ownership of the program. Builds common understanding about the program, especially about the relationship between actions and results.