Outcomes, Outputs & Context Tammy Horne, Ph.D. WellQuest Consulting Ltd. (780) 451-6145

Slides:



Advertisements
Similar presentations
ACAP DATA January 13, 2009 Anita Fervaha and Suzanne Hindmarch
Advertisements

Implementing NICE guidance
Introduction to Impact Assessment
From Research to Advocacy
Grantee Program Plan. Components of the Program Plan Goals  Objectives  Activities  Techniques & Tools  Outcomes/Change.
Program Evaluation and Measurement Janet Myers. Objectives for today… To define and explain concepts and terms used in program evaluation. To understand.
Developing a Logic Model
Dennis McBride, Ph.D. The Washington Institute (253) Goal Driven Logic Models.
Evaluation is a professional and ethical responsibility and is a core part of PHN professional practice Commitment to evaluation helps build the PHN intelligence.
Evaluation in the Field: Putting Concepts into Action Janet Myers, PhD MPH Richard Vezina, MPH CAPS HIV Prevention Conference April 21, 2006.
IHS Special Diabetes Program Competitive Grants Part 2: Refining Idea Maps Cardiovascular Disease Prevention Planning Cynthia C. Phillips, Ph.D. Lisa Wyatt.
Program Evaluation Spero Manson PhD
Action Writing Action Statements Writing action statements is the first step in the second (action) stage of the public health nutrition (PHN) intervention.
Objectives and Indicators for MCH Programs MCH in Developing Countries January 25, 2011.
Logic Models. A logic model is your program ROAD MAP. Where are you trying to go? How are you trying to get there? What will tell you that you’ve arrived?
How to Write Goals and Objectives
Measuring Learning Outcomes Evaluation
Action Planning Guidance Illinois Public Health Institute.
Developing Earmark Grant Performance Measures: Grant Proposal Section 3 Deanna Khemani.
Objectives and Indicators for MCH Programs
How to Develop a Project Evaluation Plan Pat Gonzalez Office of Special Education Programs
Developing Advocacy Programs for Adults and/or Youth Presentation for APHA CEI Workshop #2019 November 5, 2006 Caroline H. Sparks, Ph.D., Associate Professor.
Edward M. Haugh Jr. ESC Consultant. III. Recommendations for Applying Outcomes Planning to ESC  I. Introduction to Outcomes Planning II. A Sample ESC.
CONCEPT PAPER RESULT BASED PLANNING. RESULT-ORIENTED PLANNING Overall Objective/ Goal Specific Objective/ Purposes Expected Result/ Output Activities.
Evaluation: A Necessity for the Profession, an Essential Support for Practitioners Linking Intervention with Outcome Bryan Hiebert University of Victoria.
Case Management 1 What Will be Covered? 1. Organizational Assessments (Module 1) 2. Designing Quality Services (Module 2) 3. HIV Prevention and Care Advancing.
Results-Based Management
Opioid Misuse Prevention Program “OMPP” Strategic Planning Workshop
Indicators of Success -- Applying the TOC What will change? You must be able to test your theory!
THE NATURE AND PURPOSE OF STRATEGIC PLANNING
Copyright © 2014 by The University of Kansas Using the Evaluation System to Answer Key Questions About Your Initiative.
Making Sense of Data: Qualitative Analysis Basics Tammy Horne, Ph.D. WellQuest Consulting Ltd. (780)
Fundamentals of Evaluation for Public Health Programs ROBERT FOLEY, M.ED. NIHB TRIBAL PUBLIC HEALTH SUMMIT MARCH 31,
Model mod·el noun \mä-d ə l\ 1:Structural design. 2:A usually miniature representation of something; a pattern of something to be made. 3:An example for.
How to Write Successful Grant Proposals Carmichael Centre Facilitator: Caroline Egan, Consultant & External Relations Manager.
Evelyn Gonzalez Program Evaluation. AR Cancer Coalition Summit XIV March 12, 2013 MAKING A DIFFERENCE Evaluating Programmatic Efforts.
Logic Models and Theory of Change Models: Defining and Telling Apart
Introduction to Evaluation Tammy Horne, Ph.D. WellQuest Consulting Ltd. (780)
Julie R. Morales Butler Institute for Families University of Denver.
Improving lives for people with sight loss 1 Visual impairment rehabilitation in the context of personalisation and the core offer Jenny Pearce – CEO,
Nancy L. Weaver, PhD, MPH Department of Community Health School of Public Health Saint Louis University 16 July 2010 LOGIC MODEL FUNDAMENTALS.
Program Evaluation for Nonprofit Professionals Unit 1 Part 2: Evaluation and The Logic Model.
Family Resource and Youth Services Centers: Action Component Plan.
The Major Steps of a Public Health Evaluation 1. Engage Stakeholders 2. Describe the program 3. Focus on the evaluation design 4. Gather credible evidence.
Studying self-help in Germany – challenges and obstacles in self-help oriented research Christopher Kofahl, PhD University Medical Center Hamburg-Eppendorf.
Module II: Developing a Vision and Results Orientation Cheri Hayes Consultant to Nebraska Lifespan Respite Statewide Sustainability Workshop June 23-24,
Evaluating Multilingual Education Programs Seminar on Multilingual Education Kabul, March 2010 Dennis Malone, Ph.D.
Copyright © 2014 by The University of Kansas Using the Evaluation System to Answer Key Questions About Your Initiative.
BLAIR STEVENSON Strategic Planning for Digital Education.
Background, Philosophical Basis and Principles of Behavior.
Sustainability Planning Framework and Process Cheri Hayes Consultant to Nebraska Lifespan Respite Statewide Sustainability Workshop June 23-24, 2015 ©
1 Sequenced Information Strategy –incorporating short-term programme proposal Paris21 Consortium meeting : June 2000 Tony Williams UK Department.
Evaluation: from Objectives to Outcomes Janet Myers, PhD MPH AIDS Education and Training Centers National Evaluation Center
Making it Count! Program Evaluation For Youth-Led Initiatives.
Using Logic Models to Create Effective Programs
Prevention Education Meeting May 29, 2013 Evaluation 101.
Getting to Outcomes: How to do strategic planning with your CRP Theresa Costello National Resource Center for Child Protective Services May 25, 2007.
Defining Clear Goals and ObjectivesDefining Clear Goals and Objectives Barbara A. Howell, M.A. PAD 5850.
Erik Augustson, PhD, National Cancer Institute Susan Zbikowski, PhD, Alere Wellbeing Evaluation.
1 Live like Your Life Depends on it. Advancing the Message Section of Chronic Disease Prevention & Nutrition Services.
The purpose of evaluation is not to prove, but to improve.
Developing Logic Models to Prevent Infant Mortality in Kansas Facilitators: Steve Fawcett, Jeffrey Colvin, Vicki Collie-Akers, Marvia Jones, and Kaston.
Assessment/Evaluation Make evaluation a central part of planning – not an afterthought 1) Determine Needs 2) Determine Desired Outcomes 3) Determine Activities.
STRATEGIC PLANNING January 12-13, Where are we in the planning process? Needs assessment data collection and prioritization - Consequence - Consumption.
Identifying Monitoring Questions from your Program Logic.
Developing a Monitoring & Evaluation Plan MEASURE Evaluation.
Gathering a credible evidence base
Logic Models and Theory of Change Models: Defining and Telling Apart
Introduction to Evaluation
Developing Indicators of Success
Presentation transcript:

Outcomes, Outputs & Context Tammy Horne, Ph.D. WellQuest Consulting Ltd. (780)

Goals and Objectives Goal: Broad, general statement of purpose e.g., Improve the health of children in our community 11/14/20152

Goals and Objectives Objective: Desired outcomes, stated in advance, are often called outcome objectives e.g., Reduce the incidence of low birth weight babies born in our region (Activities designed to influence the outcome objective are sometimes called process objectives) 11/14/20153

Writing Outcome Objectives State only one result per objective (e.g., ‘ increase knowledge and skills ’ is not one outcome objective, but two) Focus on the result (participants learn, improve), not what you do (provide, promote) What you do is the process; what results is the outcome 11/14/20154

Writing Outcome Objectives Include direction – increase, decrease, maintain – and time frame Decide if you need a target and if one is realistic – based on research or experience: “ Increase youth representation on our tobacco reduction coalition ” vs “ Increase youth representation on our tobacco reduction coalition to 50% of the membership ” 11/14/20155

Writing Outcome Objectives When writing outcome objectives, make them SMART: Specific (Can we clearly define what we are looking for?) Measurable (Can we develop specific questions and procedures for data collection -- whether quantitative or qualitative?) 11/14/20156

Writing Outcome Objectives Actionable (Can we do anything to influence it?) Relevant (Is it a “need to know” or a “nice to know”?) Timely (Do we need it now? Can we get data for it now?) The SMART acronym has been used in a number of evaluation resources – e.g., Centre for Health Promotion at University of Toronto (1998) Evaluating Health Promotion Programs. 11/14/20157

Outcomes vs Outputs An outcome is usually a change-oriented result (may sometimes be maintenance – such as mobility or cognitive functioning) An output is a program ‘ product ’ or ‘ deliverable ’ – such as number of participants, workshops/classes/events offered, resources produced, or distributed, meetings attended, etc. 11/14/20158

Outcomes vs Outputs Examples of outputs could be: # of promotional activities (e.g., media) # of referrals given or accepted # of workshops/classes/counselling sessions # of people attending (the above) # of resource materials distributed (manuals, self-help materials) 11/14/20159

Outcomes vs Outputs Sometimes there is a grey area: Attendance is usually an output -- but it could be an outcome if people have barriers to attending – then attendance could represent behaviour change Outputs are sometimes called process indicators (more on indicators later) 11/14/201510

Our Scope of Influence Realistically, how much influence do our programs have? What is feasible within your time frame and resources? It is more realistic to influence specific outcome objectives than a broad goal to which numerous outcomes contribute 11/14/201511

Our Scope of Influence Short and intermediate outcomes are easier to influence directly, compared to longer-term outcomes that are more likely influenced by other factors E.g., skills and confidence people develop for quitting smoking, and short-term quitting, are easier to influence than how long they remain a non-smoker and whether they get a smoking-related illness 11/14/201512

Our Scope of Influence Your influence on outcomes will be dependent on the broader context in which you work? 11/14/201513

Some Example Context Questions How do other programs in your community fit with yours? (e.g., complement your efforts, compete for participants, publicity or funds) What kinds of community support does your program have (or lack)? What kinds of political support does your program have (or lack)? 11/14/201514

Some Example Context Questions What are the broader life circumstances of the people you work with (social, economic, environmental)? 11/14/201515