Objectives and Indicators for MCH Programs MCH in Developing Countries January 25, 2011.

Slides:



Advertisements
Similar presentations
1 Mateja Bizilj PEMPAL BCOP KEY CONCEPTS AND APPROACHES TO PROGRAMS AND PERFORMANCE Tbilisi, June 28, 2007.
Advertisements

Using Logic Models in Program Planning and Grant Proposals The Covenant Foundation.
Donald T. Simeon Caribbean Health Research Council
Program Evaluation. Lecture Overview  Program evaluation and program development  Logic of program evaluation (Program theory)  Four-Step Model  Comprehensive.
Program Evaluation and Measurement Janet Myers. Objectives for today… To define and explain concepts and terms used in program evaluation. To understand.
Screen 1 of 24 Reporting Food Security Information Understanding the User’s Information Needs At the end of this lesson you will be able to: define the.
Developing a Logic Model
Action Writing Action Statements Writing action statements is the first step in the second (action) stage of the public health nutrition (PHN) intervention.
Logic Models. A logic model is your program ROAD MAP. Where are you trying to go? How are you trying to get there? What will tell you that you’ve arrived?
IHS Special Diabetes Program Competitive Grants Part 2: Refining Idea Maps Diabetes Prevention Planning Cynthia C. Phillips, Ph.D. Lisa Wyatt Knowlton,
+ Monitoring, Learning & Evaluation Questions or problems during the webinar?
Developing Earmark Grant Performance Measures: Grant Proposal Section 3 Deanna Khemani.
Objectives and Indicators for MCH Programs
How to Develop a Project Evaluation Plan Pat Gonzalez Office of Special Education Programs
What is advocacy?. Session objectives Distinguish advocacy from other activities Work with participants to recognise opportunities for advocacy in our.
How to Focus and Measure Outcomes Katherine Webb-Martinez Central Coast and South Region All Staff Conference April 23, 2008.
Creating a service Idea. Creating a service Networking / consultation Identify the need Find funding Create a project plan Business Plan.
CONCEPT PAPER RESULT BASED PLANNING. RESULT-ORIENTED PLANNING Overall Objective/ Goal Specific Objective/ Purposes Expected Result/ Output Activities.
Results-Based Management
Performance Measures AmeriCorps Project Director Training Saratoga, NY October 7 th – 9 th, 2013.
Business and Management Research WELCOME. Lecture 2 Business and management research?
Indicators Dr Murali Krishna Public Health Foundation of India.
Monitoring and Evaluation in MCH Programs and Projects MCH in Developing Countries Feb 10, 2011.
1 What are Monitoring and Evaluation? How do we think about M&E in the context of the LAM Project?
Fundamentals of Evaluation for Public Health Programs ROBERT FOLEY, M.ED. NIHB TRIBAL PUBLIC HEALTH SUMMIT MARCH 31,
Classroom Assessments Checklists, Rating Scales, and Rubrics
Evelyn Gonzalez Program Evaluation. AR Cancer Coalition Summit XIV March 12, 2013 MAKING A DIFFERENCE Evaluating Programmatic Efforts.
Logic Models and Theory of Change Models: Defining and Telling Apart
Julie R. Morales Butler Institute for Families University of Denver.
Prepared by the North Dakota State Data Center July HNDECA and ECCS Evaluation Dr. Richard Rathge Professor and Director North Dakota State Data.
M&E Basics Miguel Aragon Lopez, MD, MPH. UNAIDS M&E Senior Adviser 12 th May 2009.
Using Data for Decisions Points to Ponder. Different Types of Assessments Measure of Academic Progress (MAP) Guided Reading (Leveled Reading) Statewide.
W HAT IS M&E  Day-to-day follow up of activities during implementation to measure progress and identify deviations  Monitoring is the routine and systematic.
Outcomes, Outputs & Context Tammy Horne, Ph.D. WellQuest Consulting Ltd. (780)
Mapping the logic behind your programming Primary Prevention Institute
Using Logic Models in Program Planning and Grant Proposals The Covenant Foundation.
Monitoring and Evaluation in MCH Programs and Projects MCH in Developing Countries Feb 24, 2009.
This work is part of the Joint Action on Improving Quality in HIV Prevention (Quality Action), which has received funding from the European Union within.
Community Planning 101 Disability Preparedness Summit Nebraska Volunteer Service Commission Laurie Barger Sutter November 5, 2007.
Building a database for children with disabilities using administrative data and surveys Adele D. Furrie September 27, 2011.
1 A QTS Web Training Writing Consumer Education & Referral Outcomes.
Application of Human Rights Principles in Results Based Management Muhammad Usman Akram, Evaluation Advisor Adapted from RBM training held for UNDP BRC.
1 The project is financed from the European Union funds within the framework of Erasmus+, Key Action 2: Cooperation for innovation and the exchange of.
Proposal Development Guidelines for Signature Grantee Semi-Finalists The Covenant Foundation.
Monitoring and Evaluation in MCH Programs and Projects MCH in Developing Countries Feb 9, 2012.
Monitoring Afghanistan, 2015 Food Security and Agriculture Working Group – 9 December 2015.
School Development Goal Development “Building a Learning Community”
IDEV 624 – Monitoring and Evaluation Evaluating Program Outcomes Elke de Buhr, PhD Payson Center for International Development Tulane University.
Report on the NCSEAM Part C Family Survey Batya Elbaum, Ph.D. National Center for Special Education Accountability Monitoring February 2005.
Capacity Building For Program Evaluation In A Local Tobacco Control Program Eileen Eisen-Cohen, Maricopa County Tobacco Use Prevention Program Tips for.
Session 2: Developing a Comprehensive M&E Work Plan.
Session 7: Planning for Evaluation. Session Overview Key definitions:  monitoring  evaluation Process monitoring and process evaluation Outcome monitoring.
Using Data to Assess Quality Improvement Results February 23, 2009 Presentation at the CLP/ADRC 2010 Annual Meeting Debra J. Lipson.
So You Think You’ve Made a Change? Developing Indicators and Selecting Measurement Tools Chad Higgins, Ph.D. Allison Nichols, Ed.D.
Assessment/Evaluation Make evaluation a central part of planning – not an afterthought 1) Determine Needs 2) Determine Desired Outcomes 3) Determine Activities.
Evaluation What is evaluation?
Developing a Monitoring & Evaluation Plan MEASURE Evaluation.
Applied Methodologies in PHI Session 5: Evaluation Kath Roberts (NOO/EMPHO)
Performance Indicators
M&E Basics Miguel Aragon Lopez, MD, MPH
Session 1 – Study Objectives
Monitoring and Evaluation Systems for NARS Organisations in Papua New Guinea Day 2. Session 6. Developing indicators.
Strategic Planning for Learning Organizations
Monitoring and Evaluation Systems for NARS Organisations in Papua New Guinea Day 3. Session 7. Managers’ and stakeholders’ information needs.
Business Environment
Business Environment
Strategic Prevention Framework - Evaluation
Logic Models and Theory of Change Models: Defining and Telling Apart
M & E Plans and Frameworks
Presentation transcript:

Objectives and Indicators for MCH Programs MCH in Developing Countries January 25, 2011

Objectives and Indicators Session goals – Promote an understanding of the importance of good objectives and indicators, and their contribution to effective program management –Provide or refine skills needed to develop MCH program objectives

Objectives and Indicators Session objectives -- by the end of the session, participants should be able to: – explain the terms “goal,’ “objective,” “indicator” and “target” –describe the characteristics of objectives and indicators that are useful for program management – write a “smart” objective for the country project and state its corresponding indicator

Why discuss MCH program objectives? – How will you know if you are successful if you don’t identify what you want to do? –There are always limited resources –Clear objectives are often a donor requirement – Developing appropriate and useful objectives is not always simple or intuitive... (Note -- they are NOT a substitute for “doing the right thing” based on a needs assessment)

Logic model flow chart - how program efforts contribute to the program’s goals Causality InputsActivities Processes Outputs Objectives OutcomesImpact

InputsActivities Processes Outputs Objectives OutcomesResults Activities are any action, funded or unfunded, undertaken to achieve a program result Assignments, tasks, stuff we do to achieve our objectives!

InputsActivities Processes Outputs Objectives OutcomesImpact Objectives can include anything that is clearly intended to be achieved through the program or project Output level objectives are those resulting from first order activities Impact level objectives refer to the desired long-term or ultimate result Intermediate objectives that fall somewhere between these two are usually referred to as outcomes - also known as “effects”

InputsActivities Processes Outputs Objectives OutcomesResults Output level objectives are those that result from activities -- things your program does –In most instances don’t represent population change –Important area for program/project monitoring Frequently “bean counting” –Useful for program management purposes –And -- donors may hold you accountable for the beans

InputsActivities Processes Outputs Objectives OutcomesImpact Impact and outcomes are… –Changes in the condition or behavior of a program participant or changes in conditions that affect a participant: results Whether an objective is a impact or outcome depends on its level in the causality chain –Impact describes the long-term results –Outcomes describe the immediate effects on participants The ability of a program to produce results (i.e., outcomes, impact, or both) depends on your resources, program duration, and many, many social, economic and cultural conditions that affect participants in the program

InputsActivities Processes Outputs Objectives OutcomesImpact Objectives should be the highest order objectives for which you can be held accountable They should be S M A R T : –S - simple –M - measurable (in the program setting) –A - appropriate (technically correct, important) –R - realistic –T - time-limited

InputsActivities Processes Outputs Objectives OutcomesImpact Let’s consider this objective... The project will improve the understanding of mothers about the importance of oral rehydration therapy and how to correctly mix ORS.

Let’s try again …. InputsActivities Processes Outputs Objectives Outcomes Impact By the end of the project, 80% of mothers of children under age 5 in the project area will give their child increased fluids when the child has diarrhea

InputsActivities Processes Outputs Objectives OutcomesImpact Let’s consider another objective... The project will increase immunization coverage to 80%

Let’s try again …. InputsActivities Processes Outputs Objectives Outcomes Impact By the end of the project, 80% of children aged months in the project area will have completed their basic immunizations

InputsActivities Processes Outputs Objectives OutcomesImpact Additional terms: Indicators… “How will we measure what we have achieved?” –Answer the question, “How will we measure what we have achieved?” Target a specific level of achievement

By the end of the project, 80% of children aged months in the project area will have completed their basic immunizations What is the indicator and target for this objective?

The % of children aged months in the project area who have completed their basic immunizations Indicator: Target : 80%

SelectingIndicators Who to involve in setting objectives and indicators? –Project staff –Others familiar with relevant data –The community, partners –Published literature, project reports When? –Iterative - As work on program development proceeds –Check feasibility before finalizing It’s usually OK to revise objectives if rationale is provided

19 Practicality Are the data associated with the indicator practical? –How will you collect the data? –Are quality data currently available? –Can routine data can be procured on a regular and timely basis? –Will you need to conduct a survey or special studies?

All of these contribute to the program goals -- broad, long-term intended results InputsActivities Processes Outputs Objectives OutcomesImpact Indicators

Final thoughts on the selection of objectives and indicators Indicator quality presumes data quality: be aware of the limitations (regarding validity, reliability, and timeliness) of your data More indicators aren’t necessarily better; you need enough information to get an honest reckoning Meaningful qualitative indicators are often okay and sometimes preferable Use objectives for management —it’s the main reason we measure performance Take a practical approach—get adequate information that is available at a reasonable cost to the program Indicators should make sense to a development professional, but be understandable to interested persons

Your task: Move into your country groups Choose an intervention that you might address Write a measurable, SMART outcome objective for that intervention