Using Data for Decision Making. Learning Objectives By the end of the session, participants will be able to: 1. Raise awareness of the importance of using.

Slides:



Advertisements
Similar presentations
Technical cooperation with countries Technical Cooperation for essential drugs and traditional medicines September 2005.
Advertisements

Site-Based Decision Making Campus Planning. Restructuring A process through which a district or school alters the pattern of its structures (vision, rules,
DATA DEMAND AND USE: S HARING I NFORMATION AND P ROVIDING F EEDBACK Session 5.
Overview of Mission Statement & Organization. Development Communication Division External Affairs Vice Presidency DevComm Vision To put communication.
Working with the Teachers’ Standards in the context of ITE. Some key issues for ITE Partnerships to explore.
Rwanda Case Study Additional Slides on Stakeholder Involvement.
GENERATING DEMAND FOR DATA Module 1. Session Objectives  Understand the importance of improving data-informed decision making  Understand the role of.
Begin with the End in Mind
RBM Communications Assessment Challenges and Opportunities in Ghana, Mali, Senegal, Tanzania and Uganda.
Module 1: Key concepts in data demand & use
Decision-Making and Strategic Information Workshop on M&E of PHN Programs July 24-August 11, 2006 Addis Ababa.
I NTRODUCTION TO B ASIC D ATA A NALYSIS AND I NTERPRETATION FOR H EALTH P ROGRAMS.
LINKING DATA TO ACTION Session 6. Session Objectives By the end of this session, you will be able to:  Identify priority decisions and programmatic questions.
Dissemination and Use of Results from OVC Program Evaluations Florence Nyangara, PhD MEASURE Evaluation/Futures Group Dissemination Meeting, September.
DETERMINANTS OF DATA USE Session 2. Session Objectives  Explain the data-use conceptual framework  Highlight the determinants of data use  List potential.
Communicating and Applying Research Results Session 3.
Context of Decision Making
UNDERSTANDING DATA AND INFORMATION FLOW Session 4.
Module 5: Sharing data & information. Module 5: Learning objectives  Understand the importance of information feedback in program improvement and management.
BGH M&E Working Group Updates Siân Curtis. Brief History: PRH M&E WG  2004 evaluation of OPRH M&E recommended establishing a CA M&E WG  OPRH M&E WG.
Orientation to Performance and Quality Improvement Plan
PHAB's Approach to Internal and External Evaluation Jessica Kronstadt | Director of Research and Evaluation | November 18, 2014 APHA 2014 Annual Meeting.
Challenge Questions How good is our operational management?
CONTEXT OF DECISION MAKING Module 2. PART 1: DETERMINANTS OF DDU.
Review of key themes. Module 1: Data demand & use key concepts  Data are needed to improve the delivery of services  Providers play a critical role.
Sustaining Local Public Health and Built Environment Programs Fit Nation NYC November 3, 2011 Annaliese Calhoun.
Community Planning Training 1-1. Community Plan Implementation Training 1- Community Planning Training 1-3.
Continuous Quality Improvement (CQI)
Unit 9. Human resource development for TB infection control TB Infection Control Training for Managers at National and Subnational Level.
Increasing district level evidence-based decision making in Côte d’Ivoire Tara Nutley MEASURE Evaluation / Futures Group Mini University, Washington DC.
TEMPUS IV- THIRD CALL FOR PROPOSALS Recommendation on how to make a good proposal TEMPUS INFORMATION DAYS Podgorica, MONTENEGRO 18 th December 2009.
Organization Mission Organizations That Use Evaluative Thinking Will Develop mission statements specific enough to provide a basis for goals and.
Program Collaboration and Service Integration: An NCHHSTP Green paper Kevin Fenton, M.D., Ph.D., F.F.P.H. Director National Center for HIV/AIDS, Viral.
Building Capacity on Program Evaluation in Latin America: The Experience of the Partnership between Mexico’s National Institute of Public Health (INSP)
Technical Approach to and Experiences from Strengthening National Monitoring and Evaluation System for Most Vulnerable Children Program in Tanzania Prisca.
Fundamentals of Evaluation for Public Health Programs ROBERT FOLEY, M.ED. NIHB TRIBAL PUBLIC HEALTH SUMMIT MARCH 31,
Developing Indicators
Strengthening Health Information Systems: Creating an Information Culture Manila, June 14, 2011 Theo Lippeveld, MD, MPH,
MAINSTREAMING MONITORING AND EVALUATION IN EDUCATION Can education be effectively managed without an M & E system in place?
Integrating Knowledge Translation and Exchange into a grant Maureen Dobbins, RN, PhD SON, January 14, 2013.
CONDUCTING A PUBLIC OUTREACH CAMPAIGN IMPLEMENTING LEAPS IN CENTRAL AND EASTERN EUROPE: TRAINERS’ HANDBOOK Conducting a Public Outreach Campaign.
Case management versus M&E in the context of OVC programs: What have we learned? Jenifer Chapman, PhD Futures Group/MEASURE Evaluation.
Bridging the Research-to-Practice Gap Session 1. Session Objectives  Understand the importance of improving data- informed decision making  Understand.
Consultant Advance Research Team. Outline UNDERSTANDING M&E DATA NEEDS PEOPLE, PARTNERSHIP AND PLANNING 1.Organizational structures with HIV M&E functions.
Linking Data with Action Part 1: Seven Steps of Using Information for Decision Making.
A Professional Development Series from the CDC’s Division of Population Health School Health Branch Professional Development 101: The Basics – Part 1.
Introduction to Monitoring and Evaluation. Learning Objectives By the end of the session, participants will be able to: Define program components Define.
WHY IS THIS HAPPENING IN THE PROGRAM? Session 5 Options for Further Investigation & Information Flow.
Introduction to Group Work. Learning Objectives The goal of the group project is to provide workshop participants with an opportunity to further develop.
Information Use Part II Informing Decisions Strengthening Programs through Improved Use of Data and Information.
MEASURE Evaluation Data Quality Assurance Workshop Session 3 Introduction to Routine Data Quality Assessment.
Developing a Monitoring & Evaluation Plan MEASURE Evaluation.
MEASURE EVALUATION Session: 7 Developing Action Plans Based on Results Data Quality Assurance Workshop.
Data Use for Gender-Aware Health Programming Welcome and Introductions.
Data Demand & Use: Information Use Map Webinar Series #2 Tuesday, January 24, 2012 Presenters: Eric Geers and Tara Nutley.
Monitoring & Evaluation Capacity Strengthening Workshop WORKSHOP INTRODUCTION AND OVERVIEW.
Data Quality Assurance Workshop
Data Quality Assurance
Session: 5 Using the RDQA tool for System Assessment
Fundamentals of Monitoring and Evaluation
Monitoring and Evaluation of HIV/AIDS Programs Workshop Overview
Introduction to Comprehensive Evaluation
Overview of the RHIS Rapid Assessment Tool
Session: 4 Using the RDQA tool for Data Verification
Introduction to the PRISM Framework
Siân Curtis, PhD OVC Evaluation Dissemination Meeting,
Use of Information for Decision Making
Measuring Data Quality
Session: 9 On-going Monitoring & Follow Up
RCA Workshop on RCARO Future Strategies July 2007
Presentation transcript:

Using Data for Decision Making

Learning Objectives By the end of the session, participants will be able to: 1. Raise awareness of the importance of using data to inform decisions 2. Discuss and share strategies for overcoming barriers ensuring that health-related data are being used to make decisions at all levels 3. Learn strategies for using data in program management, implementation, and decision-making

What is Decision Making? The process of choosing from among various alternatives using information in light of a given objective

Stake- holders Decisions Data Context of decision-making

Who is a decision-maker? One person responsible for acting at any level –Lower levels: Parent of a sick child –Middle Level: Regional M&E Officer –Top level: Program Manager –Global Level: RBM, Global Fund, WHO staff

Examples of Decisions Policy Making: ITN/IRS/Case management Policy Strategic Planning: ITN/IRS Targeted Program Management: Scheduling of staff for supportive supervision and monitoring Resource allocation: Drugs and Commodities Human resources Infrastructure/Equipment

Who is a Stakeholder? Any person or group with a particular interest in a policy or program

Stakeholders in the Decision-Making Process StakeholderInformation Needs Program Managers and Implementation Partners Efficacy Effectiveness Clientele Quality Coverage Health PartnersEffectiveness Policy Implications Sustainability Cost-efficiency Policy MakersCorrect/improve policy Quality Cost-efficiency Data ProducersAll of the above

Stakeholder Matrix Name of Stakeholder Organization (and specific individual if required) Stakeholder Description Potential Role in Activity and Use of Results Level of Knowledge of Topic Level of Commitment (positive and negative) Constraints to Participate in Activity When to Involve NMCP- Program Manager Oversees Malaria control service delivery Primary audience Access to sites. Service guideline revision High, extensive Strongly supports scale-up of malaria control strategies Busy schedule. Need 4 week lead time Through- out

Different people need information for different kinds of decisions Engage in dialogue with stakeholders to fully understand the decisions they make, information they need, and the best way to present that information

Why address data demand & use?

Uses of Data In what ways can we use data? Inform policies and plans Raise additional resources Strengthen programs and improve results Ensure accountability and reporting Improve quality of services provided Contribute to global lessons learned

Data Use Use refers to the decision-making process We say the decision-maker uses data if he/she Is explicitly aware of the decision to be made Considers at least two possible courses of action, and Considers relevant data in making the decision, even if the data is outweighed by other factors

Data Demand –Demand refers to the value the decision- maker places on the data, whether or not he/she actually uses the data –We say the decision-maker demands data if he/she Understands what data is needed to make the decision, and Proactively seeks out the data he/she needs

Data Demand and Use

The Response Monitoring & Evaluation Systems Better Health Outcomes Data- informed Decisions

What is the role of M&E personnel in decision making? Provide the data needed to make decisions Help decision-makers interpret data Help decision-makers understand what kinds of questions they should ask from the data

“… without information, things are done arbitrarily and one becomes unsure of whether a policy or program will fail or succeed. If we allow our policies to be guided by empirical facts and data, there will be a noticeable change in the impact of what we do.” National-level Policymaker, Nigeria

Class Discussion Consider the last time you used or wanted to use data to make a decision or recommendation about a program –Who were the decision-makers/stakeholders? –What information was used? –What decision was made?

Factors other than evidence-based information influence decisions Power relationships Timing Competing priorities Public opinion Political ideology Funding/Donors Arbitrariness Local culture of decision-making Other information sources

Stakeholders Involve new counterparts Strengthening the Decision-making Process Decisions Understand service delivery realities Data May require additional data

Class Discussion: Barriers to Data Use What barriers have you faced to using or getting others to use data?

Data are often underutilized because of… Lack of a “data culture” among decision makers Low staff motivation Organizational structures Lack of technical skills and technology, particularly at local levels Training often ad hoc and not sustainable Structural constraints– roads, telecommunication Unclear staff roles and poor information flow Poor funding for M&E Political interference

How Can We Increase the Use of Data? Provide timely reports and review on a regular basis Involve program staff in M&E Ensure data quality Demonstrate use of information Ensure consistency of indicators Mandate performance monitoring

How Can We Increase the Use of Data? Increase knowledge and availability of data Share findings & recommendations with broad audiences in appropriate formats Create action plan for the implementation of recommendations

“Making Data Speak”! Example of drug policy change Decision: Changing from chloroquine to ACTs in Ghana Data/information: –Antimalaria Efficacy Data –Malaria In Pregnancy Survey Results –Malaria Morbidity/mortality –Cost-Effectiveness –Benefit Analysis of Drug Options –WHO Guidelines Response: –NCMP analyzed data with user-friendly charts, graphs –Compared results with WHO Guidelines –Determined responses and resources needed –Communicated data to stakeholders (series of fora ) Results: –Stakeholders took informed decision to change from chloroquine to ACTS

Working Toward a Culture of Data  Support for high quality data at all program levels  Sharing data between levels in info system  Empower people to ask questions, seek improvement, learn, and improve data quality through useful data

In order to make data useful, we need to: Discuss what decisions they make and what data they may find helpful Understand of how programs work, how they collect and report data Train and supervise in order to support reporting and documentation Create a common understanding among: Those who deliver services and report on them Those who analyze the data and those who need the data Working Toward a Culture of Data

Key Messages Decisions based on evidence lead to better health outcomes We all have a role in M&E – partners in progress Involve new counterparts beyond M&E specialists High quality information is needed for decision-making at policy, planning and program levels Purpose of M&E is not just to produce more information but to improve action Investments made to improve information systems will be wasted if it is not used to inform policy and program decisions

References MEASURE Evaluation, Addis Ababa University. Decision-Making and Strategic Information. Workshop on M&E of PHN Programs July 24-August 11, 2006 Addis Ababa Available at:

MEASURE Evaluation is a MEASURE program project funded by the U.S. Agency for International Development (USAID) through Cooperative Agreement GHA-A and is implemented by the Carolina Population Center at the University of North Carolina at Chapel Hill, in partnership with Futures Group International, John Snow, Inc., ICF Macro, Management Sciences for Health, and Tulane University. Visit us online at