Nancy Padian UC Berkeley

Slides:

Advertisements

Similar presentations

PAYING FOR PERFORMANCE In PUBLIC HEALTH: Opportunities and Obstacles Glen P. Mays, Ph.D., M.P.H. Department of Health Policy and Administration UAMS College.

Advertisements

February Dakar, Senegal

An Introduction to Monitoring and Evaluation for National TB Programs.

Objectives and Indicators for MCH Programs MCH in Developing Countries January 25, 2011.

1 Designing a Monitoring and Evaluation System for a Rural Travel and Transport Project Michael Bamberger Gender and Development Group The World Bank RTTP.

Objectives and Indicators for MCH Programs

How do cancer rates in your area compare to those in other areas?

Teresa Guthrie M.PH (Health Economics) HIV modelling for in-country ownership solutions – generation of evidence IAS Conference, Washington DC, July.

Introduction to Impact Evaluation: What is it and why do we use it? Male Circumcision Impact Evaluation Meeting Johannesburg, South Africa January 18-23,

Financial Incentives & HIV prevention in Sub-Saharan Africa: Evidence from Three Experimental Interventions Berk Özler & Damien de Walque Development Research.

Overview Burkina--- ART Population: 11 millions Prevalence: 6.6% (surveillance data) Estimate of 650,000 PLWHA 300 peoples with red cross 2000 people to.

Monitoring and Evaluation Module 12 – March 2010.

Global Trends in HIV/AIDS Monitoring and Evaluation Deborah Rugg, PhD Associate Director for Monitoring and Evaluation HHS/US Centers for Disease Control.

M&E Basics Miguel Aragon Lopez, MD, MPH. UNAIDS M&E Senior Adviser 12 th May 2009.

Cost-effectiveness of male circumcision in reducing the spread of HIV in the general population in sub-Saharan Africa Jim Kahn & Elliot Marseille, UCSF.

Monitoring &Evaluation System in Health Program. Brief overview of NACP Reporting units and quality aspects Data sets Learning/ Analysis of the data sets.

28 February, 2011 University of Pretoria

Office of Global Health and HIV (OGHH) Office of Overseas Programming & Training Support (OPATS) Session: Voluntary Medical Male Circumcision (VMMC)

Nancy L. Weaver, PhD, MPH Department of Community Health School of Public Health Saint Louis University 16 July 2010 LOGIC MODEL FUNDAMENTALS.

 HIV and AIDS prevalence in the Middle East and North Africa is around 0.2% ( %) with between 230,000 and 1.4 million people infected.  Among.

Return on investment: How do whole societies benefit from improved services and coverage for key populations? Bradley Mathers Kirby Institute UNSW Australia.

Impact Evaluation in Education Introduction to Monitoring and Evaluation Andrew Jenkins 23/03/14.

Africa Impact Evaluation Program on AIDS (AIM-AIDS) Cape Town, South Africa March 8 – 13, Causal Inference Nandini Krishnan Africa Impact Evaluation.

Sampling for an Effectiveness Study or “How to reject your most hated hypothesis” Mead Over, Center for Global Development and Sergio Bautista, INSP Male.

FBO Engagement in Male Circumcision May 25, 2009 CCIH Annual Conference.

Data Triangulation. Objectives:  At the end of the session, participants will be able to:  Describe the role of data triangulation in program evaluation.

Africa RISING M&E Expert Meeting Addis Ababa, 5-7 September 2012.

Translation of research data into programmes and practice: UN Work Plan on Male Circumcision Translation of research data into programmes and practice:

Africa Impact Evaluation Program on AIDS (AIM-AIDS) Cape Town, South Africa March 8 – 13, Steps in Implementing an Impact Evaluation Nandini Krishnan.

How Can Civil Society Measure Value for Money and Prove Its Worth? Amanda Glassman Center for Global Development July 26, 2012.

07 July 2011 EFFECTIVE EMPLOYEE HEALTH AND WELLNESS PROGRAMME- HCT Service Delivery Model SABCOHA CONFERENCE Sun City –N.West Ms Morero E. Leseka.

The U.S. President’s Emergency Plan for AIDS Relief Title Cost and Impacts of expanding male circumcision services in Eastern and Southern Africa Emmanuel.

Peter Barron World TB Day, 14 March The District Health Barometer 2006/07 27 Indicators – socioeconomic and health Up to 4 years of data Profile.

IDEV 624 – Monitoring and Evaluation Evaluating Program Outcomes Elke de Buhr, PhD Payson Center for International Development Tulane University.

New M&E Requirements Increased Accountability USA versus South Korea.

What IE is not and is not Male Circumcision Impact Evaluation Meeting Johannesburg, South Africa January 18-23, 2010 Nancy Padian UC Berkeley.

What is Impact Evaluation … and How Do We Use It? Deon Filmer Development Research Group, The World Bank Evidence-Based Decision-Making in Education Workshop.

Session 13: Monitoring and Evaluation PubH325 Global Social Marketing Donna Sherard, MPH November 30, 2009.

Impact Evaluation for Evidence-Based Policy Making Arianna Legovini Lead Specialist Africa Impact Evaluation Initiative.

Introduction to Monitoring and Evaluation. Learning Objectives By the end of the session, participants will be able to: Define program components Define.

Developing Program Indicators Measuring Results MEASURE Evaluation.

1 An introduction to Impact Evaluation (IE) for HIV/AIDS Programs March 12, 2009 Cape Town Léandre Bassolé ACTafrica, The World Bank.

Comprehensive Evaluation Concept & Design Analysis Process Evaluation Outcome Assessment.

Moving from a commodity approach: “Fund some of everything” or “Fund what is comfortable” to An Investment approach: “Fund evidenced-based activities.

HPTN 071 (PopART): Have we reached the targets after two years of the PopART intervention IAS Paris July 2017 Richard Hayes.

Monitoring and Evaluation Frameworks

M&E Basics Miguel Aragon Lopez, MD, MPH

Session 13: Monitoring and Evaluation

Central American Certificate Course: HIV Monitoring and Evaluation for HIV/AIDS Policy and Program Management BZ Unit 2 – Post test CR ES GT NI PA January.

Unit 6: Second-Generation HIV/AIDS Surveillance

National and Global Monitoring of HIV Exposed, Uninfected Children

RHIVA and IQ SROI Introduction

QIC-AG Logic Model Template

Planning for Evaluation

Research in Social Work Practice Salem State University

Monitoring and Evaluation Systems for NARS Organisations in Papua New Guinea Day 3. Session 7. Managers’ and stakeholders’ information needs.

بسم الله الرحمن الرحيم.

SOCIAL SCIENCES &TECHNOLOGY

Development Impact Evaluation in Finance and Private Sector

Global Optimization of the Response to HIV

Implementation Challenges

MANAGEMENT, STAFF, NATIONAL COALITION, FINANCIAL RESOURCES,

Monitoring and Evaluation

Key Affected Populations

Impact Evaluation Designs for Male Circumcision

Sampling for Impact Evaluation -theory and application-

Progress on Voluntary Medical Male Circumcision for HIV prevention and How VMMC fits into UNAIDS ' ' target Julia Samuelson, Nurse epidemiologist.

Steps in Implementing an Impact Evaluation

Data for PRS Monitoring: Institutional and Technical Challenges

M & E Plans and Frameworks

Presentation transcript:

Nancy Padian UC Berkeley What IE is not and is not Male Circumcision Impact Evaluation Meeting Johannesburg, South Africa January 18-23, 2010 Nancy Padian UC Berkeley

Traditional randomized “eficacy” controlled trials (RCTs) Targets individuals or communities evaluator directly controls implementation Intensive in terms of cost, training Implementation is perfect Does not consider adherence, migration or other factors that might have diluted the effect Efficacy/ highest internal validity (not real world) 10/17/2019

How is IE different from M&E? M&E: Evaluating how a program is implemented Is the program being implemented as designed? Could the operations be more efficient? Are the benefits getting to those intended? Costing and accounting Monitoring trends Are indicators moving in the right direction? No ability for intervention attribution IE: Estimating the effect of the program

Question types and methods M&E: monitoring & process evaluation Is program being implemented efficiently? Is program targeting the right population? Are outcomes moving in the right direction? Descriptive analysis Impact Evaluation: What was the effect of the program on outcomes? How would outcomes change under alternative program designs? Is the program cost-effective? Causal analysis

Monitoring and Evaluation Results Pyramid INPUTS OUTPUTS OUTCOMES IMPACT ALL MOST SOME FEW NUMBER OF PROJECTS LEVELS OF EVALUATION EFFORTS Source: UNAIDS, The World Bank. Monitoring and Evaluation Operations Manual. 2002

Monitoring and Evaluation Results Pyramid INPUTS OUTPUTS OUTCOMES IMPACT ALL MOST SOME FEW NUMBER OF PROJECTS Resources (fixed or mobile) Staff Funds Supplies Training No. of procedures Condom availability Trained staff Service quality Short-term and intermediate effects: Behavior change STIs Long-term effects: HIV/AIDS Mortality Economic impact POTENTIAL FOR RESULTS ATTRIBUTION Source: UNAIDS, The World Bank. Monitoring and Evaluation Operations Manual. 2002

When to use M&E and when IE? Is MC being delivered as planned? Does outreach to women increase uptake? What are the trends in HIV prevalence? Does MC affect prevention behavior? What is a precise estimate of MC effectiveness? M&E IE M&E IE IE