Terri Wyrosdick Larry Lipscomb Kermelle Hensley.  Program evaluation is research designed to assess the implementation and effects of a program.  Its.

Slides:



Advertisements
Similar presentations
Role of CSOs in monitoring Policies and Progress on MDGs.
Advertisements

Site-Based Decision Making Campus Planning. Restructuring A process through which a district or school alters the pattern of its structures (vision, rules,
Action Research Not traditional educational research often research tests theory not practical Teacher research in classrooms and/or schools/districts.
Chapter 6 The Individual.
Measuring Value: Using Program Evaluation to Understand What’s Working -- Or Isn’t Juliana M. Blome, Ph.D. , MPH Office of Program Analysis and Evaluation.
Curriculum Making The What, Who, and Why
Title I Schoolwide Providing the Tools for Change Presented by Education Service Center Region XI February 2008.
Introduction to Theories of Public Policy
Quantitative vs. Qualitative Research Method Issues Marian Ford Erin Gonzales November 2, 2010.
V MEASURING IMPACT Kristy Muir Stephen Bennett ENACTUS November 2013.
A brief overview What is program evaluation? How is an evaluation conducted? When should it be used? When can it be used? Used with Permission of: John.
EVAL 6000: Foundations of Evaluation Dr. Chris L. S. Coryn Kristin A. Hobson Fall 2011.
Action Research Not traditional educational research often research tests theory not practical Teacher research in classrooms and/or schools/districts.
Sustaining Community Based Programs CYFAR Conference Boston, 2005.
Decision-Making and Strategic Information Workshop on M&E of PHN Programs July 24-August 11, 2006 Addis Ababa.
Tailoring Evaluations
Intelligence Unit 6 - Mandates for Action Policy exerts a powerful influence on public health nutrition (PHN) practice because it affects:  service delivery.
PPA 503 – The Public Policy- Making Process Lecture 3b – Components of a Policy Paper.
PPA 502 – Program Evaluation
PPA 503 – The Public Policy-Making Process
A Healthy Place to Live, Learn, Work and Play:
INSTRUCTIONAL LEADERSHIP FOR DIVERSE LEARNERS Susan Brody Hasazi Katharine S. Furney National Institute of Leadership, Disability, and Students Placed.
PAD190 PRINCIPLES OF PUBLIC ADMINISTRATION
Measuring Learning Outcomes Evaluation
University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Unit 3: Engaging stakeholders.
Health Systems and the Cycle of Health System Reform
Practicing the Art of Leadership: A Problem Based Approach to Implementing the ISLLC Standards, 4e © 2013, 2009, 2005, 2001 Pearson Education, Inc. All.
Designing Influential Evaluations Session 2 Topics & Timing Uganda Evaluation Week - Pre-Conference Workshop 19 th and 20 th May 2014.
Kermelle Hensley Larry Lipscomb Terri Wyrosdick.  Program evaluation is research designed to assess the implementation and effects of a program.  Its.
Assistive Technology Clinical Outcomes Research Management System (AT-CORMS) Tool Utilizing the International Classification of Functioning (ICF) Cognitive.
Economics as Social Science Economic Methodology Lecture 2 Dominika Milczarek-Andrzejewska.
Too expensive Too complicated Too time consuming.
Designing a Random Assignment Social Experiment In the U.K.; The Employment Retention and Advancement Demonstration (ERA)
INTEGRATED ASSESSMENT AND PLANNING FOR SUSTAINABLE DEVELOPMENT 1 Click to edit Master title style 1 Analysis of the planning process Why and how? Session.
LEVEL 3 I can identify differences and similarities or changes in different scientific ideas. I can suggest solutions to problems and build models to.
Teaching to the Standard in Science Education By: Jennifer Grzelak & Bonnie Middleton.
Evidence-based Education and the Culture of Special Education Chair: Jack States, Wing Institute Discussant: Teri Palmer, University of Oregon.
What is Research ? Research Methodology CHP400:
Systematic Review: Interpreting Results and Identifying Gaps October 17, 2012.
“Participation is a Goal, not just a Means, in NFPs.” Margaret A. Shannon, Ph.D. COST Action E-19 Vienna, September 15, 2003.
Program Evaluation Overview. Definitions of Program Evaluation systematic collection of information abut the activities, characteristics, and outcome.
1 Monitoring indicators of children ’ s victimization in school Mona Khoury-Kassabri and Rami Benbenishty Paul Baerwald School of Social Work and Social.
An Expanded Model of Evidence-based Practice in Special Education Randy Keyworth Jack States Ronnie Detrich Wing Institute.
Stakeholders
CRITICAL THINKING AND THE NURSING PROCESS Entry Into Professional Nursing NRS 101.
Welcome to Program Evaluation Overview of Evaluation Concepts Copyright 2006, The Johns Hopkins University and Jane Bertrand. All rights reserved. This.
Technology Needs Assessments under GEF Enabling Activities “Top Ups” UNFCCC/UNDP Expert Meeting on Methodologies for Technology Needs Assessments
Chapter 2: The Role of Economics
DEVELOPING THE WORK PLAN
Erik Augustson, PhD, National Cancer Institute Susan Zbikowski, PhD, Alere Wellbeing Evaluation.
The purpose of evaluation is not to prove, but to improve.
1 Governance strategy for the Washington City Group Comments on draft proposal by Howard Meltzer (UK) February Brussels.
Training on Safe Hospitals in Disasters Module 3: Action Planning for “Safe Hospitals”
Learning outcomes SW BA Prof dr Nevenka Zegarac Department of Social work and social policy Faculty of political sciences UBG TEMPUS SHEPSSSS Workshop.
CONVENTION & DESTINATION MARKETING Prepared by Yooshik Yoon, Kyunghee University
Building Strong Library Associations | Library Associations in Society: An Overview DAY 1 Session 3 What is the context of Library Associations in your.
Chapter 1 Toward Accountability. The Faces of Accountability Professional Accountability.Service Delivery Accountability.Coverage Accountability.Cultural.
INTEGRATED ASSESSMENT AND PLANNING FOR SUSTAINABLE DEVELOPMENT 1 Click to edit Master title style 1 Integration into the decision making process Session.
Ethics and Moral reasoning
Responding to Complexity in Impact Evaluation
Evaluation: For Whom and for What?
Introduction to Theories of Public Policy
Introduction to Program Evaluation
Rational Perspectives on Decision Making Keys to Decision Making
The Value of Twisting the Lion’s Tail: How the Design of Policy Experiments Impact Learning Outcomes for Adaptation Governance. Belinda McFadgen, PhD researcher,
D-Lab Fall 2004.
WHAT is evaluation and WHY is it important?
Steps for Ethical Analysis
DCEC & Getting to Impact
DCEC & Getting to Impact
Presentation transcript:

Terri Wyrosdick Larry Lipscomb Kermelle Hensley

 Program evaluation is research designed to assess the implementation and effects of a program.  Its purposes vary and can include  (1) program improvement,  (2) judging the value of a program,  (3) assessing the utility of particular components of a program, and  (4) meeting accountability requirements

 Results of program evaluations are often used for decisions about whether to continue a program, improve it, institute similar programs elsewhere, allocate resources among competing programs, or accept or reject a program approach or theory.  Through these uses program evaluation is viewed as a way of rationalizing policy decision-making.

 Program evaluation is conducted for a wide range of programs, from broad social programs such as welfare, to large multisite programs such as the preschool intervention program Head Start, to program funding streams such as the U.S. Department of Education's Title I program that gives millions of dollars to high-poverty schools, to small- scale programs with only one or a few sites such as a new mathematics curriculum in one school or district.

 There has been some debate about the relationship between "basic" or scientific research and program evaluation. For example, in 1999 Peter Rossi, Howard Freeman, and Michael Lipsey described program evaluation as the application of scientific research methods to the assessment of the design and implementation of a program.  In contrast, Michael Patton in 1997 described program evaluation not as the application of scientific research methods, but as the systematic collection of information about a program to inform decision-making.

 in many circumstances the design of a program evaluation that is sufficient for answering evaluation questions and providing guidance to decision-makers would not meet the high standards of scientific research.  Further, program evaluations are often not able to strictly follow the principles of scientific research because evaluators must confront the politics of changing actors and priorities, limited resources, short timelines, and imperfect program implementation.

 Program evaluations must be designed to maximize the usefulness for decision-makers, whereas scientific research does not have this constraint.  Both types of research might use the same methods or focus on the same subject, but scientific research can be formulated solely from intellectual curiosity, whereas evaluations must respond to the policy and program interests of stakeholders.

 Although the main justification for program evaluation is its role in rationalizing policy, program evaluation results rarely have a direct impact on decision-making.  This is because of the political nature of policy decision-making and because people are generally resistant to change.

 While program evaluations may not directly affect decisions, evaluation does play a critical role in contributing to the discourse around a particular program or issue.  Information generated from program evaluation helps to frame the policy debate by bringing conflict to the forefront, providing information about trade-offs, influencing assumptions and beliefs underlying policies, and changing the way people think about a specific issue or problem.