Between a Rock and a Hard Place Scientifically Based Evidence in Evaluation Presentation to the Canadian Evaluation Society Vancouver, B.C. June 3, 2003.

Slides:



Advertisements
Similar presentations
Grey Literature in Public Administration Markus Weber, CCE 4 – 5 Dec 2005 Page 1 Grey Literature in Public Administration – An Example of a specific Quality.
Advertisements

Postgraduate Course 7. Evidence-based management: Research designs.
Multilevel Interventions: Study Design and Analysis Issues Paul D. Cleary, Ph.D. Yale School of Public Health Cary Gross, M.D. Yale School of Medicine.
From Dept. of Ed website Dated bytes - Fri Mar 15 12:15:53 EST 2002.
Evidence-Based Education (EBE) Grover J. (Russ) Whitehurst Assistant Secretary Educational Research and Improvement United States Department of Education.
Experimental designs Non-experimental pre-experimental quasi-experimental experimental No time order time order variable time order variables time order.
Implementing Evidence- Based Practice Training in a Scientist-Practitioner Program David DiLillo Director of Clinical Training University of Nebraska-Lincoln.
National Human Resources for Health Observatory HRH Research Forum Dr. Ayat Abuagla.
Chapter 3 Flashcards. obligation of an individual to other individuals based on a social or legal contract to justify his or her actions; the processes.
Designing Influential Evaluations Session 5 Quality of Evidence Uganda Evaluation Week - Pre-Conference Workshop 19 th and 20 th May 2014.
CHAPTER 12, evaluation research
 Finding the right information to answer a given question often depends on the source of the information  Searching for evidence that has already been.
What is going on with psychotherapy today? Carolyn R. Fallahi, Ph. D.
Including Parents in Evidence-based Education Ronnie Detrich Wing Institute.
Experimental Design making causal inferences. Causal and Effect The IV precedes the DV in time The IV precedes the DV in time The IV and DV are correlated.
10/16/2008 Gerald D. Nunn, Ph.D., NCSP2 TIA RTI.
Evaluation Research, aka Program Evaluation. Definitions Program Evaluation is not a “method” but an example of applied social research. From Rossi and.
Evidence-Based Medicine and Causal Mechanisms Dr. Leen De Vreese Centre for Logic and Philosophy of Science Ghent University, Belgium
Copyright © 2009 Pearson Education Canada2-1 Chapter 2: Child Development 2.1 Doing Child-Development Research 2.2 Child-Development Research and Family.
Thinking Like a Psychologist. Overview Psychologists use scientific reasoning strategies. These strategies can be helpful outside of this class. * Many.
Research in Psychology. Questions What can we find out with research? Why should we believe scientists? Isn’t Psychology just common sense?
Evaluation Research COMT 502. topics Evaluation research –Process of determining whether intervention has its intended result.
Evidence-Based Practice for Pharmacy Y2 Pamela Corley, MLS, AHIP Joe Pozdol, MLIS Norris Medical Library 2003 Zonal Ave. Los Angeles, CA
Experimental Study.
Introduction to Educational Research Dr. M C. Smith
Research Methodology For IB Psychology Students. Empirical Investigation The collecting of objective information firsthand, by making careful measurements.
Taking a Critical Stance Evidence-based practice the integration of the best research evidence with [professional] expertise and client.
S-005 Intervention research: True experiments and quasi- experiments.
ARROW Trial Design Professor Greg Brooks, Sheffield University, Ed Studies Dr Jeremy Miles York University, Trials Unit Carole Torgerson, York University,
Zoe G. Davies Centre for Evidence-Based Conservation University of Birmingham, UK Systematic Review Methodology: a brief summary.
H860 Reading Difficulties Week 7 Reading Interventions: How Do They Weigh Up?
Evidence-Based Practice: Evidence-Based Practice: NUR 126 Denise Filiatrault Adopted from Curry College Division of Nursing Elizabeth Kudzma.
Evidence-Based Medicine Presentation [Insert your name here] [Insert your designation here] [Insert your institutional affiliation here] Department of.
The Pennsylvania State University (PSU) Rutgers, The State University of New Jersey, Center for Effective School Practices (CESP) Caliber, an ICF International.
Evidence-Based Medicine: What does it really mean? Sports Medicine Rounds November 7, 2007.
Equations and Inequalities. Equation – A sentence stating that two qualities are equal. Includes a variable – 3x + 5 = 17 Equation variable The solution.
Randomised Controlled Trials: What, why and how? Pam Hanley 22 March 2013.
Evidence-based Education and the Culture of Special Education Chair: Jack States, Wing Institute Discussant: Teri Palmer, University of Oregon.
+ IDENTIFYING AND IMPLEMENTING EDUCATIONAL PRACTICES SUPPORTED BY RIGOROUS EVIDENCE: A USER FRIENDLY GUIDE Presented by Kristi Hunziker University of Utah.
Evidence Based Practice RCS /9/05. Definitions  Rosenthal and Donald (1996) defined evidence-based medicine as a process of turning clinical problems.
Best Practices in Demonstrating Evidence Diana Epstein, Ph.D, CNCS Office of Research and Evaluation Carla Ganiel, AmeriCorps State and National.
Natural Experiments Versus RCTs Steven Gortmaker, Ph.D. Harvard School of Public Health /Harvard Prevention Research Center.
The Scientific Method. Parts of an Experiment Independent variable; Input, the manipulated variable. What the experimenter chooses to change Dependent.
+ Evidence Based Practice University of Utah Evidence-Based Treatment and Practice: New Opportunities to Bridge Clinical Research and Practice, Enhance.
PTP 661 EVIDENCE ABOUT INTERVENTIONS CRITICALLY APPRAISE THE QUALITY AND APPLICABILITY OF AN INTERVENTION RESEARCH STUDY Min Huang, PT, PhD, NCS.
Finding, Evaluating, and Presenting Evidence Sharon E. Lock, PhD, ARNP NUR 603 Spring, 2001.
W HAT IS EXPOSITION ? Expository Writing English I.
Evidence-Based Nursing An Overview What’s It All About? Betty Ackley, RN, MSN, EdS Mosby items and derived items © 2011 by Mosby, Inc., an affiliate of.
Chapter 4 INTRODUCTION TO CLINICAL PSYCHOLOGY, THIRD CANADIAN EDITION by John Hunsley and Catherine M. Lee.
EVALUATION RESEARCH To know if Social programs, training programs, medical treatments, or other interventions work, we have to evaluate the outcomes systematically.
Homework Martha Y Pancardo, Silvia Gamez, Mariela Cordoba.
Research Design Quantitative. Quantitative Research Design Quantitative Research is the cornerstone of evidence-based practice It provides the knowledge.
Psychodynamic Psychotherapy: A Systematic Review of Techniques, Indications and Empirical Evidence Falk Leichsenring & Eric Leibing University of Goettingen,
Randomized Control Trials: What, Why, How, When, and Where Mark L. Davison MESI Conference March 11, 2016 Department of Educational Psychology.
Copyright © 2010, 2006, 2002 by Mosby, Inc., an affiliate of Elsevier Inc. Chapter 10 Evidence-Based Practice Sharon E. Lock.
Grants 101: From Research Idea to Literature Review Jan Glover, MLS Mary Warner, MMSc, PA-C Yale School of Medicine.
Evidence-Based Mental Health PSYC 377. Structure of the Presentation 1. Describe EBP issues 2. Categorize EBP issues 3. Assess the quality of ‘evidence’
Standards of Evidence for Prevention Programs Brian R. Flay, D.Phil. Distinguished Professor Public Health and Psychology University of Illinois at Chicago.
RESEARCH SYNTHESIS: The Core Methodology of Evidence-Based Reviews Susan N. Labin, Ph.D.
Distinguish between an experiment and other types of scientific investigations where variables are not controlled,
The Research Design Continuum
Evidence Based Practice Process
2016 AmeriCorps Texas All-Grantee Meeting February 25-26, 2016
Computers & Programming Languages
Reading Expository Writing English II 2012
Things to Remember… PubMed
Scientific Process METHODS
Research Design Quantitative.
Level of Evidence Lecture 4.
Engendering Success in STEM:  Combatting Implicit Bias Toni Schmader, Ph.D. Canada Research Chair in Social Psychology.
Presentation transcript:

Between a Rock and a Hard Place Scientifically Based Evidence in Evaluation Presentation to the Canadian Evaluation Society Vancouver, B.C. June 3, 2003

What Works Clearinghouse A new U.S. federal initiative To be an ongoing public resource that will assess and report scientific evidence on “What Works?" in education Systematic review processes will be used to report on the quantity, quality, and relevance of evidence, and magnitude of effects of specific educational interventions

What is empirical evidence? Scientifically-based research from fields such as psychology, sociology, speech & hearing, economics, and neuroscience, and especially from research in educational settings Empirical data on performance used to compare, evaluate, and monitor progress

Evidence-Based Education

EBE – Where Are We?

Quality: Levels of Evidence All evidence is NOT equal for questions of effectiveness (what works) 1.Randomized trial (true experiment) 2.Comparison groups (quasi-experiment) 3.Pre-/Post- comparison 4.Corelational studies 5.Case studies 6.Anecdotes

What might this mean for evaluators? Evaluation questions reduced to what works questions. Evaluation costs redirected from complex studies of multiple variables to RCT’s Evaluators’ bookshelves filling up with research design texts and pushing evaluation texts aside Logic models falling into disuse Evaluations tapped for inclusion in reviews/syntheses often not complete Client requests for RCT evaluations

Randomized Trials: The gold standard Claims about the effects of an educational intervention on outcomes Two or more conditions that differ in levels of exposure to the educational intervention Random assignment to conditions Tests for differences in outcomes

Feedback: Privacy Policy Feedback
Do Not Sell My Personal Information
About project: SlidePlayer Terms of Service

© 2024 SlidePlayer.com Inc. All rights reserved.