Regression Discontinuity (RD) Andrej Tusicisny, methodological reading group 2008.

Slides:



Advertisements
Similar presentations
AFRICA IMPACT EVALUATION INITIATIVE, AFTRL Africa Program for Education Impact Evaluation Muna Meky Impact Evaluation Cluster, AFTRL Slides by Paul J.
Advertisements

Graduate Methods Master Class
REGRESSION, IV, MATCHING Treatment effect Boualem RABTA Center for World Food Studies (SOW-VU) Vrije Universiteit - Amsterdam.
Applied Research Seminar Public Policy Research Center REGRESSION DISCONTINUITY DESIGN CAN BE YOUR FRIEND: DEVELOPING EVIDENCE IN THE REAL WORLD David.
Presented by Malte Lierl (Yale University).  How do we measure program impact when random assignment is not possible ?  e.g. universal take-up  non-excludable.
GROUP-LEVEL DESIGNS Chapter 9.
Analyzing Regression-Discontinuity Designs with Multiple Assignment Variables: A Comparative Study of Four Estimation Methods Vivian C. Wong Northwestern.
Regression Discontinuity (Durham, 8 April 2013) Hans Luyten University of Twente, Faculty of Behavioural Sciences.
Jean Yoon July 11, 2012 Research Design. Outline Causality and study design Quasi-experimental methods for observational studies –Sample selection –Differences-in-differences.
Regression Discontinuity Design Thanks to Sandi Cleveland and Marc Shure (class of 2011) for some of these slides.
The World Bank Human Development Network Spanish Impact Evaluation Fund.
Introduction of Regression Discontinuity Design (RDD)
Econometric Modeling More on Experimental Design.
Research Design: The Experimental Model and Its Variations
SINGLE CASE, QUASI- EXPERIMENT AND DEVELOPMENT RESEARCH.
Chapter 7 Conducting & Reading Research Baumgartner et al Chapter 8 Experimental Research.
Empirical methods take real-world data estimate size of relationship between variables two types  regression analysis  natural experiments take real-world.
Sampling and Experimental Control Goals of clinical research is to make generalizations beyond the individual studied to others with similar conditions.
Regression Discontinuity Design 1. 2 Z Pr(X i =1 | z) 0 1 Z0Z0 Fuzzy Design Sharp Design.
TOOLS OF POSITIVE ANALYSIS
Temporary Contracts across Generations: Long-term effects of a labour market reform at the margin Miguel Ángel Malo Universidad de Salamanca, Spain Begoña.
1 Exploring Quasi-experiments Lab Assignment #5 Due May 16, 2008 Locate an empirical journal article that employs a quasi-experimental design. Closely.
Methods and Approaches to investigate the UK Education System Sandra McNally, University of Surrey and Centre for Economic Performance, London School of.
METHODS IN BEHAVIORAL RESEARCH NINTH EDITION PAUL C. COZBY Copyright © 2007 The McGraw-Hill Companies, Inc.
Larysa Minzyuk - Felice Russo Department of Management and Economics - University of Salento (Lecce)
I want to test a wound treatment or educational program but I have no funding or resources, How do I do it? Implementing & evaluating wound research conducted.
Regression Discontinuity Design. Basics Two potential outcomes Yi(0) and Yi(1), causal effect Yi(1) − Yi(0), binary treatment indicator Wi, covariate.
Selecting a Research Design. Research Design Refers to the outline, plan, or strategy specifying the procedure to be used in answering research questions.
Non Experimental Design in Education Ummul Ruthbah.
Development Economics ECON 4915 Lecture 5 Andreas Kotsadam.
Longitudinal Methods for Pharmaceutical Policy Evaluation Common Analytic Approaches Michael Law The Centre for Health Services and Policy Research The.
SINGLE - CASE, QUASI-EXPERIMENT, AND DEVELOPMENT RESEARCH © 2012 The McGraw-Hill Companies, Inc.
Jean Yoon December 15, 2010 Research Design. Outline Causality and study design Quasi-experimental methods for observational studies –Covariate matching.
Session III Regression discontinuity (RD) Christel Vermeersch LCSHD November 2006.
Ch. 2 Tools of Positive Economics. Theoretical Tools of Public Finance theoretical tools The set of tools designed to understand the mechanics behind.
RCTs and instrumental variables Anna Vignoles University of Cambridge.
AFRICA IMPACT EVALUATION INITIATIVE, AFTRL Africa Program for Education Impact Evaluation David Evans Impact Evaluation Cluster, AFTRL Slides by Paul J.
WWC Standards for Regression Discontinuity Study Designs June 2010 Presentation to the IES Research Conference John Deke ● Jill Constantine.
Applying impact evaluation tools A hypothetical fertilizer project.
Quasi Experimental and single case experimental designs
Experimental & Quasi-Experimental Designs Dr. Guerette.
AADAPT Workshop Latin America Brasilia, November 16-20, 2009 Laura Chioda.
ECON 3039 Labor Economics By Elliott Fan Economics, NTU Elliott Fan: Labor 2015 Fall Lecture 91.
Randomized Assignment Difference-in-Differences
ECON 3039 Labor Economics By Elliott Fan Economics, NTU Elliott Fan: Labor 2015 Fall Lecture 61.
Jamal Abedi, UCLA/CRESST Major psychometric issues Research design issues How to address these issues Universal Design for Assessment: Theoretical Foundation.
ECON 3039 Labor Economics By Elliott Fan Economics, NTU Elliott Fan: Labor 2015 Fall Lecture 71.
INSTRUMENTAL VARIABLES Eva Hromádková, Applied Econometrics JEM007, IES Lecture 5.
Randomized Evaluation: Dos and Don’ts An example from Peru Tania Alfonso Training Director, IPA.
Impact Evaluation Methods Regression Discontinuity Design and Difference in Differences Slides by Paul J. Gertler & Sebastian Martinez.
Research Designs for Explanation Experimental, Quasi-experimental, Non-experimental, Observational.
Gabe Avakian Orona, M.P.H. CAIR 2016 November 17, 2016
ECON 4009 Labor Economics 2017 Fall By Elliott Fan Economics, NTU
Ch. 2 Tools of Positive Economics
Lezione di approfondimento su RDD (in inglese)
An introduction to Impact Evaluation
12 Inferential Analysis.
Experiments: Part 3.
Impact evaluation: The quantitative methods with applications
Regression Discontinuity
EMPIRICAL STUDY AND FORECASTING (II)
12 Inferential Analysis.
Evaluating Impacts: An Overview of Quantitative Methods
Explanation of slide: Logos, to show while the audience arrive.
Experiments: Part 2.
Experiments: Part 3.
Experiments: Part 3.
The Effect of Institution Ownership on Payout Policy
Positive analysis in public finance
Using Big Data to Solve Economic and Social Problems
Presentation transcript:

Regression Discontinuity (RD) Andrej Tusicisny, methodological reading group 2008

Interrupted time series (ITS)  Y t = f(T) + D t b + e t  Single unit observed in multiple points in time  We extrapolate f(T) from t 0 to t 1  F(T) should be correctly specified  Autocorrelation  Attrition and disruption

How to do it better? (ITS)  Braga et al. (2001)  1. Assess the effect of the cause on similar outcomes that should be affected by the cause  2. Assess the effect of the cause on similar outcomes that should not be affected by the cause

How to do it better? (ITS)  3. Assess the effect within meaningful subgroups  4. Include time-varying covariates  5. Compare the time trend with the time trend in similar not-treated units or populations  6. Assess the impact of termination of the cause in addition to its initiation

Regression discontinuity (RD)  Treatment function of a continuous “forcing” variable Z  Cutoff value of Z determines assignment to the treatment group  Units of either side of the cutoff exchangeable  Other covariates smooth at cutoff  Sharp RD and fuzzy RD

Discontinuity  Counterfactual values extrapolated  Internal validity high  Bias can be reduced by limiting the sample to the vicinity of the discontinuity frontier, but it will decrease efficiency (Black, 2005)  External validity limited  No problem with autocorrelation

How to do it  Bias if model misspecified  Polynomials used  Y i = β 0 + β 1 X i + β 2 D i + β 3 X i D i + β 4 X i 2 + β 5 X i 2 D i + e i  In STATA: rd (

Tests  Imbens and Lemieux (2008)  Treatment should have zero effect on covariates  No discontinuity in covariates at the cutoff point  No unpredicted discontinuities  No manipulation of Z (McCrary, 2007)

RD and IV  Z can have a direct impact on Y  Example of Z used as an instrument for an endogenous variable: Angrist and Lavy (1999)

Useful references  Exemplary ITS:  Braga, A. et al. (2001) “Problem- oriented policing, deterrence, and youth violence: An evaluation of Boston's Operation Ceasefire.” Journal of Research in Crime and Delinquency 38: 195–225

Useful references  Comprehensive overview:  Imbens, G. W. and Lemieux, T. (2008) “Regression discontinuity designs: A guide to practice”. Journal of Econometrics 142: 615– 635

Useful references  Bias and efficiency  Black, D. et al. (2005) “Evaluating the regression discontinuity design using experimental data.” Syracuse University, New York, unpublished manuscript.

Useful references  What happens if manipulation of Z:  McCrary, J. (2008) “Manipulation of the running variable in the regression discontinuity design: A density test.” Journal of Econometrics 142: 698–714

Useful references  Exemplary graphic presentation of RD results:  Lee, D. et al. (2004) “Do Voters Affect or Elect Policies? Evidence from the U.S. House.” Quarterly Journal of Economics 119(3)

Useful references  RD and IV  Angrist, J. D. and Lavy, V. (1999) “Using Maimonides' Rule to Estimate the Effect of Class Size on Scholastic Achievement.” The Quarterly Journal of Economics 114(2):