ECON 3039 Labor Economics 2015-16 By Elliott Fan Economics, NTU Elliott Fan: Labor 2015 Fall Lecture 81.

Slides:



Advertisements
Similar presentations
A small taste of inferential statistics
Advertisements

Girls’ scholarship program.  Often small/no impacts on actual learning in education research ◦ Inputs (textbooks, flipcharts) little impact on learning.
Review of Identifying Causal Effects Methods of Economic Investigation Lecture 13.
1 Arlene Ash QMC - Third Tuesday September 21, 2010 (as amended, Sept 23) Analyzing Observational Data: Focus on Propensity Scores.
A Guide to Education Research in the Era of NCLB Brian Jacob University of Michigan December 5, 2007.
Teacher Effectiveness in Urban Schools Richard Buddin & Gema Zamarro IES Research Conference, June 2010.
Experimental Research Designs
MEASURING COLLEGE VALUE-ADDED: A DELICATE INSTRUMENT Richard J. Shavelson SK Partners & Stanford University AERA Ben Domingue University of Colorado Boulder.
KIPP: Effectiveness and Innovation in Publicly-Funded, Privately-Operated Schools October 4, 2012 Presentation to the APPAM/INVALSI Improving Education.
Missing Data Issues in RCTs: What to Do When Data Are Missing? Analytic and Technical Support for Advancing Education Evaluations REL Directors Meeting.
SREE workshop march 2010sean f reardon using instrumental variables in education research.
Impact Evaluation: The case of Bogotá’s concession schools Felipe Barrera-Osorio World Bank 1 October 2010.
Chapter 2 – Tools of Positive Analysis
The Practice of Statistics
Types of Evaluation.
WARM UP  Write a short response to the following questions: 1. What are the most important elements of taking notes in class? 2. What do we need to know.
CAUSAL-COMPARATIVE RESEARCH
Racial and Economic Segregation in Schools: Barrier to Quality and Equality in Education Baris Gumus-Dawes.
Experiments and Observational Studies.  A study at a high school in California compared academic performance of music students with that of non-music.
Experimental Design The Gold Standard?.
DRAFT Building Our Future 2017 Fulton County Schools Strategic Plan Name of Meeting Date.
Vouchers in Milwaukee: What Have We Learned From the Nation’s Oldest and Largest Program? Deven Carlson University of Oklahoma.
1 Psych 5500/6500 Confounding Variables Fall, 2008.
McGraw-Hill/Irwin Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. Choosing a Research Design.
Research and Evaluation Center Jeffrey A. Butts John Jay College of Criminal Justice City University of New York August 7, 2012 How Researchers Generate.
Chapter 5 The American Political Landscape. Unlike most nations, the United States has an incredibly varied mix of ethnicities from every part of the.
How Does Secondary Education in Louisiana Stack up? Presented by Dr. Bobby Franklin January 31, 2005.
Populations, Samples, and Probability. Populations and Samples Population – Any complete set of observations (or potential observations) may be characterized.
Individual values of X Frequency How many individuals   Distribution of a population.
One-sample In the previous cases we had one sample and were comparing its mean to a hypothesized population mean However in many situations we will use.
Chapter 2 Research in Abnormal Psychology. Slide 2 Research in Abnormal Psychology  Clinical researchers face certain challenges that make their investigations.
Instrumental Variables: Problems Methods of Economic Investigation Lecture 16.
● Uncertainties abound in life. (e.g. What's the gas price going to be next week? Is your lottery ticket going to win the jackpot? What's the presidential.
COMM 250 Agenda - Week 10 Housekeeping C2 – Returned to You Today RP1 – Due Today (IM Surveys) TP3a – Due Tomorrow Lecture RAT4 Review RP1 Experiments.
ECON 3039 Labor Economics By Elliott Fan Economics, NTU Elliott Fan: Labor 2015 Fall Lecture 31.
Evaluating Harlem Children’s Zone. Harlem Children’s Zone Started by Geoffrey Canada in a 97 block area of Harlem in NYC. Combines high energy “no excuses”
ECON 3039 Labor Economics By Elliott Fan Economics, NTU Elliott Fan: Labor 2015 Fall Lecture 21.
© CCSR ccsr.uchicago.edu. © CCSR Early Warning Indicators of High School Graduation and Dropout Elaine Allensworth.
Application 2: Minnesota Domestic Violence Experiment Methods of Economic Investigation Lecture 6.
Data Analysis Econ 176, Fall Populations When we run an experiment, we are always measuring an outcome, x. We say that an outcome belongs to some.
Instrumental Variables: Introduction Methods of Economic Investigation Lecture 14.
Children,< 18. Dropout rates Dropouts by Generation --Latino DROPOUTS, 2000: --Born outside US = 994,000 [26%] --1 st Generation = 240,000 [4.4%] --2.
Experiments. The essential feature of the strategy of experimental research is that you… Compare two or more situations (e.g., schools) that are as similar.
Chapter 10 Experimental Research Gay, Mills, and Airasian 10th Edition
0 Universal Pre-Kindergarten (UPK) FY13 February 2012.
Non-Experimental designs
State and Local Public Finance Spring 2015, Professor Yinger Lecture 4 Public Sector Costs: Concepts.
Randomness, Probability, and Simulation
ECON 3039 Labor Economics By Elliott Fan Economics, NTU Elliott Fan: Labor 2015 Fall Lecture 91.
State and Local Public Finance Professor Yinger Spring 2016.
Please hand in homework on Law of Large Numbers Dan Gilbert “Stumbling on Happiness”
INST 275 – Administrative Processes in Government Lecture 4b – Developing Policy Arguments.
ECON 3039 Labor Economics By Elliott Fan Economics, NTU Elliott Fan: Labor 2015 Fall Lecture 71.
Copyright © 2015 Inter-American Development Bank. This work is licensed under a Creative Commons IGO 3.0 Attribution-Non Commercial-No Derivatives (CC-IGO.
INSTRUMENTAL VARIABLES Eva Hromádková, Applied Econometrics JEM007, IES Lecture 5.
Chapter 9 Estimation and Confidence Intervals. Our Objectives Define a point estimate. Define level of confidence. Construct a confidence interval for.
7 th June 2012 Is it better to fail than to succeed? A quantitative analysis of ‘just’ failing an English school inspection Rebecca Allen, Institute of.
AP Stat 2007 Free Response. 1. A. Roughly speaking, the standard deviation (s = 2.141) measures a “typical” distance between the individual discoloration.
Measuring College Value-Added: A Delicate Instrument
ECON 4009 Labor Economics 2017 Fall By Elliott Fan Economics, NTU
State and Local Public Finance Professor Yinger Spring 2017
ECON 4009 Labor Economics 2017 Fall By Elliott Fan Economics, NTU
EXPERIMENTAL RESEARCH
How High Schools Explain Students’ Initial Colleges and Majors
Chapter 10: Comparing Two Populations or Groups
State and Local Public Finance Professor Yinger Spring 2019
State and Local Public Finance Professor Yinger Spring 2019
Chapter 10: Comparing Two Populations or Groups
Instrumental Variables
Reminder for next week CUELT Conference.
Presentation transcript:

ECON 3039 Labor Economics By Elliott Fan Economics, NTU Elliott Fan: Labor 2015 Fall Lecture 81

Introducing charter schools Elliott Fan: Labor 2015 Fall Lecture 82 Charter schools are public schools of choice, meaning that families choose them for their children. A charter—the right to operate a public school—is typically awarded to an independent operator (mostly private, nonprofit management organizations) for a limited period, subject to renewal. Charter schools are free to structure their curricula and school environments. Many charter schools expand instruction time by running long school days and continuing school on weekends and during the summer.. Teachers and staff who work at the former rarely belong to labor unions..

Introducing charter schools Elliott Fan: Labor 2015 Fall Lecture 83

Introducing charter schools Elliott Fan: Labor 2015 Fall Lecture 84

5

Back in the 1990s... KIPP LA College Prep, one of more than 140 schools affiliated with the Knowledge Is Power Program. KIPP was started in Houston and New York City in 1995 by veterans of Teach for America, a program that recruits thousands of recent graduates of America’s most selective colleges and universities to teach in low-performing school districts. Today, the KIPP network serves a student body that is 95% black and Hispanic, with more than 80% of KIPP students poor enough to qualify for the federal government’s subsidized lunch program. Elliott Fan: Labor 2015 Fall Lecture 86

7

KIPP There are large test score differences by race and ethnicity, generating two sorts of responses. – The first looks to schools to produce better outcomes; – The second calls for broader social change Because of its focus on minority students, KIPP is often central in this debate Supporters pointing out that nonwhite KIPP students have markedly higher average test scores than nonwhite students from nearby schools. KIPP skeptics have argued that KIPP’s apparent success reflects the fact that KIPP attracts families whose children are more likely to succeed anyway. Elliott Fan: Labor 2015 Fall Lecture 88

KIPP The first KIPP school in New England was a middle school in the town of Lynn, Massachusetts. In 2009, more than three quarters of Lynn’s mostly nonwhite public school students were poor enough to qualify for a subsidized lunch. Although urban charter schools typically enroll many poor, black students, KIPP Lynn is unusual among charters in enrolling a high proportion of Hispanic children with limited English proficiency. Elliott Fan: Labor 2015 Fall Lecture 89

KIPP Scarce charter seats are allocated by lottery. These lotteries allow us to untangle the charter school causality conundrum. Our IV tool uses these admissions lotteries to frame a naturally occurring randomized trial. Elliott Fan: Labor 2015 Fall Lecture 810

Lotteries are NOT RCTs Note that what is randomized here is not the treatment (enrollment of a charter school), but the offer of a charter seat. – Applicants are not randomly chosen – Lotteries winners may refuse to get enrolled – Lotteries losers find way into KIPP Elliott Fan: Labor 2015 Fall Lecture 811

Lotteries are NOT RCTs Elliott Fan: Labor 2015 Fall Lecture 812

Elliott Fan: Labor 2015 Fall Lecture 813

Implementation Note that we can write: Effect of offers on scores = (Effects of offers on attendance)*(Effects of attendance on scores) And this is Effects of attendance on scores= (Effect of offers on scores) /(Effects of offers on attendance) Elliott Fan: Labor 2015 Fall Lecture 814

Implementation Note that we can write: Effect of offers on scores = (Effects of offers on attendance)*(Effects of attendance on scores) and rearranging it we can get: Effects of attendance on scores= (Effect of offers on scores) /(Effects of offers on attendance) Elliott Fan: Labor 2015 Fall Lecture 815

Three requirements 1.The instrument (offer) has a causal effect on the variable whose effects we’re trying to capture, in this case KIPP enrollment. For reasons that will soon become clear, this causal effect is called the first stage. 2.The instrument is randomly assigned or “as good as randomly assigned,” in the sense of being unrelated to the omitted variables we might like to control for (in this case variables like family background or motivation). This is known as the independence assumption. 3.Finally, IV logic requires an exclusion restriction. The exclusion restriction describes a single channel through which the instrument affects outcomes. Here, the exclusion restriction amounts to the claim that the.36σ score differential between winners and losers is attributable solely to the.74 win-loss difference in attendance rates shown in column (3) of Table 3.1 (at the top of panel B). Elliott Fan: Labor 2015 Fall Lecture 816

Implementation Elliott Fan: Labor 2015 Fall Lecture 817

Terminologies The original randomizer (in this case, a KIPP offer) is called an instrumental variable or just an instrument for short. As we’ve seen, the link from the instrument to the causal variable of interest (in this case, the effect of lottery offers on KIPP attendance) is called the first stage, because this is the first link in the chain. The direct effect of the instrument on outcomes, which runs the full length of the chain (in this case, the effect of offers on scores), is called the reduced form. Finally, the causal effect of interest—the second link in the chain—is determined by the ratio of reduced form to first-stage estimates. This causal effect is called a local average treatment effect (LATE for short). Elliott Fan: Labor 2015 Fall Lecture 818

Implementation Elliott Fan: Labor 2015 Fall Lecture 819

What do you mean by LATE? Elliott Fan: Labor 2015 Fall Lecture 820 Local average treatment effect: Specifically, LATE is the average causal effect for children whose KIPP enrollment status is determined solely by the KIPP lottery.

Four types of children Elliott Fan: Labor 2015 Fall Lecture 821 Applicants like Alvaro are dying to go to KIPP; if they lose the lottery their mothers get them into KIPP anyway. (always-takers) Applicants like Camila are happy to go to KIPP if they win, but stoically accept the verdict if they lose (compliers). Finally, applicants like Normando worry about long days and lots of homework. Normando doesn’t really want to go to KIPP and refuses to do so when hearing that he has won a seat (never-takers).

Four types of children Elliott Fan: Labor 2015 Fall Lecture 822

Four types of children Elliott Fan: Labor 2015 Fall Lecture 823 Note that we cannot directly observe compliers, because they are mixed with always-takers among the treated, or mixed with never-takers among the untreated. We can, however, observe the revealed always-takers and revealed never-takers. Some always-takers are revealed because, in the case of KIPP, lottery losers end up with enrolling in KIPP. Some never-takers are revealed because lottery winders deny enrolling in KIPP.

LATE and TOT Elliott Fan: Labor 2015 Fall Lecture 824 Average treatment effect on the treated (TOT) is in general different from local average treatment effect (LATE) because there are both compliers and always-takers among the treated. LATE=TOT only when the treatment effects on always takers and compliers are the same.

External validity Elliott Fan: Labor 2015 Fall Lecture 825 The question of whether a particular causal estimate has predictive value for times, places, and people beyond those represented in the study that produced it is called external validity. To explore the external validity of a particular LATE, we can use a single instrument to look at estimates for different types of students—say, those with higher or lower baseline scores. We can also look for additional instruments that affect different sorts of compliers. As with estimates from randomized trials, the best evidence for the external validity of IV estimates comes from comparisons of LATEs for the same or similar treatments across different populations.