Early College, Early Success January 2014 Copyright © 2014 American Institutes for Research. All rights reserved. Results From the Early College High School Initiative (ECHSI) Impact Study Andrea Berger, Ph.D. Principal Research Analyst, AIR

Two Phases o Descriptive Study: 2002–2009 o Impact Study: 2010–2013 ECHSI National Evaluation 2

Extensive data collections Key findings: Students were largely from populations underrepresented in postsecondary institutions EC students were outperforming districts on state assessments Students were accumulating college credit Students expected to graduate from college Majority of early graduates enrolled in college after high school Annual summary reports available at Descriptive Study: 2002 –

Promising findings from descriptive study but correlational evidence Two research questions 1.Do EC students have better outcomes than they would have had at other high schools? 2.Do the effects of EC differ for students with different background characteristics? Impact Study: 2010 –

Impact Study Approach 5 How do we determine impact? Time machine?

Impact Study Approach 6 How do we determine impact? Randomly assign all students?

Impact Study Approach 7 How do we determine impact? Randomly assign all students?

Impact Study Approach 8 Randomly assign some students How do we determine impact?

Impact Study Approach 9 How do we examine college outcomes without waiting at least 6 years? Go back in time…kind of Retrospective RCT

Impact Study Approach 10 Treatment Students Comparison Students

Impact Study: Participating Early Colleges 11 Open by fall 2007 Students in high school grades Had graduates in study years Used a lottery for admissions Kept old lottery records 154 Early Colleges 141 Early Colleges 125 Early Colleges 20 Early Colleges 10 Early Colleges

12 9 th grade (05–06) 12 th grade (08–09) 4 th year college (12–13) 9 th grade (06–07) 12 th grade (09–10) 3 rd year college (12–13) Study Cohorts and Expected Student Progression 9 th grade (07–08) 12 th grade (10–11) 2 nd year college (12–13)

 10 Early Colleges  2,458 students Early College (treatment): n = 1,044 Comparison: n = 1,414 ECHSI Impact Study Sample

Sample Characteristics Student Background Characteristic Early CollegeComparisonDifference Female51.8%55.0%-3.2% Minority52.4%53.6%-1.2% First generation30.7%34.4%-3.7% Low income46.4%42.3%4.1% Prior ELA: z-score Prior math: z-score

Data Collection  Student educational records Lottery records, student demographics, and student outcomes From Early Colleges, districts, and states National Student Clearinghouse Fall 2004 through summer 2013

Impact Study Findings: High School Outcomes  Early Colleges had a significant impact on the high school graduation rate

Impact Study Findings: College Outcomes  Early Colleges had a significant impact on college enrollment rates

 Early Colleges had a significant impact on degree attainment Impact Study Findings: College Outcomes

 RQ2: Do the effects of ECs differ for students with different background characteristics? High school graduation: no significant differences College enrollment: no significant differences Degree attainment: stronger impact for… – Minority students – Low-income students – Students with higher middle school achievement Subgroup Outcomes

Do Early College students have better outcomes than they would have had at other high schools? Yes Do the effects of Early Colleges differ for students with different background characteristics? Similar or stronger impacts for underrepresented students ECHSI Impact Study Results

All reports are available at AIR.org. Search for “Early College” or use link below: ECHSI Impact Study Reports

Andrea Berger Campus Drive, Suite 200 San Mateo, CA General Information: TTY: Note: Images used with permission of Microsoft. 22