Toward a New Paradigm for Student Success ALADE Conference 2018 Toward a New Paradigm for Student Success Alexander Mayer October 19, 2018

About MDRC Dedicated to finding solutions to some of the nation’s most challenging problems. Design promising new interventions. Evaluate programs and polices across the country using the highest research standards. Provide technical assistance to help schools, programs, and organizations improve their work.

Goals for Postsecondary Education Increase graduation rates for low-income students Improve outcomes throughout the Postsecondary Pipeline Reduce college achievement and postsecondary earnings gaps 3

 Compelling Evidence to Improve Student Outcomes Across the Education Pipeline There is evidence for preventing developmental education placement and helping those needing dev ed succeed  Frequent advising and coaching are vital Behavioral strategies help drive success Comprehensive strategies that combine opportunity with obligation have big effects (including graduation) but cost more The Next Big Challenge: Converting evidence into action

Getting through Developmental Education 11/01/2017 Getting through Developmental Education

The Developmental Education Challenge About 2/3 of community college students are referred to developmental education More than half never complete developmental education About 2/3 fail to earn a degree or a certificate within 6 years

What’s causing the problem? Academic Challenges Financial Barriers Work-Life-School Balance Lack of College Know-How Institutional Barriers

Innovation: Assessment & Placement Use of Measures Other than Standardized Tests for Assessment Among Public 2-Year Colleges

Innovation: Instructional Methods Prevalence of Developmental Math Instructional Methods Among Public 2-Year Colleges

Weak Evidence ≠ Group experiences the program Confidential - Please do not circulate Weak Evidence “Motivated” Individual “Unmotivated” Individual Group experiences the program Group does not experience the program ≠ 10 Differences in outcomes between these two groups of individuals could be the result of the types of individuals and/or the program.

Strong Evidence (Random Assignment) Confidential - Please do not circulate Strong Evidence (Random Assignment) “Motivated” Individual “Unmotivated” Individual Program Group Control Group ≈ 11 Differences in outcomes between program and control group individuals are a result of the program (not the types of people)

Using Multiple Measures Helps Students Avoid Developmental Education 1. Research suggests both under- and over-placement for many students: better placement systems necessary 2. MDRC & CCRC worked together to test using multiple measures for placement (incl. High School GPA) 3. Promising early results: More students placed into college-level English and Math & more passed

Performance-Based Scholarships Increase Math Completion Performance-Based Scholarship Demonstration: Highest Level of Math Completed after Two Years (Hillsborough Community College) Percent 5.6* 5.4** Statistical significance levels are indicated as: *** = 1 percent; ** = 5 percent; * = 10 percent.

Pathways Increase Success in College-Level Math Dana Center Math Pathways Evaluation: Impact on College-Level Math Pass-Rate, Fall 2015 & Spring 2016 Cohorts Percent 7.9** 10.8*** Statistical significance levels are indicated as: *** = 1 percent; ** = 5 percent; * = 10 percent.

Behavioral Strategies Help Drive Success 11/01/2017 Behavioral Strategies Help Drive Success

The Promise of Behavioral Science Context matters Actions do not reflect intentions Human behavior can be predictable Focus on how people actually make decisions and behave 16

Case Study: Encouraging Additional Summer Enrollment Research finds that students who enroll in summer, especially after their first year, are more likely to: Persist Graduate within five years Summer courses could: Bridge gap between spring and fall Mitigate loss of learning Accelerate time to completion Recent state and federal policies : Reinstatement of Third-Term OCOG (Ohio) Reinstatement of Year-Round Pell Only ~20% of community college students in Ohio enroll during the summers

Behavioral Info Campaign (and Behavioral Info Campaign + Gap Tuition) Increase Summer Enrollment Both interventions boost summer enrollment rates Info campaign + gap tuition grant is substantially more effective

Text Messages May Support College Enrollment for Adults 11/01/2017 Text Messages May Support College Enrollment for Adults College Enrollment Steps  General Check-ins Logistical and Life Issues Build evidence about the effectiveness of text messaging support for the adult population served by Educational Opportunity Centers 19

Comprehensive Programs Increase Long-Term Success 11/01/2017 Comprehensive Programs Increase Long-Term Success

Comprehensive Services Increases Degree Completion CUNY ASAP is comprehensive 3-year program, bringing together many promising reforms Positive and significant impacts on full-time enrollment, persistence, and degree attainment Nearly doubled the three-year graduation rate (40% versus 22%) Despite program costs, the cost per degree for ASAP was lower than the control condition

Programs based closely on CUNY ASAP Ohio Program Model Programs based closely on CUNY ASAP Student Services Triage Advising Tutoring Career Services Student Responsibility and Messaging Enroll Full-time Take Dev. Ed. Early Graduate in 3 Years Course Enrollment ASAP Seminar Course Schedules Early Registration Financial Supports Tuition Waiver Gas/Grocery Card Textbooks

More Students Persist Into 2nd Semester

More Students Enroll Full Time

Strengthening Promise Programs Preliminary Confidential Draft

Detroit Promise Path Increases Second Semester Enrollment 11.5*** 15.0*** Statistical significance levels are indicated as: *** = 1 percent; ** = 5 percent; * = 10 percent.

Conclusions Students face diverse challenges, but there are proven strategies that help. The strongest programs are comprehensive programs that use multiple strategies, and combine opportunity and obligation. Acting on the evidence is the next big challenge.