1. Toward a New Paradigm for Student Success
ALADE Conference 2018
Toward a New Paradigm for Student Success
Alexander Mayer
October 19, 2018

2. About MDRC
Dedicated to finding solutions to some of the nation’s most challenging problems.
Design promising new interventions.
Evaluate programs and polices across the country using the highest research standards.
Provide technical assistance to help schools, programs, and organizations improve their work.

3. Goals for Postsecondary Education
Increase graduation rates for low-income students
Improve outcomes throughout the Postsecondary Pipeline
Reduce college achievement and postsecondary earnings gaps 3

4.  Compelling Evidence to Improve Student Outcomes Across the Education Pipeline
There is evidence for preventing developmental education placement and helping those needing dev ed succeed 
Frequent advising and coaching are vital
Behavioral strategies help drive success
Comprehensive strategies that combine opportunity with obligation have big effects (including graduation) but cost more
The Next Big Challenge: Converting evidence into action

5. Getting through Developmental Education
11/01/2017
Getting through Developmental Education

6. The Developmental Education Challenge
About 2/3 of community college students are referred to developmental education
More than half never complete developmental education
About 2/3 fail to earn a degree or a certificate within 6 years

7. What’s causing the problem?
Academic Challenges
Financial Barriers
Work-Life-School Balance
Lack of College Know-How
Institutional Barriers

8. Innovation: Assessment & Placement
Use of Measures Other than Standardized Tests for Assessment Among Public 2-Year Colleges

9. Innovation: Instructional Methods
Prevalence of Developmental Math Instructional Methods Among Public 2-Year Colleges

10. Weak Evidence ≠ Group experiences the program
Confidential - Please do not circulate
Weak Evidence
“Motivated” Individual
“Unmotivated” Individual
Group experiences the program
Group does not experience the program ≠ 10
Differences in outcomes between these two groups of individuals could be the result of the types of individuals and/or the program.

11. Strong Evidence (Random Assignment)
Confidential - Please do not circulate
Strong Evidence (Random Assignment)
“Motivated” Individual
“Unmotivated” Individual
Program Group
Control Group ≈ 11
Differences in outcomes between program and control group individuals are a result of the program (not the types of people)

12. Using Multiple Measures Helps Students Avoid Developmental Education
1. Research suggests both under- and over-placement for many students: better placement systems necessary
2. MDRC & CCRC worked together to test using multiple measures for placement (incl. High School GPA)
3. Promising early results: More students placed into college-level English and Math & more passed

13. Performance-Based Scholarships Increase Math Completion
Performance-Based Scholarship Demonstration: Highest Level of Math Completed after Two Years (Hillsborough Community College)
Percent
5.6*
5.4**
Statistical significance levels are indicated as: *** = 1 percent; ** = 5 percent; * = 10 percent.

14. Pathways Increase Success in College-Level Math
Dana Center Math Pathways Evaluation: Impact on College-Level Math Pass-Rate, Fall 2015 & Spring 2016 Cohorts
Percent
7.9**
10.8***
Statistical significance levels are indicated as: *** = 1 percent; ** = 5 percent; * = 10 percent.

15. Behavioral Strategies Help Drive Success
11/01/2017
Behavioral Strategies Help Drive Success

16. The Promise of Behavioral Science
Context matters
Actions do not reflect intentions
Human behavior can be predictable
Focus on how people actually make decisions and behave 16

17. Case Study: Encouraging Additional Summer Enrollment
Research finds that students who enroll in summer, especially after their first year, are more likely to:
Persist
Graduate within five years
Summer courses could:
Bridge gap between spring and fall
Mitigate loss of learning
Accelerate time to completion
Recent state and federal policies :
Reinstatement of Third-Term OCOG (Ohio)
Reinstatement of Year-Round Pell
Only ~20% of community college students in Ohio enroll during the summers

18. Behavioral Info Campaign (and Behavioral Info Campaign + Gap Tuition) Increase Summer Enrollment
Both interventions boost summer enrollment rates
Info campaign + gap tuition grant is substantially more effective

19. Text Messages May Support College Enrollment for Adults
11/01/2017
Text Messages May Support College Enrollment for Adults
College Enrollment Steps 
General
Check-ins
Logistical and Life Issues
Build evidence about the effectiveness of text messaging support for the adult population served by Educational Opportunity Centers 19

20. Comprehensive Programs Increase Long-Term Success
11/01/2017
Comprehensive Programs Increase Long-Term Success

21. Comprehensive Services Increases Degree Completion
CUNY ASAP is comprehensive 3-year program, bringing together many promising reforms
Positive and significant impacts on full-time enrollment, persistence, and degree attainment
Nearly doubled the three-year graduation rate (40% versus 22%)
Despite program costs, the cost per degree for ASAP was lower than the control condition

22. Programs based closely on CUNY ASAP
Ohio Program Model
Programs based closely on CUNY ASAP
Student Services
Triage Advising
Tutoring
Career Services
Student Responsibility and Messaging
Enroll Full-time
Take Dev. Ed. Early
Graduate in 3 Years
Course Enrollment
ASAP Seminar
Course Schedules
Early Registration
Financial Supports
Tuition Waiver
Gas/Grocery Card
Textbooks

23. More Students Persist Into 2nd Semester

24. More Students Enroll Full Time

25. Strengthening Promise Programs
Preliminary Confidential Draft

26. Detroit Promise Path Increases Second Semester Enrollment
11.5***
15.0***
Statistical significance levels are indicated as: *** = 1 percent; ** = 5 percent; * = 10 percent.

27. Conclusions
Students face diverse challenges, but there are proven strategies that help.
The strongest programs are comprehensive programs that use multiple strategies, and combine opportunity and obligation.
Acting on the evidence is the next big challenge.