1. Matt Dawson Director, REL Midwest August 2009
Evidence Based Initiatives: Using Data Systems to Improve Education Processes and Outcomes
Matt Dawson
Director, REL Midwest
August 2009

2. Overview View from the Top (Down) Exploring the Possibilities
Learning Point Associates SEC Projects
Overview of the presentation:
Moving the conversation beyond accountability at the state level
View from the

3. “Supposing is good, but finding out is better.” (Mark Twain)

4. State Level Efforts
“Getting the Evidence for Evidence-Based Initiatives”
Available at:

5. DQC Essential ElementsIL IN IA MI MN OH WI
Statewide student identifier X
Student-level enrollment data
Student-level test data
Information on untested students
Statewide teacher identifier with match
Student-level course completion data
Student-level SAT, ACT, and AP exam
Student-level graduation and dropout
K-12 and higher ed. match
State data audit system

6. Exemplary Practices Establishing LDS using unique student ID
Linking data across the system
Developing diagnostics
Using accountability data
Establishing LDS using unique student ID
All states in the Midwest have or are establishing individual level student and/or teacher LDS
All states have received LDS funding from IES
Linking data across the system
Linking students to teachers – not easily done
Ohio value-add
State laws prohibiting
Linking K-12 to post-secondary
Including course taking, course completion, family involvement, school climate)
Including pre-post certification, PD activities
Developing Diagnostics
Dropout (similar to Chicago, Milwaukee early warning systems)
Identify teacher PD practices that lead to improved student achievement
Teacher mobility and attrition
Using accountability data
Identifying schools making progress even if not meeting AYP
Identify how funds are being used and the impact
Supporting continuous assessment
Formative, benchmark , etc. assessment projects

7. Challenges and Constraints
Analytic capacity, staff, and resources
Data burden
FERPA
Analytic Capacity, staff, and resources
Usually staff issues – budget cuts, turnover, training needed, etc.
Data burden
can’t provide resources to districts to get individual level data
absence of legal authority (Indiana)
FERPA
State attorney general interpretation of FERPA
Concerns about ability to return data to districts once processed by the state

8. Beyond Accountability: An Example
where Di = number of FTE teachers needed to meet requirements in a subject area a = proportion of years that the student body is required to take in a given subject xi = average student enrollment in a given school y = class size z = number of periods taught per FTE per day
Collaboration with MSU and MDE
Focused on issue MDE wanted solved, not researchers
Question : Given the new “Merit Curriculum” requirements, are there enough teachers in the core subject areas to meet demand?

9. District Level Needs Sensing
Survey of principals and teachers
More time to use data
More training to interpret test scores
More systematic and relevant information
Training on putting what is learned into practice
Training on working with the data being collected
Over 1400 principals and 1400 teachers interviewed in 2008
Part of larger needs sensing study
More time to use data 93% principals, 89% teachers
Training to interpret test scores 89% principals, 75% teachers
More systematic and relevant information 82% principals 78% teachers
Training on putting data into practice 80% principals 78% teachers
Training on working with data being collected 76% principals 69% teachers

10. District Focus Group Findings
Almost all districts use state assessment data
Few find it useful
Few can link state and district data
Lack of consistency between systems
Few have qualified personnel to make data available and understandable
Almost all districts use state assessment data
Few find it useful
Few can link state and district data
Lack of consistency between systems
Few have qualified personnel to make data available and understandable

11. District Focus Group Findings
Interested in tracking academic growth over time
Interested in measuring teacher value-add
Need easy to understand tools and reports
Data should meet the needs of various audiences
Data should be linked to strategies for improvement
Interested in tracking academic growth over time
Interested in measuring teacher value-add
Need easy to understand tools and reports
Data should meet the needs of various audiences
Data should be linked to strategies for improvement

12. How is your district different?

13. Questions for Districts (and States)
What is the goal?
How will the goal be reached?
Why is that the way to reach the goal?
Inputs (e.g. student demographics, teacher training, etc.)
Outcomes (academic)
Processes (what happens in the classroom)
Attendance and Behavior

14. Reading the Tea Leaves Secretary Duncan John Easton ARRA CPS Link
Duncan Quotes

15. ARRA State Fiscal Stabilization Fund $48.6 billion
Title I, Grants to Local Agencies $10 billion
Title I, School Improvement Grants $3 billion
Ed Technology State Grants $650 million
Individuals with Disabilities Education Act $12.2 billion
Impact Aid Construction $100 million
Vocational Rehabilitation State Grants $540 million
Independent Living Services $140 million
Pell Grants $17.1 billion
Work Study $200 million
Education for Homeless Youth $70 million
Teacher Incentive Fund $200 million
Teacher Quality Enhancement $100 million
Statewide Data Systems $250 million
Race to the Top $4.35 billion
Invest in What Works and Innovation Fund $650 million
Investments range from a measly $100 million to a staggering $48.6 billion

16. ARRA State Fiscal Stabilization Fund $48.6 billion
Title I, Grants to Local Agencies $10 billion
Title I, School Improvement Grants $3 billion
Ed Technology State Grants $650 million
Individuals with Disabilities Education Act $12.2 billion
Impact Aid Construction $100 million
Vocational Rehabilitation State Grants $540 million
Independent Living Services $140 million
Pell Grants $17.1 billion
Work Study $200 million
Education for Homeless Youth $70 million
Teacher Incentive Fund $200 million
Teacher Quality Enhancement $100 million
Statewide Data Systems $250 million
Race to the Top $4.35 billion
Invest in What Works and Innovation Fund $650 million

17. Examples of SEC work by LPA
NY: SEC as part of district audit process
DE: State level project analyzing alignment to standards
OH: Actively working with Ohio for last 5 years
MI: Building capacity for future work
IN: Primarily with districts in corrective action

18. Questions?

19. Matt Dawson
P: F:
1120 East Diehl Road, Suite 200
Naperville, IL
General Information: