1. 1 DDOE Education Insight Dashboard Implementation Project 25 th Annual STATS-DC 2012 Data Conference July 13, 2012

2. 2 Zero to Dashboard in 15 Months Introductions Project Background Going Further Faster Next Steps Q & A

3. 3 Who we are Reese Robinson o Delaware Department of Education o Education Insight Project Manager Lori Fey o Michael & Susan Dell Foundation o Director – Ed-Fi Initiative Eddie Parker o Otis Educational Systems (OtisEd) o Founder & CEO

4. 4 RTTT Project Aimed at Ambitious Targets K-12 data is increasingly important ●Federal mandates ●Management – Data-driven decisionmaking DOE Targets (RT 3 ) ●90% of students will graduate by 2013-2014 ●100% will meet standard on state math and reading exams by 2013-2014 How do we close the gap?

5. 5 Specific Focus on Equipping Educators with Meaningful Data to Help Students Help educators find students who: Are not “getting it” (DCAS, grades) Are unavailable to learn (absent) Have other issues (conduct, special needs)

6. 6 Series of Education Insight Projects Required to Meet Goals Infrastructure Single Sign On Portal Microsoft – Forefront Identity Management Longitudinal Data Warehouse Otis Educational Systems - iMart Performance Management Dashboard Michael & Susan Dell Foundation – Ed-Fi

7. 7 Project Timelines Posed Significant Challenge April 2012 Pilot April 2011 Contract Dec RFP Sept RFI July 2010 Funding

8. 8 Insight Dashboard Preparation Process Documentation Review System Inventory Market Review LEA Interviews Findings: Many Existing Systems, Many Potential Providers Request For Information: 26 Responses Selected Ed-Fi standard for data structure and dashboards Request for Proposal o Data Warehouse: ESP Solutions Group / OtisEd o Dashboard Design: Wireless Generation / Double Line Partners July 2010 – April 2011

9. 9 Ed-Fi Leverages Existing Data for New Uses Extensive documentation o Interface, Database, Metrics, Data Exchange Research-based Well received Consistent with RT 3 philosophy Public domain Growing adoption by states and districts o States of Arkansas, Colorado, Kansas, Texas o Little Rock School District Adopted for the Strategic Learning Collaborative (SLC) o Piloted with Colorado, Georgia, Illinois, Massachusetts, New York, North Carolina Ed-Fi includes: Open data standard Collection of best practice metrics Dashboard source code Ed-Fi includes: Open data standard Collection of best practice metrics Dashboard source code

10. 10 Architecture

11. 11 Data Flow eSchool Master DCAS DIBELS College Board Source Data Extract Transform Load OLDS Load SLDS Warehouse Extract Load Ed-Fi Generate Metrics Build Dashboards Dashboard 11 26,000,000 Records Evaluated Nightly 6-7 Hours

12. 12 Insight Dashboard Designed to Meet RTTT Goals Collection of research-based metrics (33) o Predictive of education outcomes Integrated from multiple sources o eSchool, DCAS, DIBELS… Focused on students o Class, School, District rollups Along with student characteristics o Contacts, Program Indicators Designed by and for Teachers 12

13. 13 How was it Developed? Teacher’s Insight Dashboard 1.0 Delaware Focus Groups Texas Dashboards District Planning Sessions 13 45 Individuals All Districts 4 Charter Schools 70 Student Metrics 200 Aggregate or Rollup Metrics 11 Focus Groups 175 Participants ― 122 Teachers ― 4 Principals ― 49 Admin

14. 14 Stakeholder Workshop Review Three stakeholder engagement workshops were conducted in June 2011. June 20, 2011 Glasgow HS 84 participants June 22, 2011 Polytech HS 55 participants June 23, 2011 Sussex Tech HS 36 participants 175 people attended the stakeholder workshops 122 Classroom Teachers 4 Principals 49 Other Administration 11 Breakout Sessions with 4 stakeholder groups Elementary Teachers Middle School Teachers High School Teachers Principals, Counselors, and other Administrative personnel (sometimes as part of teacher breakout sessions)

15. 15 Stakeholder Survey Feedback Feedback from the Workshop participants was overwhelmingly positive.

16. 16 Several key factors enabled DDOE to get further, faster Single IIS system with nightly data feeds RTTT funds and momentum Flexible management, minimal bureaucracy, exceptional leadership support Fortunate environment Adopted widely used standards Liberally used Ed-Fi and iMart Extensively researched K-12 architectures and other states’ work Leverage Implemented new approaches to development projects Actively collaborated with vendors Embraced change

17. 17 Leveraging Others’ Work Accelerated Development Ed-Fi Tools o Data standard already created o Metrics research already synthesized and well-documented o Operational dashboard source code dramatically cut development time Stakeholder Engagement Model from Texas o Metrics prioritized by Delaware educators o Built awareness and buy-in iMart Data Warehouse o OTS product with dimensional model and K12 operational process o Easily extensible o Low cost of ownership o Self-Sufficiency with Knowledge Transfer to DDOE staff

18. 18 Embracing Change Eliminated Common Pitfalls Adopting Standards o Provided common ‘language’ o Minimized design confusion and unnecessary development Agile Management o ‘TimeBox’ development approach was key to meeting deadlines o Executives minimized bureaucracy Specific Development Team Strategies o Mentoring o Pair-programming o Code reading and review o Regular code walkthroughs o Review of artifacts o Question and answer

19. 19 Metric Focus Metrics Research Based Prioritized by Stakeholders Example: Reading Proficiency (Scale Score, Subject, Proficiency Level) Ed-Fi Domains Standards Example: Student Assessment iMart Educational ‘Facts’ Dimensions Example: Student Result Summary Source eSchool Student Information External and Longitudinal Data Example: AIR Assessment

20. 20 Ed-Fi Provided Powerful, Free Accelerators Ed-Fi Core 1.2 Delaware Insight Dashboard extensions maintain compatibility with Ed-Fi Core if/as it is modified Ed-Fi Core 1.3 Texas Student Data System dashboard code developed into publicly licensable Ed-Fi tool suite DDOE licensed Ed-Fi tool suite free Implementation of Ed-Fi allows for extensibility (customization) for Delaware presentation and unique metrics Ed-Fi core schema will evolve over time, but will still be compatible with Delaware implementation as long as extensibility points are only areas of customization Texas Student Data System dashboard code developed into publicly licensable Ed-Fi tool suite DDOE licensed Ed-Fi tool suite free Implementation of Ed-Fi allows for extensibility (customization) for Delaware presentation and unique metrics Ed-Fi core schema will evolve over time, but will still be compatible with Delaware implementation as long as extensibility points are only areas of customization Future Ed-Fi Core releases

21. 21 © 2012 Michael & Susan Dell Foundation Ed-Fi Footprint is Growing Total US students 49.4M Total US teachers 3.2M 19% of students 19.5% of teachers 34% of students 36% of teachers Momentum of State Adoption Creates Further Opportunities for Leverage

22. 22 Scope of iMart to Mapping Process Moving data from iMart Data Warehouse to Ed-Fi Operational Data Store Tables o Source Tables Used to read data: 65 o Target tables loaded:  105 Type Tables (Code Tables)  84 Maps (Ed-Fi Target Tables) 14 packages or modules 95 ETL jobs Data points o 600 columns loaded of 84 Ed-Fi Tables o 135,000 unique Current Year enrolled students processed o 26,575,792 Records processed (Most of them are only Current year records) This does not include the source mapping to the Data Warehouse (iMart)

23. 23 Data Mapping and Import Process Available data Dashboard requirements Design Insight data warehouse eSchool Master Quality Assured Data Sets External Data Sets Strawman Metrics Stakeholder Feedback Research & Best Practices Ed-Fi Standard

24. 24 Insight Dashboard Project Timeline 201120122013 Release 1.0 Interim Teacher Dashboard Development Stakeholder engagement 4/1/11 Release 2.0 Teacher (expansion), Principal, Administrator, DOE Dashboards 4/1 Release 3.0 and beyond Expansion, refinement, and support for additional Stakeholders 6/30/137/110/1 Phased release Pilot districts Other districts

25. 25 Q & A Lori.Fey@msdf.org www.ed-fi.org Zeynep@doublelinepartners.com www.doublelinepartners.com Eddie.Parker@OtisEd.com www.OtisEd.com