2018 Improving Data, Improving Outcomes Conference Arlington, VA August 2018

Your Data Story: Using Critical Questions to Jumpstart the Data Exploration Process Missy Coffey, DaSy Center Gary Harmon, DaSy Center Jessica deMonsabert, AEM Corporation Kate Grannemann, AEM Corporation

Welcome & Introductions

Agenda Welcome & Introductions A Look Across Fields: Asking Questions & Using Data Activity: Prioritizing Critical Question Topics Exploring Solutions: Using CEDS Align & Connect Wrap-Up

Joining PollEverywhere By phone: Open a new text message to 22333, type DASY, send the message. Online: Enter this URL into your browser: PollEv.com/dasy

PollEverywhere Prompt

Poll Prompt

A Look Across Fields: Asking Questions and Using Data Speaker: Gary

Poll Prompt

Overview of DaSy Critical Questions

What are Critical Questions? Questions that, when answered, provide information in areas deemed most important. Questions a quality state data system should provide the data to answer. Provide information, which when answered, help to improve results for children and families.

About the DaSy Critical Questions Created in 2015 Collaboration Serve as a starting point for further discussions

DaSy Critical Questions: 3 Sections Child- and family-level Practitioner-level Local Early Intervention Services (EIS) program/Local education agency (LEA) level

DaSy Critical Questions: Question Types Essential (Bread and Butter) Questions Aspirational (Mountain Climber) Questions Speaker: Gary

Critical Questions You May Have… What are the characteristics of the practitioners working with children with IFSP/IEPs in general early care and education? 2.A.1 What are the levels of education and years of experience of the general early care and education practitioners working with children with IFSP/IEPs? What is the cost of providing early intervention/early childhood special education services to children and families? 3.C.1 What is the average cost per child for EI/ECSE services statewide? For each EIS program/LEA?

Asking MORE Questions: An Example from the Maternal and Child Health Field

Title V Health Data: Key Topics The Association of Maternal and Child Health Programs (AMCHP) wanted to identify and answer key questions related to Title V health data. Topics of interest: Developmental Screening Autism Community-Based Services

Title V Health Data: Key Questions Developmental Screening How many children birth through age 5 are receiving a developmental screening using a parent-completed screening tool? How many children birth through age 5 are achieving five-domain developmental health as demonstrated by a parent-completed developmental screening results? Source: AMCHP Title V Data Integration Toolkit

Title V Health Data: Key Questions Autism How many children birth through age 5 have a documented autism diagnosis? What percentage of children birth through age 5 were diagnosed with autism based on a referral as a result of a screening or assessment? Of the children diagnosed with autism, what percentage are receiving IDEA Part C services? What percentage are receiving IDEA Part B services? Source: AMCHP Title V Data Integration Toolkit

Title V Health Data: Key Questions Community-Based Services Which programs and services are children birth through age 5 receiving? What percentage of children birth through age 5 received a referral to any community service or program? Source: AMCHP Title V Data Integration Toolkit

Answering Key Questions: ECIDS Collects, integrates, maintains, stores, and reports information from early childhood programs Crosses multiple agencies within a state that serve children and families from birth to age 8 Includes data on the individual child, the child’s family, the classroom, the program/providers, and other services that provide comprehensive care and education for young children (What is an ECIDS, NCES 2014)

Poll Prompt

Why are states creating ECIDS? Articulate access and availability Distinct count of children Sequence of programs and services for children Investments in Early Childhood programs Demonstrate cross-program decision-making Transitions School readiness Child and family outcomes State and federal reporting requirements (Shift from compliance) Updated Head Start Program Performance Standards IDEA Part C and Part B State Systemic Improvement Plans

Integrating Health Data States are looking to integrate health data into integrated data systems Operational or key instructional program data systems are NOT replaced Organizational data can be leveraged to improve insights, policymaking, program management, and resource investments

The Toolkit Overview of ECIDS Value of integrating and sharing Title V data Tip Sheets Use Cases State examples Available here.

The Use Cases Essential Title V questions needing integrated data to answer Suggested data elements that align to CEDS Example analysis and data visualization Possible actions based on data Topics Developmental Screening Autism Community-Based Services

Walk-Through of DaSy Critical Questions Analysis Plans

DaSy CQ Analysis Plans In development for Question 1.B (expected release Summer 2018) Step-by-step process Preparing the data set Data elements needed Setting up and conducting analysis Data Tables and Visualizations

DaSy CQ Analysis Plans

DaSy CQ Analysis Plans

DaSy CQ Analysis Plans

DaSy CQ Analysis Plans

Activity: Prioritizing Critical Question Topics

Critical Questions Activity At each table, review the subset of critical questions. Identify the top 2-3 broad questions (those in the green boxes) that are a priority for your role/program. Write the question “code” (e.g., 1.A.1) on the provided sticky notes. Designate one table representative who will share back your top 2 -3 questions.

Table Share-Back In 2 – 3 minutes, have your designated table representative: Share with the large group the top 2-3 broad questions that are priorities for the folks at your table. Provide your sticky note for the wall charts

Exploring Solutions: Using CEDS Align & Connect

Poll Prompt

What is CEDS? What is CEDS? Education Data Management Initiative

What is CEDS? (continued) Education Data Management Initiative Data Standard Element Definition Option set Domain Entity

What is CEDS? (continued) Education Data Management Initiative Data Standard Data Management Tool Set | Align

What is CEDS? (continued) Education Data Management Initiative Data Standard Data Management Tool Set | Connect

Using CEDS Using CEDS to Develop Answers Import Data Dictionaries Align to CEDS Compare with Others Analyze data

Using CEDS (continued) Using CEDS to Develop Answers Answer policy questions Calculate metrics and indicators Address reporting requirements

CEDS myConnect

CEDS myConnect

Activity: Finding CEDS Connections Go to ceds.ed.gov Under “Tools” in the toolbar, click “Connect” Click “Find Existing Connection” Select a category, use the search engine, or check out featured connections to identify a question of interest to you

Next Steps When you return to your agency identify or gather the list of critical questions. Feel free to build from the examples provided by DaSy. Once available, use the analysis plans to guide you through analyzing, reviewing, and presenting your data. Use the similar examples in the AMCHP Data Integration Toolkit to inform your work. Check out other examples in CEDS Connect.

Wrap-Up

Key Resources DaSy Critical Questions: http://dasycenter.org/resources/critical-questions/ AMCHP Title V Data Integration Toolkit: http://www.amchp.org/programsandtopics/CYSHCN/projects/spharc/ChildhoodDevelopmentToolkit/Pages/Title-V-Early-Childhood-Data-Integration-Toolkit.aspx Common Education Data Standards: https://ceds.ed.gov/

Acknowledgment The contents of this presentation were developed under a grant from the U.S. Department of Education, # H373Z120002. However, those contents do not necessarily represent the policy of the U.S. Department of Education, and you should not assume endorsement by the Federal Government. Project Officers, Meredith Miceli and Richelle Davis. Instructions to presenters: This slide is to be included as the last slide in your deck but you are not expected to show it to the audience. Please be sure to delete these instructions from this slide’s notes page in your presentation.