1. ies.ed.gov Connecting Research, Policy and Practice Kristen Rhoads, Ph.D. National Center for Special Education Research Presentation to Single-Case Intervention Design and Analysis Institute Madison, WI Kristen.Rhoads@ed.gov Single Case Designs and IES

2. ies.ed.gov Organizational Structure of IES 2 National Board for Education Sciences Standards & Review Office Office of the Director National Center for Education Evaluation National Center for Education Statistics National Center for Education Research National Center for Special Education Research

3. ies.ed.gov IES Grant Programs: Research Objectives Develop or identify education interventions (practices, programs, policies, and approaches) – that enhance academic achievement – that can be widely deployed Identify what does not work and thereby encourage innovation and further research Understand the processes that underlie the effectiveness of education interventions and the variation in their effectiveness 3

4. ies.ed.gov Recent SCD Efforts at IES What Works Clearinghouse SCD Study Design Standards (http://ies.ed.gov/ncee/wwc/)http://ies.ed.gov/ncee/wwc/ Methodological research grants focused on SCD Technical Work Group on SCD Increased focus on SCD in recent Request for Applications Technical papers on SCD (in progress) SCD Summer Training Institute

5. ies.ed.gov IES Goals for SCD Summer Training Institute Build national capacity for conducting SCD Improve the quality and scientific credibility of SCD

6. ies.ed.gov FY 2015 Research Grant Programs Education Research Programs (84.305A) Special Education Research Programs (84.324A) 6

7. ies.ed.gov Education Research Topics (84.305A) Cognition and Student Learning Early Learning Programs and Policies Education Technology Effective Teachers & Effective Teaching English Learners Improving Education Systems: Policies, Organization, Management, and Leadership Mathematics and Science Education Postsecondary and Adult Education Reading and Writing Social and Behavioral Context for Academic Learning 7

8. ies.ed.gov Special Education Research Topics (84.324A) Autism Spectrum Disorders Cognition and Student Learning in Special Education Early Intervention and Early Learning in Special Education Families of Children with Disabilities Mathematics and Science Education Professional Development for Teachers and Related Service Providers Reading, Writing, and Language Development Social and Behavioral Outcomes to Support Learning Special Education Policy, Finance, and Systems Technology for Special Education Transition Outcomes for Secondary Students with Disabilities 8

9. ies.ed.gov Research Goals Exploration Development & Innovation Efficacy & Replication Effectiveness Measurement 9

10. ies.ed.gov IES Grant Programs: Research Objectives Develop or identify education interventions (practices, programs, policies, and approaches) – that enhance academic achievement – that can be widely deployed Development (Iterative development process, promise evaluation) Efficacy (Efficacy testing, Complement group design) Effectiveness (Complement group design) 10

11. ies.ed.gov IES Grant Programs: Research Objectives Identify what does not work and thereby encourage innovation and further research Efficacy (Efficacy testing, Complement group design) Effectiveness (Complement group design) Development (Iterative development process, promise evaluation) 11

12. ies.ed.gov IES Grant Programs: Research Objectives Understand the processes that underlie the effectiveness of education interventions and the variation in their effectiveness Efficacy (Efficacy testing, Complement group design) Effectiveness (Complement group design) Exploration (Complement research design, meta- analytic work that includes SCDs) 12

13. ies.ed.gov Research Training Program in Special Education: Early Career Development and Mentoring (84.324B) Develop and maintain a strong cadre of independent researchers addressing the needs of infants, toddlers, children, and youth with disabilities, and their families and teachers Support for an integrated research and career development plan for investigators in the early stages of their academic careers

14. ies.ed.gov Statistical & Research Methodology in Education (84.305D) Research projects intended to expand and improve the methodological and statistical tools available for education researchers These tools will be used to improve the design of research studies, analysis of research data, and interpretation of research findings The topic has an early career option. 14

15. ies.ed.gov Reviewer Comments: The Good The combined use of SCD and group design is innovative and arguably will provide richer information on the response of students as they progress through the intervention.

16. ies.ed.gov Reviewer Comments: The Bad There are insufficient details to determine if the study meets the WWC standards. Lack of information about: – Sample identification, selection, and number of cases – Settings – Number of data points per phase – Establishing baseline – Measures, data collection, and analysis, including coding and determining inter-rater reliability

17. ies.ed.gov Reviewer Comments: The Ugly Further justification for the design is needed. The link between the design and research questions needs to be clearer. It’s not clear how the design will answer the research questions. The design does not match the intervention or proposed hypotheses. There appears to be little expertise in single- case design on the research team.

18. ies.ed.gov Questions? Kristen.Rhoads@ed.gov