A Registry of Efficacy & Effectiveness Studies Supported under grant IES R305U150001 to the Society for Research on Educational Effectiveness Jessaca Spybrook, Western Michigan University jessaca.spybrook@wmich.edu Rebecca Maynard, University of Pennsylvania rmaynard@upenn.edu March 2, 2017
Talking Points Why a registry for education studies? The Registry of Efficacy and Effectiveness Studies (REES) What’s next?
1. Why a registry for education studies?
A sampling of existing registries Medicine – National Institutes of Health Clinicaltrials.gov Economics & other Social Sciences – American Economic Association (AEA) RCT Registry Governance, Politics, and Institutions – Evidence in Governance and Politics (EGAP) International Development – The Registry for International Development Impact Evaluations (RIDIE)
Commonalties & differences Common goals Information sharing Transparency Accountability Disciplinary distinctions Norms Languages Standards Existing infrastructures Vision and goals for a registry Registration requirements
A Registry specific to education studies Build on lessons from other disciplines Create a reliable source for identifying all causal inference studies in education Build on & articulate with existing infrastructures in education (i.e., WWC, common evidence guidelines & grant guidelines) Language familiar to education researchers Norms and standards used for efficacy & effectiveness studies
2. A Registry of Efficacy & Effectiveness Studies (REES)
Registry of Efficacy & Effectiveness Studies (REES) Repository of information on causal inference studies Efficacy & effectiveness studies RCTs & QEDs Planning phase, in-process & completed studies Chronicle changes & add products Project leadership Study plans Sample & data Reports Low burden for evaluators Easy to navigate Quick to complete Structured response codes (when possible)
What is in REES? 8 Sections – Basic information & analysis plan General Study Information Description of Study Research Questions Study Design Sample Characteristics Outcomes Analysis Plans Additional Materials (e.g., instruments, reports, data & code)
REES Output Uses Content Unique registration ID PDF of registration & changes Searchable & exportable database By intervention type, grades, design type, etc. Uses Quick identification of completed & in-process studies Facilitate replication, research synthesis
3. What’s Next?
Status of REES Completing development Pilot registrations New studies In-process studies Completed studies (imported from existing review platforms) Refine REES based on pilot Launch REES late 2017
Promoting REES Permanent ID/Badge Collaborate with: Funders Professional Associations Journals Clearinghouses
To volunteer to pilot REES: REES Website www.sree.org/pages/registry.php To volunteer to pilot REES: contact@sreereg.org Additional Questions: Jessaca.spybrook@wmich.edu
Clinical Trials.gov
AEA RCT Registry
EGAP
RIDIE