1. QRIS Validation Study Massachusetts Quality Rating and Improvement System Presentation to EEC Board March 11, 2014

2. Study Redesign New lead researcher Accommodates timeline changes Incorporates feedback from state and federal advisory members, EEC, and early education experts Redesigned study positively received by the US DOE advisory and technical assistance providers Meets federal validation objectives for Race to the Top Early Learning Challenge States, as well as EEC’s objective to gather valuable insight to inform system improvement, policy, and technical assistance. 2

3. 3 Validation Study Objectives Federal objectives Validate whether QRIS tiers reflect differential levels of program quality Assess the extent to which changes in ratings are related to children’s learning and development What will EEC better understand? Does the QRIS discern levels of quality? What revisions to QRIS or its standards may be warranted? What types of technical assistance, outreach, and supports for programs are needed? What are the connections between QRIS and child development outcomes?

4. 4 Key Changes from October 2012 Plan Research design examines and compares all QRIS levels individually (i.e., Level 1 vs. 2 vs. 3 vs. 4) Study sample reflects a statewide representation of programs Center- and school-based programs will be included. Family- based providers part of the formative research phase currently underway Child assessment measures have been changed Updated research questions, sample design, and data analysis plan

5. 5 Study Timeline and Measures Sample Target Fall 2014Spring 2015 Program Quality Measures ERS Observations 120 preschool and 72 infant/toddler classrooms X Director Interviews120 programsX Teacher Interviews192 classroomsX Child Outcomes Measures Direct Assessment480 preschool childrenXX Teacher Child Ratings 700 preschool and toddler children XX * Please see 3-page summary of QRIS Validation Study for more detailed description of specific study measures

6. 66 For additional information, please contact: Lonnie Kaufman Senior Research Manager Applied Research and Program Evaluation email: lkaufman@donahue.umassp.edu phone: 413-587-2419 Joanne Roberts, Ph.D. Senior Research Scientist Wellesley Centers for Women email: jroberts@wellesley.edu phone: 781-283-2559