1. Massachusetts Quality Rating and Improvement System

2. Quality Rating and Improvement System: What is it? 2 “A Quality Rating & Improvement System (QRIS) is a method to assess, define, and communicate the level of quality in early care & education and after-school settings. QRIS are systemic, addressing multiple aspects of early care and education and out - of -school time programs through a uniform approach that is available statewide. QRIS are similar to other consumer rating systems, in that they "rate" goods or services to provide customers with a better understanding about the quality of that item.” Stairsteps to Quality, Anne W. Mitchell (2005)

3. Purposes of the Massachusetts QRIS Programs and providers use one streamlined set of standards that are connected to supports and fiscal incentives to help them meet and maintain the standards. Programs receive feedback and are involved in continuous quality improvement. Parents have easily accessible information about the quality of early care and education programs. Policymakers understand where and how to invest additional resources. High-quality early education and care and out of school opportunities are available throughout the Commonwealth that demonstrate improved outcomes for children. 3

4. The Massachusetts QRIS a voluntary system an opportunity available to all programs that are part of the Commonwealth’s mixed delivery system, which includes child care centers public preschool programs private school preschool and kindergarten family child care homes after school and out-of-school time programs Head Start programs Is linked to Educator and Provider Supports, professional development, mentoring, technical assistance and training opportunities Is a way of demonstrating and supporting quality that is above and beyond licensing requirements 4

5. 5 Review QRIS Standards for QRIS Program Type Start QRIS Application & Self-Assessment (QPM) Update Professional Qualifications Registry (PQR) Prepare & Complete QRIS Documentation Submit QRIS Application & Self Assessment (QPM) Send Summary Profile & related documents to EEC (MAIL) EEC Reviews and Verifies QRIS & PQR Information EEC works with programs to schedules ERS Reliable Rater Visit (Level 3+) Program Receives QRIS Rating Program Reviews Results & Update Plan for Quality Improvements Continue to Implement Quality Improvements QRIS Process for continuous quality improvements

6. Center-based/ School-Based Programs For use by center-based and school-based programs, including license-exempt center-based programs (i.e. public school preschools, Montessori schools, or faith-based affiliated programs serving infants, toddlers, preschool-age children). Family Child Care For use by Family Child Care homes Afterschool/Out of School Time Programs For use by After School and Out of School Time programs, serving school-age children and youth (kindergarten and up) outside of the hours of the regular school day. Programs may be located on public school premises. 6 There are QRIS Standards for Each QRIS Program Type

7. MA QRIS Standards are organized in 5 Categories with Subcategories 1.Curriculum and Learning: 1A. Curriculum, Assessment, and Diversity 1B. Teacher- Child Interactions 2.Safe, Healthy Indoor and outdoor Environments: 2A. Safe, Healthy Indoor and outdoor Environments 3.Workforce Qualifications and Professional Development: 3A. Program Administrators 3B. Program Staff/Educators 4.Family and Community Engagement 4A. Family and Community Engagement 5.Leadership, Management and Administration: 5A. Leadership, Management, and Administration 5B. Supervision 7

8. The QRIS Standards are also organized in levels 8 “Levels”: There are presently four levels in the QRIS Standards. Each program will need to meet all requirements of the standards in the proceeding level before advancing to the next level. “Meet Requirements of Level 1 Plus” A fifth level that builds connections between program quality, educator quality and positive outcomes for children is forthcoming.

9. 9 Level 1 1A.1.1 Meets Licensing regulations or non- licensable or license exempt and meets EEC licensing requirements. Level 2 1A.2.1 Educators demonstrate completion of professional development in curriculum, screening tools, and formative assessment. 1A.2.2 Materials reflect the language and culture of the children in the classroom, their communities, and represent the diversity of society. Level 3 1A.3.1 Staff include parental input in the progress reports. 1A.3.2 Staff has received formal professional development in the curriculum; using the MA Guidelines for Preschool Learning Standards or Infant / Toddler Learning; documenting children's progress; and working with children from diverse languages and cultures and second language acquisition. 1A.3.3 Program uses screening tools, progress reports, formative assessments, and information gathered through observation to set goals for individual children across all developmental domains. 1A.3.4 Staff demonstrate language and literacy skills either in English or the child's language that provide a model for children. Level 4 1A.4.1 Program uses a curriculum that is aligned with MA guidelines for Preschool Learning Standards and the Infant/ Toddler Learning Guidelines. 1A.4.2 Program uses progress reports, appropriate screening tools, formative assessments, and information gathered through observation to inform curriculum planning, and use results to monitor each child’s progress across developmental domains, and inform program decision-making (e.g. curriculum content, strategies for improved staff implementation, and professional development. Category 1: Curriculum & Learning Subcategory: 1A Curriculum, Assessment, and Diversity Example of Center/Based School Based QRIS Standards

10. QRIS Levels and Standard Criteria QRIS Standard: This is the criteria that programs must meet. These indicators of program quality are grounded in research and identified as best practice (used in other state’s QRIS, and/or identified MA stakeholders. In the QRIS Program Manager, the standards are organized and numbered as follows: ( Subcategory. Level. Standard Criteria #) 10 1A.2.1 Educators demonstrate completion of professional development in curriculum, screening tools, and formative assessment.

11. Sample: QRIS Application & Self Assessment Reference 11

12. QRIS Measurement Tools: Environment Rating Scales ITERS-R is designed to assess center-based child care programs for infants and toddlers up to 30 months of age. Also available Spanish. Infant/Toddler Environment Rating Scale, Revised Edition ECERS-R is designed to assess group programs for children of preschool through kindergarten age, 2½ through 5. Expanded score sheet and additional notes improve accuracy in scoring. Also available Spanish. Early Childhood Environment Rating Scale, Revised Edition FCCERS-R is designed to assess family child care programs conducted in a provider's home for children from infancy through school-age. This resource is also available Spanish. Family Child Care Environment Rating Scale, Revised Edition SACERS is a scale designed to assess group-care programs for children of school age, 5 to 12. It contains full instructions for using the scale, a training guide, and notes clarifying selected items are also included. The School-Age Care Environment Rating Scale 12 http://ers.fpg.unc.edu

13. QRIS Measurement Tools (Cont.) PAS is a reliable and easy-to-administer tool designed to assess quality in ten areas: human resources development, personnel cost and allocation, center operations, child assessment, fiscal management, program planning and evaluation, family partnerships, marketing and public relations, technology, and staff qualifications. Program Administration Scale (Center- School based) BAS is a reliable tool for measuring the overall quality of business and professional practices in family child care settings. When used with FCCERS- R these instruments provide a comprehensive picture of the quality of the family child care learning environment and the business practices that support the program. Business Administration Scale Family Childcare APT is designed for programs serving children from kindergarten through middle school. It includes two tools. The APT Observation Tool (APT O) focuses on observable program practices; and the APT Program Questionnaire (APT Q), a self-assessment tool which examines other aspects of program quality,such as program planning and connections with schools and parents. The Assessing Afterschool Program Practices Tool 13 For More Info about APT: http://www.niost.org/content/view/1652/282/ http://www.niost.org/content/view/1652/282/ For More Info about PAS and BAS http://cecl.nl.edu/evaluation/pas.htm http://cecl.nl.edu/evaluation/pas.htm

14. QRIS Measurement Tools (Cont.) The 26-item Arnett-Caregiver Interaction Scale can be used without modification in both center and home-based settings. The items measure the emotional tone, discipline style, and responsiveness of the caregiver in the classroom. Available for Download from EEC’s Website Arnett -Caregiver Interaction Scale (Arnett-CIS) The CLASS is a tool for observing and assessing the qualities of interactions among teachers and children in classrooms. It measures the emotional, organizational, and instructional supports provided by teachers that are known from research to contribute to children’s social development and academic achievement. The Classroom Assessment Scoring System (CLASS) Strengthening Families Self-Assessment offers tools to help programs make small but significant changes in their day-to-day practice to build Protective Factors with families. Strengthening Families Program Self Assessment is should be used by all programs participating in QRIS at Level 2. Strengthening Families Self-Assessment 14 For More Info about CLASS http://www.teachstone.org/ http://www.teachstone.org/ For more Info about the Strengthening Families Self Assessment Tools:http://www.strengtheningfamilies.net/index.php/online_resources/g uide_assess/category/self_assessment/http://www.strengtheningfamilies.net/index.php/online_resources/g uide_assess/category/self_assessment/

15. QRIS Measurement Tools: Environment Rating Scales The Environment Rating Scales are required by all QRIS participants regardless of program type or accreditation status to ensure consistency among the measurement tools used across the mixed delivery system. All programs participating in QRIS are required to complete the appropriate ERS tool for each classroom/group setting as a self-assessment for Level 2. ERS self-assessment must be conducted within 12 months of the QRIS Application submission date. For Level 3 and above, programs will need to request an outside reliable raters visit with their QRIS Application. 15

16. Providing Supporting Documentation: To demonstrate that programs meet the measurements Measurement Tools and Scores: ERS, PAS, BAS, APT, and CLASS are reported directly in QRIS Program Manager using the “Add Document – Measurement Tool” for EEC verification. Evidence in PQ Registry: Several of the QRIS Standards require that programs demonstrate that the program administrator and educators working at each program meet specific qualifications, work experience, and have professional development and/or training in certain topics. This information should all be documented in the Professional Qualifications Registry (PQR) and will be reviewed by EEC as part of the QRIS Application & Self-Assessment. 16

17. QRIS Documentation Required Documentation: Materials that will be reviewed by EEC as “evidence” of meeting the Standard/ Measurement. This documentation is submitted in hardcopy with the QRIS Application Summary Profile (PDF). Head Start Documentation: QRIS standards are aligned to specified Head Start Performance Standards. Programs provide a official documentation of their current Head Start program status. National Accreditation Documentation QRIS standards are aligned to specific national accreditation standards. Programs provide a copy of their current accreditation certificate. National Association for the Education of Young Children (NAEYC) National Accreditation for Family Child Care (NAFCC) Council of Accreditation for Afterschool Programs. (COA) 17

18. These documents are for reference only QRIS Application and Self Assessment References These documents outline the QRIS Standards, measurement methods, documentation types and titles that can be used to assist programs in responding to questions in the QRIS Program Manager Online Application and Self Assessment

19. 19 1 2 3 4 6 7 5 QRIS Program Manager (QPM) is the web-based interface used by programs to start a QRIS program application and to self-assess their own level of quality. EEC uses QPM to manage the QRIS Rating verification process Start QRIS Application & Self-Assessment (QPM)

20. QRIS Participation Data 20

21. QRIS Application Status By Region 21 *As of May 5. 2011 Application Status QRIS Program Type Central MA Metro Metro Boston Northeast Southeast & Cape Western MA Grand Total Draft After School/Out of School Time 9272019315 93 Center/School Based 327450666858 348 Family Child Care10017691826032 460 141118139267131105901 Final - Submitted to EEC After School/Out of School Time 183632443430 194 Center/School Based 5369817210692 473 Family Child Care115501081297039 511 186155221245210161 1178 Grand Total 3272733605123412662079

22. Final QRIS Applications Received by Region and Self-Assessed Levels* 22 *As of May 5, 2011 Programs Self- Assessed Level Central MA Metro Metro Boston North East Southeast and Cape Western MA Grand Total Level 11631262002191861471041 Level 21516 23 13106 Level 3759122 Level 412115 Grand Total 1851482272432101611174

23. QRIS Program Quality Improvement Grant 23

24. FY11 QRIS Program Quality Improvement Grants Together for Quality (T4Q) QRIS Foundational Training: Trainings designed to assist programs in QRIS grant application process were provided in each EEC region by the CAYL Institute. QRIS Program Quality Improvement Grants: The United Way issued the request for proposals (RFPs) and is overseeing the administration, implementation, and evaluation of grants. $2.82 million is currently being awarded to selected grantees. T4Q Field Coach Program (Wheelock): A select number of grantees that indicated interest through their grant application to provide technical assistance and mentoring support. Trained field coaches will provide mentoring and content-focused consultation to programs in professional development, curriculum and instruction, child assessment, and/or program management. 24

25. FY11 QRIS Program Quality Improvement Grants Over 900 programs and educators applied for funding through this RFP, requesting over $7.7 million in grants. In total, $2,820,000 in funding was awarded to 416 programs and educators Commonwealth. Awards were made in all EEC Regions and to all three QRIS program types; After School/Out of School Time, Center and School Based, and Family Child Care. ~ 46% of the programs that applied received FY11 QRIS Program Quality Improvement Grant Awards 47% Family Child Care 42% After School/ Out of School Time programs 42% Center/ School Based programs 25

26. 26

27. FY11 QRIS Program Quality Improvement Grants Award Determinations Programs may not have been awarded funding for the following reasons: A high number of proposals from a program type may have been submitted in the region and it was not possible to fund them all. The proposal scored low on the criteria in the scoring rubric in the RFP. Frequent reasons for low scores included: requested funding for items that are not allowable, contained expenditures that began or end outside of the grant period did not provide adequate narrative little or no alignment between the program improvement plan in the QRIS Summary and proposed expenditures or were linked to a standard already met via self-assessment; this would not support a program in moving towards the next level of the QRIS. Did not submit all required grant supporting documents as directed in the RFP and clarified in the Q&A documents, or submitted documents that were substantially incomplete or incorrect. 27