1. Points & Rating System Recommendations May 2012 Prepared by Samuel A. Stephens Center for Assessment and Policy Development 1

2. The Charge Recommend points and rating system for QUALITYstarsNY Principles: – Differentiate levels of quality – Be equitable across settings – Allow all settings to demonstrate strengths – Encourage participation – Achieve higher ratings with reasonable effort – Be easily interpreted 2

3. Considerations & Assumptions Stars reflect levels of quality interpreted as: – One star = “meeting minimum standards” – Two stars = “achieving satisfactory quality” – Three stars = “achieving good quality” – Four stars = “achieving very good quality” – Five stars = “achieving excellent quality” 3

4. Minimum Requirements To apply to be in QUALITYstarsNY: – Hold valid current license – Operated/Contracted by public school district – Applicants automatically assigned Star 1 To be rated: – Application for rating/self-study submitted To be at Star 3 or above: – Sufficient points to be provisionally rated at Star 3 level – ERS score of 4.25 or above 4

5. Special Conditions National accreditation: – Be exempted from equivalent standards based on crosswalk between QSNY and accreditation requirements Head Start/Early Head Start: – If in full compliance with Performance Standards, be exempted from equivalent standards 5

6. Special Conditions Sites serving specific population groups or having other special conditions: – Age groups (infants, toddlers, preschoolers) – Children whose home language is not English – Children with special needs Sites with none of these conditions would need to earn the base number of points (290) before ERS points Sites with these conditions would be working toward a greater number of total possible points (up to 310) before ERS points 6

7. Possible Points Total of 360 possible points 290 possible points for all sites, before ERS points Up to 50 possible points based on ERS scores Up to 20 possible points depending on applicable conditions 7

8. Distribution of Points by Category 8

9. Distribution of Points within Categories Same in all settings: – Learning Environment – Management & Leadership Different by setting: – Family Engagement – Qualifications & Experience 9

10. Distribution of Points in Learning Environment Category 10

11. Distribution of Points in Family Engagement Category 11

12. Distribution of Points in Qualifications & Experience Category – Management/Administration 12

13. Distribution of Points in Qualifications & Experience Category – Provider & Assistant/Teaching Staff 13

14. Distribution of Points in Management & Leadership Category 14

15. Conversion of Points to Stars Star One Level – Valid license or operated by public school – Did not apply for rating OR – Less than minimum points in each category (30 points total) Star Two Level – Up to 39% of total possible points without ERS OR – 40% or more of total possible points without ERS but ERS < 4.25 Star Three Level – 40% to 59% of total possible points with ERS and ERS = or > 4.25 Star Four Level – 60% to 84% of total possible points with ERS and ERS = or > 4.25 Star Five Level – 85% of total possible points and above with ERS and ERS = or > 4.2 15

16. Rating Process STEP 2a: Site licensure or public school status is confirmed STEP 1a: Site applies to be assigned a Star 1 rating STEP 3a: If status confirmed, site is assigned to Star 1 level STEP 4: Application for rating is reviewed & number of points in each standards category is computed DECISION POINTS BASED ON REVIEW OF APPLICATION & CALCULATION OF POINTS STEP 1b: Site applies to begin self-study process; provides information to determine which standards apply including accreditation or HS/EHS compliance status Site earns at least minimum points needed in all categories STEP 2b: Site is provided with # points needed at each star level, based on specific conditions OR Site does not earn minimum points needed in all categories STEP 3b: Site submits application for rating with supporting documents Site earns sufficient points for provisional Star 3 level or above Site does not earn sufficient points for provisional Star 3 status or above STEP 5a: Site is assigned to Star 1 level OR STEP 7: Site is assigned to Star 3, 4, or 5 level, based on total points earned STEP 6a: Site develops improvement plans for ERS areas with low scores Site ERS score is 4.25 or higher STEP 5c: Site is assigned to Star 2 level DECISION POINT BASED ON ERS SCORES STEP 5b: ERS observations are conducted at site OR STEP 6b: Site is assigned to Star 2 level Site ERS score is less than 4.25 16

17. Recommended Procedures Application – Confirm licensure status – Confirm total points possible, based on specific conditions – Confirm exempted standards based on accreditation or HS/EHS compliance status Self-study – Compile documentation re standards – Submit evidence of accreditation, HS/EHS compliance if appropriate 17

18. Recommended Procedures Initial review – Determine whether meets minimum points – Determine whether at “provisional” star 3 level Sites at “provisional” star 3 level – Independent ERS observations conducted – Scores computed Sites with ERS score at or above 4.25 – Compute total points, including ERS points – Assign to final star level 18

19. Results from Scenarios If minimum points in one category & minimum ERS points, but maximum points in all others – sites would be rated at Star 4 level If minimum points in one category, but maximum points in all others and maximum ERS points – sites would be rated at Star 4 or Star 5 level, depending on which category received minimum points 19

20. Results from Scenarios If minimum points in one category, 50% points in all others & minimum ERS points – sites would be rated at Star 3 level If 50% points in all categories and any number of ERS points (minimum, midpoint, maximum) – sites would be rated at Star 3 level 20

21. Results from Scenarios Centers earning 85% of possible points in LE + FE + M&L categories, by combinations of staff qualifications: – BA teacher, CDA assistant: Star 5 – AA teacher, CDA assistant: Star 5 – AA teacher, assistant w/ no credentials: Star 4 – Teacher with NYS certificate, assistant w/ no credentials: Star 4 – CDA teacher, assistant w/ no credentials: Star 4 21

22. Results from Scenarios Centers earning 50% of possible points in LE + FE + M&L categories, by combinations of staff qualifications: – BA teacher, CDA assistant: Star 4 – AA teacher, CDA assistant: Star 3 – AA teacher, assistant w/ no credentials: Star 3 – Teacher with NYS certificate, assistant w/ no credentials: Star 3 – CDA teacher, assistant w/ no credentials: Star 3 22