1. Composite Index Scores (CIS) Understanding Accountability for Strategic Goal Setting August 24, 2015 Andrew Milligan | RIDE Office of Transformation

2. Objectives Firm up a technical understanding of the current Composite Index Score (CIS) and how it informs school improvement planning in general, and goal setting in particular Understand the impact of the PARCC transition on the CIS and planning for the future

3. Agenda 1.(Re)-Introduction to the CIS – 5 min 2.Deeper Dive a)Proficiency & work-time – 12 min b)Gaps & work-time – 12 min c)Growth & work-time – 8 min d)Graduation– 8 min 3.Questions – 15 min

4. Exit Criteria Priority: – Achieve 50+ points on CIS for 3 consecutive years – Or meet 80% of AMOs for 3 consecutive years Focus – Achieve 50+ points of CIS for 2 consecutive years – Or meet 80% of AMOs for 2 consecutive years (50 is equivalent to a classification of “Typical”)

5. What You Probably Already Know All schools will be assigned a composite index score between 20 and 100. MeasureDefinition Elementary / Middle Schools High Schools Absolute Percent Proficient How many students have attained proficiency or better? 30 points Progress To 2017 Target Is the school approaching its 2017 targets? 10 points Achievement Gaps Is the school serving all students, including those with disabilities and English Learners? 30 points Percent of Students at Distinction Level How many students have attained distinction? 5 points Growth Are all students making progress? 25 pointsn/a HS Graduation Rates Is the school reaching its graduation-rate goals? n/a 20 points High School Scaled Score Is the school improving annually? n/a 5 TOTAL 100 possible points

6. What about PARCC? The transition to PARCC this year will have minor changes to the CIS for 2014-15: MeasureNECAPPARCC (E/M)PARCC (H) Absolute Percent Proficient30 points33.33 points35.3 Progress To 2017 Target10 points0 points Achievement Gaps30 points33.33 points35.3 Percent of Students at Distinction Level 5 points5.56 points5.89 Growth (E/M)25 points27.78 pointsn/a HS Graduation Rates (H) 20n/a23.53 High School Scaled Score (H) 5 n/a TOTAL 100 possible points

7. A Closer Look 85 of the 100 points for elementary and middle schools and 85 for high schools come from these three categories: – Proficiency (30) – Gaps (30) – Growth (25) OR Graduation (20)

8. A Closer Look Cont. Three of these components have subcomponents based on subjects… – Reading – Math …and one or more student subgroups – All students – Reference students – Minority/SES – IEP/ELL

9. Lets Try The Math For Proficiency, we have two subjects (reading and math) each examined for three subgroups (ALL, Min/SES, and IEP/ELL) for a total of 6 subcomponents Elementary School SubjectReadingMath Group All Students Minority/PovertyProgram All Students Minority/PovertyProgram % Prof.68.6167.2347.1758.7657.4543.4

10. Elementary School SubjectReadingMath Group All Students Minority/PovertyProgram All Students Minority/PovertyProgram % Prof.68.6167.2347.1758.7657.4543.4 Each subcomponent is then converted into a “subscore” using a score-specific table. Each one looks a little different but here’s the table for “Proficiency”

11. Elementary School SubjectReadingMath Group All Students Minority/PovertyProgram All Students Minority/PovertyProgram % Prof.68.6167.2347.1778.7657.4523.4 3 3 24 3 1

12. Elementary School SubjectReadingMath Group All Students Minority/PovertyProgram All Students Minority/PovertyProgram % Prof.68.6167.2347.1778.7657.4523.4 3324 3 1 We next find the average of these subscores: 2.67 Then, divide by 5 (the maximum for each subscore) 3+3+2+4+3+1= 6 2.67= 5.53 And finally, multiply this fraction by the total points for Progress, which was 30.53 X 30 points = 16 points for progress

13. Work time (12 minutes) Try re-creating your schools “Proficiency” component score using this procedure: 1.Find each subscore using the cut score table provided 2.Average the subscores 3.Divide the average by 5 to get a fraction 4.Multiple your fraction by the max points

14. Lets Try The Math For Gaps, we have two subjects (reading and math) each examined for two subgroups (Min/SES and IEP/ELL) for a total of 4 subcomponents Reading Reference Reading Min/SES Reading IEP/ELL Math Reference Math Min/SES Math IEP/ELL 82.2753.4934.5278.7843.9334.85 Difference from Reference 28.7847.75Difference from Reference 34.8547.83

15. Lets Try The Math Each subcomponent is then converted into a subscore by looking up the differences, or gaps on this cut score table for “Gaps”: Reading Reference Reading Min/SES Reading IEP/ELL Math Reference Math Min/SES Math IEP/ELL 82.2753.4934.5278.7843.9334.85 Difference from Reference 28.7847.75Difference from Reference 34.8547.83

16. Lets Try The Math Reading Reference Reading Min/SES Reading IEP/ELL Math Reference Math Min/SES Math IEP/ELL 82.2753.4934.5278.7843.9334.85 Difference from Reference 28.7847.75Difference from Reference 34.8547.83 4 33 3

17. We next find the average of these subscores: 3.25 Then, divide by 5 (the maximum for each subscore) 4+3+3+3= 4 3.25= 5.65 And finally, multiply this fraction by the total points for Gaps, which was 30.65 X 30 points = 19.5 points for gaps Reading Reference Reading Min/SES Reading IEP/ELL Math Reference Math Min/SES Math IEP/ELL 82.2753.4934.5278.7843.9334.85 Difference from Reference 28.7847.75Difference from Reference 34.8547.83 4 33 3

18. Work time (12 minutes) Try re-creating your schools “Gaps” component score using this procedure: 1.Find each subscore using the cut score table provided 2.Average the subscores 3.Divide by 5 to get a fraction 4.Multiple your fraction by the max points

19. Lets Try The Math For Growth, we have one subject (SGPs for reading and math are combined) each examined for threesubgroups (All students, Min/SES and IEP/ELL) for a total of 3 subcomponents AllMin/SESIEP/ELL Median SGP: 67.2Median SGP: 51.2Median SGP: 29.5

20. Lets Try The Math Each subcomponent is then converted into a subscore by looking up the median SGPs, this cut score table for “Growth”: AllMin/SESIEP/ELL Median SGP: 67.2Median SGP: 51.2Median SGP: 29.5

21. Lets Try The Math AllMin/SESIEP/ELL Median SGP: 67.2Median SGP: 51.2Median SGP: 29.5 5 3 1

22. We next find the average of these subscores: 3 Then, divide by 5 (the maximum for each subscore) 5+3+1 = 3 3= 5.6 And finally, multiply this fraction by the total points for growth, which was 30.6 X 25 points = 15 points for growth AllMin/SESIEP/ELL Median SGP: 67.2Median SGP: 51.2Median SGP: 29.5 5 3 1

23. Work time (8 minutes) Try re-creating your schools “Growth” component score using this procedure: 1.Find each subscore* using the cut score table provided 2.Average the subscores 3.Divide by 5 to get a fraction 4.Multiple your fraction by the max points *Note: Two of our subcomponents are not reported publicly, but you can find more detailed information on different student groups in the growth model visualization tool. I have provided you with your schools subscore for this exercise.

24. Lets Try The Math For Graduation, we have one “subject” and one student group, so we only have one subcomponent. However, graduation uses either the 4-year rate or the composite index rate, whichever is higher We also need to know a schools grad. rate target and the state average All Students (2013) 4 Year Grad. Rate: 73.8 Composite Grad. Rate: 76.0 School Target: 66.2 ± 5.6 Statewide Average: 80

25. Lets Try The Math Grad. rate points are determined using a subscore and an additional bonus point. To determine the subscore use the table below. To determine the bonus point, simply see whether the grad. rate meet the school target or was higher than the state average? All Students (2013) 4 Year Grad. Rate: 73.8 Composite Grad. Rate: 76.0 School Target: 66.2 ± 5.6 Statewide Average: 80

26. Lets Try The Math All Students (2013) 4 Year Grad. Rate: 73.8 Composite Grad. Rate: 76.0 Statewide Average: 80 School Target: 66.2 ± 5.6 3 +1 4

27. Lets Try The Math All Students (2013) 4 Year Grad. Rate: 73.8 Composite Grad. Rate: 76.0 Statewide Average: 80 School Target: 66.2 ± 5.6 3 +1 4 Divide the subscore by 6 (instead of 5!!) 4 6 =.66 Multiply this percentage by 20.66 X 20 = 13.33

28. Work time (8 minutes) Try re-creating your schools “Graduation” component score using this procedure: 1.Determine whether to use the 4 year or composite rate, whichever is higher 2.Using the cut score table provided find your subscore 3.Determine if either the rate is higher than the target or the state average, if so add a bonus point to your subscore 4.Divide the subscore by 6 5.Multiple your fraction by the max points (20)

29. Questions?