1. School Performance Measure Calculations SY 2014-15
Office of Achievement and Accountability

2. Agenda
This presentation is intended to guide you in reviewing your School Performance Measure (SPM) report.
It will answer the following questions:
What is the School Performance Measure (SPM)?
What are the categories and indicators of SPM?
How do I interpret my SPM report?
How is SPM calculated?
Where can I find more information about SPM?

3. What is the School Performance Measure?

4. School Performance Measure Overview
The SPM reflects City Schools’ values including progress for all students and the cultivation of a nurturing learning environment
Collectively, a school’s teachers and school leadership play an instrumental role in affecting student growth
The SPM serves as a component of the teacher and school leader evaluation systems
For more information on SPM in evaluations, please visit City Schools Inside regarding teacher and school leader evaluations

5. School Performance Measure Overview
The SPM is a measure of quantitative indicators that reflects a whole school’s year-long performance. Data are:
Lagged, so the SPM is based on SY data
District-normed, so schools are scored relative to one another
Context-specific, giving consideration to absolute performance and annual progress
Alternative schools and alternative options programs are excluded from SPM because the majority of these schools and programs are missing data on most indicators

6. What are the categories and indicators of SPM?

7. 2014-15 School Performance Measure Categories
Learning Environment
Progress
College and Career Readiness
The SPM measures school performance in 3 categories
Elementary and middle schools have only learning environment data as a result of the transition to PARCC
Schools serving grades 9-12 include progress and college & career readiness
ES/MS (100%)
HS (33%)
HS Only (33%)
HS Only (33%)

8. 2014-15 School Performance Measure Indicators
Learning Environment
Progress*
College/Career Readiness* (or Growth)
ES/MS Indicators
School Survey: Parents
School Survey: Staff
School Survey: Students
Attendance Rate
Chronic Absence Rate
Cohort Retention Rate (2-year)
Not applicable for SY 14-15
HS Indicators
Dropout Rate (4-year)
Progress toward AMO for:
HSA Algebra
HSA English
HSA Biology
SAT/ACT Participation AND
College/Career Preparation
Graduation rate (5-year)
* Progress and college/career readiness use state-developed annual measurable objective (AMO) data. When 2014 AMO data are not available, 2013 data are used.

9. How do I interpret my 2014-15 SPM report?

10. 2014-15 School Performance Measure Reports
Elementary and Middle Schools
SPM = Learning Environment
School Survey: Parents
School Survey: Staff
School Survey: Students
Attendance Rate*
Chronic Absence Rate*
Cohort Retention Rate (2-year)*
* For these indicators, schools receive the greater of two scaled scores: either the absolute performance or the change in the indicator from the previous year. Unlike the other indicators, low rates of chronic absence yield higher scores.

11. 2014-15 School Performance Measure Reports
High Schools
SPM = Average of three categories:
Learning Environment
School Survey: Parents, Staff, and Students
Attendance Rate*
Chronic Absence Rate*
Cohort Retention Rate (2-year)*
Dropout Rate (4-year)*
Progress
AMO- HSA Algebra
AMO- HSA English
AMO- HSA Biology
College & Career Readiness
SAT/ACT Participation Rate
AMO- College/Career Preparation
AMO – Graduation Rate (5-year)
* For these indicators, schools receive the greater of two scaled scores: either the absolute performance or the change in the indicator from the previous year. Unlike the other indicators, low rates of chronic absence and dropout yield higher scores.

12. How is SPM calculated? 1. Scoring: Comparisons Between Schools
Scaled scores on each indicator are calculated based on each school’s performance relative to other schools in the same school grade-band
2. Absolute or Change Scores
Scaled scores are compared, and schools receive whichever score is greater: the absolute or change score
3. Overall Scoring
The overall score is calculated by taking the average of scaled scores for each available indicator

13. 1. Scoring: Comparisons Between Schools
Schools receive scaled scores based on how they perform relative to other schools within their grade-bands (E, EM, M, MH, H)*
SPM is on a 100-point scale, and scores are based on floors (10th percentile) and targets (90th percentile, or 1 for AMO data) based on the following calculation:
In this example, the floor is 64.2 and the target is 79.6
School indicator value– floor
Target– floor
x 100
65.9– 64.2
79.6– 64.2
1.7
15.4 =
x =
* Grade bands M, MH, and EMH were grouped for learning environment data, and EMH, MH, and H were grouped for high school-only data

14. 2. Absolute or Change Scores
Schools can receive scores for improving their performance from the previous year in attendance, chronic absence, cohort retention, and dropout rate
In this example, the school receives the change score because it is greater than the absolute score for attendance. Here is the comparison:
Absolute: 2014 Attendance = 87.87%
Because the floor for elementary schools is 89.37% for attendance, this school would receive a scaled score of 0 based on absolute attendance.
Change: Change in Attendance (performance from SY 2014 (87.87%) – performance from SY 2013 (88.0%)= -.83
Because the floor is -1.76, and the target is .62 for change in attendance, this school would receive a scaled score of

15. 3. Overall Scoring Elementary/Middle Schools
Each of the Learning Environment indicators receives an equal weight in the final score
Final score= average of 6 indicators (or available indicators)
High Schools
All indicators within categories receive an equal weight
Final score= average of 3 categories (or available categories)

16. Where can I find additional information about SPM?

17. Additional Resources Accessing SPM reports
Principals have access to SPM reports on Principal’s Dashboard
For more information on SPM in evaluations, please visit City Schools Inside regarding teacher and school leader effectiveness evaluations
For questions not addressed on the website, please contact:

18. Indicator Definitions
Appendix
Indicator Definitions

19. Learning Environment Indicators
Definition
School Survey- Parents
Average percent (%) of parents responding positively to items regarding school administration, physical environment, learning climate, family involvement, school resources, safety, satisfaction with school, creativity and the arts, and student grit, on 100-point index
School Survey- Staff
Average percent (%) of staff responding positively to items regarding school administration, physical environment, learning climate, family involvement, school resources, safety, satisfaction with school, creativity and the arts, and student grit, on 100-point index
School Survey- Students
Average percent (%) of students responding positively to items regarding school administration, physical environment, learning climate, family involvement, school resources, safety, satisfaction with school, creativity and the arts, and student grit, on 100-point index
Attendance Rate
Average daily attendance rate (%, aggregate number of days attending divided by the aggregate number of days of membership)
Chronic Absence Rate
Proportion of enrolled students absent more than 20 days (%, number of students absent more than 20 school days and enrolled at least 90 days, divided by total number of students enrolled at least 90 days)
Cohort Retention Rate (2-year)
Proportion of students remaining at school 2 years after normal entry grade (%, number of students who remain at the school two years after entry at normal entry grade divided by the number of students who enroll at the beginning of the entry year-- base year for 2014 is 9/30 enrollment file for SY11-12)
Dropout Rate (4-year) (HS only)
4-year adjusted proportion of dropouts in 2010 cohort (%, number of students who withdraw from school (for any reason other than death) and do not reenroll, divided by the number of students who entered grade 9 for the first time in Adjusted for transfers to other schools and other districts-- transfer students are removed from denominator)

20. Progress Indicators HS Only
Definition
AMO- HSA Algebra
Proportional achievement relative to HSA Algebra AMO (%, number of students advanced and proficient in algebra divided by the total number of students eligible to take assessments; this proficiency rate is divided by the school's AMO target. AMOs are set in annual equal increments toward a 50% reduction in the percentage of students who are not proficient by Proficiency rates from assessments administered in SY10-11 are used for the baseline year.)
AMO- HSA English
Proportional achievement relative to HSA English AMO (%, number of students advanced and proficient in English divided by the total number of students eligible to take assessments; this proficiency rate is divided by the school's AMO target. AMOs are set in annual equal increments toward a 50% reduction in the percentage of students who are not proficient by Proficiency rates from assessments administered in SY10-11 are used for the baseline year.)
AMO- HSA Biology
Proportional achievement relative to HSA Biology AMO (%, number of students advanced and proficient in biology divided by the total number of students eligible to take assessments; this proficiency rate is divided by the school's AMO target. AMOs are set in annual equal increments toward a 50% reduction in the percentage of students who are not proficient by Proficiency rates from assessments administered in SY10-11 are used for the baseline year.)

21. College/Career Readiness Indicators HS Only
Definition
SAT/ACT Participation
Proportion students who took SAT or ACT (%, number of diploma track seniors who took the SAT or ACT divided by the number of students in grade 12 based on end of year attendance records that are graduating or still enrolled and not on a SPED Certification track)
AMO- College/Career Preparation
Proportional measure of graduates qualifying for any of following: AP/IB proficiency, CTE concentrator, or college enrollment relative to AMO (%, number of students succeeding in one of the following areas: Advanced Placement or International Baccalaureate, Career and Technology Education Concentrators, and College Enrollment within 16 months of high school graduation, divided by number of graduates; this rate is divided by the school's AMO target. The CCP targets are on a trajectory toward 2017, when each school is expected to reduce its percent of students that are not completing the CCP goals by half.)
AMO- Graduation Rate (5-year)
Proportional measure of graduation rate relative to AMO (%, number of students who graduated with a regular Maryland High School Diploma in 5-year adjusted cohort (from June 2013 to June 2014) divided by number of students in cohort; this number is divided by the school's AMO target. The 5-year adjusted cohort graduation rate targets are on a trajectory toward 2020, when each school is expected to reduce its rate of non-graduating students by half.)