1. School Performance Measure Calculations SY 2015-16
Office of Achievement and Accountability

2. Agenda
This presentation is intended to guide you in reviewing your School Performance Measure (SPM) report.
It will answer the following questions:
What is the School Performance Measure (SPM)?
What are the categories and indicators of SPM?
What improvements were made for the school year?
How do I interpret my SPM report?
How is SPM calculated?

3. What is the School Performance Measure?

4. School Performance Measure Overview
The SPM reflects City Schools’ values, including the importance of progress for all students and the cultivation of a nurturing learning environment
Collectively, a school’s teachers and school leadership play an instrumental role in affecting student growth and the learning environment within the school
The SPM serves as a component of the teacher and school leader evaluation systems
For more information on SPM in evaluations, please visit City Schools Inside regarding teacher and school leader evaluations

5. School Performance Measure Overview
The SPM is a measure of quantitative indicators that reflect a whole school’s year-long performance. Data are:
Alternative schools and alternative options programs are excluded from SPM because the majority of these schools are missing data on most indicators
So the SY SPM is based on SY data
Lagged
So schools are scored relative to one another
District-Normed
So consideration is given to absolute performance and annual progress within a school
School-Specific

6. What are the categories and indicators of SPM?

7. 2015-16 School Performance Measure Categories
Learning Environment
Achievement
Student Growth OR
College and Career Readiness
ES/MS (100%)
HS (50%)
Not applicable
HS Only (50%)
The SPM measures school performance in 3 categories: Learning Environment, Achievement, and Student Growth OR College and Career Readiness.
For SY 15-16, Achievement data are not available for any schools as a result of the transition to PARCC and Student Growth indicators are not available for schools serving grades PK-8

8. 2015-16 SPM Indicators by Domain
Learning Environment Domain
Achievement Domain
Student Growth OR College/Career Readiness Domain
ES/MS Indicators
School Survey: Parents
School Survey: Students
Attendance Rate
Chronic Absence Rate
Not applicable
HS Indicators
Dropout Rate (4-year)
College or Career Readiness Participation (SAT/ACT, AP, CTE, dual enrollment)
College or Career Readiness Success (SAT/ACT, AP, CTE, dual enrollment)
Graduation rate (5-year)

9. What changes were made since the 2014-15 SPM?

10. Stakeholder Feedback
To improve the School Performance Measure, a series of focus groups were held with three stakeholder groups:
Principals
Teachers
District office staff
These groups discussed what indicators and calculations would make SPM the most meaningful for professional practice and school improvement efforts
Feedback was used to improve the indicators and the calculation used in SPM

11. Changes to 2015-16 SPM Indicators
Learning Environment
School Survey –Student
Based on focus group feedback and district review of survey indicators, use selected items that are most relevant to school climate and staff responsibilities.
School Survey—Parent
School Survey—Staff
Omit as an indicator for SY calculations, based on feedback that what teachers report about their own schools should not be used for or against them in their individual evaluations.
Cohort Retention
Omit as an indicator for SY calculations. This is based on entering grade band, so it does not include all teachers’ impacts on their students.

12. Changes to 2015-16 SPM Indicators & Calculations
Achievement
Progress Toward HSA Goals
Omit achievement indicators as the district transitions to PARCC.
College and Career Readiness – HS Only
College and Career Readiness indicators
Redefine College and Career Readiness indicators in terms of participation AND success in readiness benchmarks
Changes to SPM Calculations
Calculation
Change
Minimum Service to School
Include a minimum threshold of service to a school for SPM to apply to an individual’s evaluation. This minimum is set to 3 months.
Final Scores in Reports
Round final scores in evaluation reports to whole numbers to increase readability.

13. 2015-16 SPM Selected School Survey Items- Students
School Survey- Students
Admin14*
The school mission is clearly communicated
Learn14
I feel like I belong at this school
Learn16
School staff respect the students
Learn18*
My school prepares me for college and to have a career
Learn19
If students break rules, there are fair consequences
Parent1*
My parent or guardian feels welcome at this school
Parent3
When I do something good at school, my parent or guardian hears about it
Parent4
When I do something bad at school, my parent or guardian hears about it
Resource 7
My teachers can give me extra help with schoolwork when I need it
Resource8
There is someone at my school who I can talk to about my problems
Satisfy2
I learn a lot at my school
Satisfy 8
I like the classes I take
Satisfy11
Overall, I am satisfied with my school
Satisfy12*
I would recommend this school to others
*Schools with only grades 3-5 have fewer items than schools with students in grades Of the items listed here, four (marked with *) are not included in the survey for students in grades 3-5. All School Survey items not listed here are excluded from SPM calculations.

14. 2015-16 SPM Selected School Survey Items- Parents
School Survey- Parents
Creative1*
Student work in the arts is displayed or presented in my child's school
Learn13
Teachers at this school care about my child
Learn14
My child feels like she/he belongs at this school
Learn18
This school prepares students for college and to have a career
Learn19
If students break rules, there are fair consequences
Parent1
I feel welcome at my child's school
Parent3
When my child does something good at school, I usually hear about it from the school
Parent4
When my child does something bad at school, I usually hear about it from the school
Parent5
School staff work closely with parents to meet students' needs
Parent19
I feel that my input into my child's education is valued
Parent23
This school regularly communicates with parents about how they can help their children learn
Resource 7
Teachers provide extra academic help to students who need it
Satisfy11
Overall, I am satisfied with my child's school
Satisfy12
I would recommend my child's school to other parents
*All School Survey items not listed here are excluded from SPM calculations.

15. How do I interpret my 2015-16 SPM report?

16. 2015-16 School Performance Measure Reports
Elementary and Middle Schools
SPM = Learning Environment
Student School Survey Rating
Parent School Survey Rating
Attendance Rate OR Change in Attendance Rate *
Chronic Absence Rate OR Change in Chronic Absence Rate *
* For these indicators, schools receive the greater of two scaled scores: either the absolute performance or the change in the indicator from the previous year. Unlike the other indicators, low rates of chronic absence yield higher scores.

17. 2015-16 School Performance Measure Reports
High Schools
SPM = Average of two categories:
Learning Environment
Student School Survey Rating
Parent School Survey Rating
Attendance Rate*
Chronic Absence Rate*
Dropout Rate (4-year)*
College/Career
Readiness
College or Career Participation
College or Career Success
Graduation Rate (5-year)
* For these indicators, schools receive the greater of two scaled scores: either the absolute performance or the change in the indicator from the previous year. Unlike the other indicators, low rates of chronic absence and dropout yield higher scores.

18. How is SPM calculated? 1. Scoring: Comparisons Between Schools
School scores on each indicator are calculated based on each school’s performance relative to other schools in the same school grade-band
2. Absolute or Change Scores
Scores are compared, and schools receive whichever score is greater: the absolute or change score
3. Overall Scoring
The overall score is calculated by taking the average of scores for each available indicator for each domain, and then the average of domain scores

19. 1. Scoring: Comparisons Between Schools
Schools receive scores based on how they perform relative to other schools within their grade-bands (E, EM, M, MH, H)*
SPM is on a 100-point scale, and scores are based on floors (10th percentile) and targets (90th percentile) based on the following calculation:
A value below the floor yields an indicator score of 0, and a value above the target yields an indicator score of 100
In this example, based on school performance in this grade-band, the floor for parent school survey rating is 78.0 and the target is 94.9, so that:
School indicator value– floor
Target– floor
x 100
4.0
16.9 =
x =
* Grade bands M, MH, and EMH were grouped for learning environment data, and EMH, MH, and H were grouped for high school-only data

20. 2. Absolute or Change Scores
Schools can receive scores for improving their performance from the previous year in attendance, chronic absence, and dropout rate
In this example, the school receives the change score because it is greater than the absolute score for attendance. Here is the comparison:
Absolute: 2015 Attendance = 88.7%
Because the floor for this school is 88.9% for attendance, this school would receive an indicator score of 0 based on absolute attendance.
Change: Change in Attendance = 0.0
Because the floor is -1.55, and the target is .77 for change in attendance rate, this school would receive an indicator score of 66 for 0 change in attendance. Because this provides more points than the absolute rate, it is used in the SPM calculation.

21. 3. Overall Scoring Elementary/Middle Schools
Each of the Learning Environment indicators receives an equal weight in the final score
Final score = average of 4 indicators (or available indicators)
High Schools
All indicators within categories receive an equal weight
Final score = average of 2 categories (or available categories)

22. Where can I find additional information about SPM?

23. Additional Resources Accessing SPM reports
Principals have access to SPM reports on Principal’s Dashboard
For more information on SPM in evaluations, please visit City Schools Inside regarding teacher and school leader effectiveness evaluations
For questions not addressed on the website, please contact:

24. Indicator Definitions
Appendix
Indicator Definitions

25. Learning Environment Indicators
Definition
School Survey- Parents
Positive parent response rate (number of positive responses to items selected for inclusion in SPM divided by number of total responses to items selected, expressed as a percent (%) by school). Data are included when N > 50 or N >10% of student enrollment.
School Survey- Students
Positive student response rate (number of positive responses to items selected for inclusion in SPM divided by number of total responses to items selected, expressed as a percent (%) by school). Data is included when N > 30% of student enrollment.
Attendance Rate
Average daily attendance rate (aggregate number of days attending divided by the aggregate number of days of membership, expressed as a percent (%), by school).
Chronic Absence Rate
Proportion of students absent more than 20 days (number of students absent more than 20 school days and enrolled at least 90 days, divided by total number of students enrolled at least 90 days, expressed as a percent (%), by school).
Dropout Rate (4-year) (HS only)
4-year adjusted proportion of dropouts in 2011 cohort (number of students who withdraw from school (for any reason other than death) and do not reenroll, divided by the number of students who entered grade 9 for the first time in 2010, expressed as a percent (%), by school. Adjusted for transfers to other schools and other districts (transfer students are removed from denominator).

26. College and Career Readiness Indicators High School Only
Definition
College/Career Readiness Participation
Proportion 12th graders who took SAT, ACT, or AP exams, are enrolled in CTE courses, OR are enrolled in college courses (number of diploma track seniors who took the SAT, ACT, AP exams, CTE courses, or credit-bearing college courses during high school divided by the number of students in grade 12 based on end of year attendance records that are graduating or still enrolled and not on a special education certification track, expressed as a percent (%) by school).
College/Career Readiness Success
Proportion 12th graders qualifying for any of following: SAT/ACT benchmark; AP proficiency, CTE completer, or passing college coursework (number of students succeeding in one of the following areas: meeting the 75th district percentile in SAT or ACT composite score; receiving a 3 or higher on any AP exam; completing all coursework in a CTE pathway; and passing a college course during high school, divided by the number of students in grade 12 based on end of year attendance records that are graduating or still enrolled and not on a special education certification track), expressed as a percent (%) by school).
Graduation Rate (5-year)
Adjusted 5- year graduation rate (number of students who graduated with a regular Maryland High School Diploma in 5-year adjusted cohort (from June 2014 to June 2015) divided by number of students in cohort, expressed as a percent (%), by school).