Presentation on theme: "Progress Reports for New York City Public Schools"— Presentation transcript:
1 Progress Reports for New York City Public Schools
2 PROGRESS REPORTS Overview Measuring student performance and progress for elementary and middle schoolsMeasuring progress and performance for high schoolsEvaluating the school learning environmentPeer and city comparisonsAdditional credit for closing the achievement gapTranslating scores into grades
3 School Accountability in New York City WHATEVALUATEENFORCE CONSEQUENCESENABLEHOWProgress ReportsGrades based on student outcomesQuality ReviewsScores based on performance management criteriaSchool SurveyParent, teacher, and student surveys about school environmentFederal and State EvaluationMeasures of schools’ Adequate Yearly Progress and accountability standingRewardsMonetary bonusesConsequencesRestructuring or phaseout of chronically failing schoolsAligned MechanismsCity and Cluster performance targets, Principals’ Performance Review and bonuses, school-wide teacher performance bonusesPeriodic AssessmentsDiagnose and track progressOffice of Achievement ResourcesHands-on data training through collaborative teacher teamsAchievement Reporting and Innovation System (ARIS)Fully integrated knowledge and data managementKnowledge SharingSupport structures and tools for collaboration and knowledge sharing
4 PROGRESS REPORT GUIDING PRINCIPLES Measure student outcomes as accurately as possible given the different challenges schools faceEnsure that schools can verify and re-create metrics so schools understand how they are measured and how they can improve their performanceCompare school performance to that of “peer schools” (schools serving similar student populations) and all schools CitywideProduce outcomes that are minimally correlated with socioeconomic status, Special Education populations, or other demographic characteristicsDifferentiate among schools to support parents in choosing schools and DOE in school leadership and portfolio decisionsIncorporate direct input from parents, teachers, and students
5 OVERVIEW OF THE PROGRESS REPORT The Progress Report measures:Longitudinal progress with students (to and beyond proficiency)Mastery by all students of state learning standards as required by state and federal (NCLB) lawStudent attendance in schoolClosing of the achievement gap for high need populationsDesired conditions for learning as assessed by hundreds of thousands of parents, teachers, and studentsStudent readiness for high school (and ultimately) college successHigh school graduation and progress toward high school graduation
6 LONGITUDINAL PROGRESS TO AND BEYOND PROFICIENCY IS DIRECTLY RELATED TO SUCCESS IN HIGH SCHOOL AND AFTER
7 PROGRESS REPORTS HAVE BEEN DEVELOPED FOR MOST SCHOOLS The first official Progress Reports were released in Fall (evaluating the school year)Elementary/Middle Schools (EMS)High Schools (HS)Transfer Schools (HST)Progress Reports for District 75 Schools, Young Adult Borough Centers, and Early Childhood schools were released for the first time in Fall 2010 (evaluating the school year)Progress Reports for other school types, such as District 79 programs, are still under development
8 THE PROGRESS REPORT METHODOLOGY EVOLVES THROUGH CONTINUOUS FEEDBACK Progress Reports releasedMethodology Review (including previously received feedback)Proposed ChangesFeedback from principals, networks, unions, parents and communityFinal Methodology
9 Progress Report overview Progress, Performance, School Environment, and High School/College & Career Readiness scores based on comparison to peer schools (75%) and City (25%).Grade and Overall ScoreStudent ProgressStudent PerformanceSchool EnvironmentCollege and Career ReadinessClosing the Achievement GapElementary Schools60 points25 points15 points16 pointsK-8 Schools60 points25 points15 points18 pointsMiddle Schools60 points25 points15 points18 pointsHigh Schools55 points20 points15 points10 points16 points
10 COLLEGE READINESS METRICS SCORED IN 2011-12 College and Career Preparatory Course IndexPercentage of students in the graduation cohort who achieved:65+ on Algebra II, Math B, Chemistry, or Physics Regents exam,3+ on any Advanced Placement (AP) exam or 4+ on any International Baccalaureate (IB) exam,grade of “C” or higher in a college credit-bearing course (e.g., College Now, Early College),passing grade in another course certified by the DOE as college- and career-ready*,a diploma with a Career and Technical Education (CTE) or an Arts endorsement*, orpassing grade in an industry-recognized technical assessment*.College Readiness Index (Four and Six Year)College Readiness Index – percentage of students who graduate and demonstrated proficiency in reading, writing, and mathematics as defined by the CUNY standards for passing out of remedial coursework.In 2012, a student may surpass the threshold for remediation using the Regents exams, ACT, SAT, or CUNY Assessment Test.Postsecondary Enrollment Rate (Six and 18 months after high school)Postsecondary Enrollment Rate – percentage of students who graduate and have enrolled in a two- or four-year college, vocational program, or public service program (e.g., military or AmeriCorps)Vocational programs that count toward the PER must culminate in an institutional certificate or industry skill certification, last for a minimum of six months of full-time instruction or a comparable amount of part-time instruction, carry eligibility for Federal grants, be accredited by a USDOE-authorized accreditor, and be licensed in the state in which the student is enrolled.*Achievements indicated with an asterisk are newly included for
11 NEXT LEVEL READINESS METRICS Are students passing their core courses in middle school?The percentage of students in 6th through 8th grade who received a passing grade in a full-year core course in:MathScienceEnglishSocial studiesAre students earning high school credit in 8th grade?The percentage of students in 8th grade who have passed a high school level course and the related Regents exam by June of the 8th grade year.How well do former students from each elementary school perform in their sixth grade courses? How many students from each middle school are on track to graduate at the end of ninth grade?The percentage of students passing courses in their first year of middle or high school
12 TEMPLATES CLARIFY SCORING AND METRICS Detailed explanation of categories and metricsMultiple years of Progress Report resultsDetailed explanation of scoring, with examplesExplanation of peering methodology and more information about peer schoolsFor elementary/middle schools, step-by-step explanation of “growth percentiles,” the primary measure of student progress
13 The Progress Report Overview We have produced Progress Report Overviews for each school. This report:provides a summary of a school’s Progress Report results,helps families interpret the Progress Report and understand information about school performance.
14 HOW CAN I FIND THE PROGRESS REPORT FOR A SCHOOL? Progress Reports and Progress Report Overviews are located on each school’s home page on the NYC Department of Education Web site under ‘Statistics’Families can access Progress Reports and Progress Report Overviews for their children’s schools through ARIS Parent Link:You can search for individual schools’ Progress Reports and Progress Report Overviews, find information about the Progress Report methodology, and view historical Progress Report results at:Read slide.Schools that earned Ds and Fs this year or Cs over the past 3 years could face consequences that include leadership changes or proposed phase-out based on a careful review of their survey and Quality Review scores, last year's results, overall proficiency levels, the principal's length of service, and input from key officials.
15 PROGRESS REPORTS Overview Measuring student performance and progress for elementary and middle schoolsMeasuring progress and performance for high schoolsEvaluating the school learning environmentPeer and city comparisonsAdditional credit for closing the achievement gapTranslating scores into grades
16 ES/MS STUDENT PERFORMANCE AND PROGRESS The Progress Report rewards progress for students at all levels of performanceScaled scoresPerformance levelsProficiency RatingsState ELA and Math tests are graded on a scale of 200 to 800The State decides what scaled scores correspond to each performance level (1, 2, 3, or 4)The City uses a more precise translation to distinguish among students at each performance level800Level 44.00 – 4.50Meeting learning standards with distinctionLevel 33.00 – 3.99Meeting learning standardsProficiencyLevel 22.00 – 2.99Partially meeting learning standardsLevel 11.00 – 1.99Not meeting learning standards200Different cohorts of studentsSame cohorts of students
17 GROWTH PERCENTILES DEFINED A student’s growth percentile compares his or her growth to the growth of all students in the City who started at the same level of proficiency the year beforeA 50th percentile outcome means that a student made more growth than 50% of the students who started at the same place
18 Grade 4 Proficiency: 3.29 Growth Percentile: 84 GROWTH PERCENTILES CONTROL FOR A STUDENT’S STARTING PROFICIENCYA student with a growth percentile of 84 earned a score on this year’s test that was the same or higher than 84 percent of the students in the City who had the same score last yearPROFICIENCY RATING1.002.003.004.004.50Grade 3 Proficiency 2.8484% of students who scored 2.84 in 3rd grade scored 3.29 or lower in 4th grade16% of students who scored 2.84 in 3rd grade scored higher than 3.29 in 4th gradeGrade 3 to grade 4 mathGrade 4 Proficiency: 3.29 Growth Percentile: 84
19 GROWTH PERCENTILES ARE ADJUSTED BASED ON STUDENTS’ DEMOGRAPHIC CHARACTERISTICS These adjustments reflect average differences in growth compared to students with the same starting proficiency level. The adjustments are made to students’ ending proficiency rating as follows:The Progress Report evaluates a school based on its median adjusted growth percentile, the adjusted growth percentile of the middle student when all the students’ adjusted growth percentiles are listed from lowest to highest.
20 PROGRESS REPORTS Overview Measuring student performance and progress for elementary and middle schoolsMeasuring progress and performance for high schoolsEvaluating the school learning environmentPeer and city comparisonsAdditional credit for closing the achievement gapTranslating scores into grades
21 HS STUDENT PERFORMANCE AND PROGRESS We measure graduation rates as well as the key performance indicators that track progress toward graduationYear 3CreditsGraduationYear 2CreditsYear 1Credits+Regents (completion and pass rates)Advanced Regents Diploma with HonorsAdvanced Regents DiplomaRegents DiplomaLocal DiplomaGEDEnglishMathScienceU.S. HistoryGlobal Studies
22 HIGH SCHOOL: WEIGHTED REGENTS PASS RATES The Weighted Regents Pass Rates measure progress made since the 8th grade English, Math, Science, and Social Studies testsIllustrative100%More weight is given to students with lower proficiency based on the 8th grade New York State tests90%“Expected” Regents pass rate based on 8th grade proficiency (%)33%25%12910DecileWeight1.01.13.04.0
23 PROGRESS REPORTS Overview Measuring student performance and progress for elementary and middle schoolsMeasuring progress and performance for high schoolsEvaluating the school learning environmentPeer and city comparisonsAdditional credit for closing the achievement gapTranslating scores into grades
24 SCHOOL ENVIRONMENT – SURVEYS + ATTENDANCE School surveys tell us about the learning environment at each school. Survey results contribute 10 points to the Progress Report. Student attendance contributes another 5 points.School Community1. Academic Expectations2. Communication3. Engagement4. Safety and RespectParentsTeachersStudents
25 PROGRESS REPORTS Overview Measuring student performance and progress for elementary and middle schoolsMeasuring progress and performance for high schoolsEvaluating the school learning environmentPeer and city comparisonsAdditional credit for closing the achievement gapTranslating scores into grades
26 PEER GROUPSA peer group is a group of schools serving similar student populations in the same grade levelsPeer groups consist of up to 40 schoolsEach school has a unique peer group (so each school can be in the middle of its peer group)Peer Index FactorsElementary SchoolMiddle SchoolHigh SchoolEntering proficiencyXStudents with disabilitiesOverageEconomic needEthnicityEnglish language learner status
27 COMPARING RESULTS ACROSS PEER SCHOOLS AND THE CITY Peer Horizon Scores (count 3X – 75%)City Horizon Scores (count once – 25%)Each school’s performance is compared to the performance of schools in its peer groupEach school’s performance is also compared to the performance of all schools CitywideThe peer comparison counts three times as much as the City comparison because we want to emphasize the relative performance of schools with similar student populations.
28 PROGRESS REPORTS Overview Measuring student performance and progress for elementary and middle schoolsMeasuring progress and performance for high schoolsEvaluating the school learning environmentPeer and city comparisonsAdditional credit for closing the achievement gapTranslating scores into grades
29 THE PROGRESS REPORT REWARDS SCHOOLS THAT CLOSE THE ACHIEVEMENT GAP Schools can earn additional credit for closing the achievement gap with high need populationsElementary/Middle/K-8 Schools earn additional credit through exemplary gains on State tests, with their high need populationsHigh Schools earn additional credit through exemplary gains based on graduation outcomes of their high need populationsEnglish Language LearnersStudents with DisabilitiesStudents in the Lowest Third CitywideBlack/Hispanic Males in the Lowest ThirdFocus Populations
30 PROGRESS REPORTS Overview Measuring student performance and progress for elementary and middle schoolsMeasuring progress and performance for high schoolsEvaluating the school learning environmentPeer and city comparisonsAdditional credit for closing the achievement gapTranslating scores into grades
31 TRANSLATING SCORES INTO GRADES High schools earn grades by achieving a total score over a certain threshold:A – 70 points; B – 58 points; C – 47 points; D – 40 points; F – less than 40 pointsAny school achieving the score threshold for a grade earns that grade, regardless of how many other schools earn the same gradeAs state tests continue to evolve, we have employed a set grade distribution for elementary, middle, and K-8 schools.25% A, 35% B, 30% C, 7% D and 3% FsTop Performance rule:Schools in the top 33% (in terms of 4-year graduation rate or ELA and Math performance) can receive no lower than a “C”