Presentation on theme: "Understanding the College and Career Ready Performance Index (CCRPI)"— Presentation transcript:
1 Understanding the College and Career Ready Performance Index (CCRPI) In 2012, the Georgia Department of Education applied for and received a waiver to the No Child Left Behind Act. This allowed states to view accountability on a more broad scope, looking beyond the sole measure of Adequate Yearly Progress, but looking also at growth and overall achievement of all students. This new accountability instrument is called the College and Career Readiness Performance Index, or CCRPI.Presented by Brittany CunninghamPrincipal Druid Hills High School*CCRPI data used in this presentation is from the school year** CCRPI is scheduled to be published in December 2013
2 Why Change from AYP to CCRPI? Allows flexibility of NCLB requirements through the ESEA Flexibility Waiver.DOE and Districts are no longer required to provide:Public School ChoiceSupplemental Educational Services (SES)Subgroup ConsequencesProvides a means for all stakeholders to have access to school data and play an active role in the school’s continuous improvement processThe College and Career Readiness Performance Index (CCRPI) has allowed Georgia the flexibility to discontinue some NCLB requirements such as Public School Choice, Supplemental Educational Services and other consequences given to schools for subgroup performance. If you would like more information about the Flexibility Waiver it can be found on the Georgia Department of Education website. The CCRPI also provides an easier means for all stakeholders to access school data. School stakeholders are now able to review school improvement status based on multiple criteria.
3 CCRPI = Easy Access to Data The CCRPI also provides an easier and more complete means for all stakeholders to access school data. Educators, students, parents, and community can easily see not just the achievement of the school, but all facets of school improvement in one location and format. CCRPI indicators allow stakeholders to access and interpret individual schools’ mastery of specific standards, achievement gaps, student academic growth, school climate data, and financial audit results.
4 How is CCRPI Different from AYP? Shifts the focus from targeting specific schools not meeting pre-determined Annual Measurable Objectives to overall improvement for all schoolsProvides a roadmap that guides schools in preparing all students to be ready for college, career, and post-secondary opportunitiesUtilizes a “balanced scorecard” that addresses the process of school improvement as well as the end productThe CCRPI is a shift from singling out schools that were unable to meet pre-set Annual Measurable Objectives to focusing on improvement for all schools. It is a guide, measuring multiple criteria and rewarding points. The CCRPI format allows schools to set goals and work toward preparing all students for college, career and post-secondary opportunities.
5 How Are Schools Identified Differently Under CCRPI? AYPTitle I Distinguished SchoolsMet AYPDid Not Meet AYPNeeds ImprovementCorrective ActionRestructureCCRPITitle I SchoolsReward SchoolsFocus SchoolsPriority SchoolsTitle I and Non-Title IAlert SchoolsSchools are no longer identified as Distinguished, Met/Did Not Meet, Needs Improvement, Corrective Action, or Restructure schools. As a means of accountability, the CCRPI identifies Priority, Focus, Alert, and Reward schools based on state-determined criteria. Priority, Focus and Reward are specific to Title I schools. Georgia extended these accountability measures beyond Title I and added a fourth measure, Alert , that could be applied to non-Title I schools. If you would like more information about the Flexibility Waiver it can be found on the Georgia Department of Education website.
6 How is CCRPI Scored?The CCRPI will consist in an overall score awarded to schools based on three primary areas: an achievement score which is 70% of the overall score and made-up of three academic achievement components, a progress score which is 15% of the overall score, and an achievement gap score, which is 15% of the overall score. Each of these areas is weighted and the final score is based on a total of 100 possible points. Schools also have an opportunity to earn challenge points that can be added to the final score. Future CCRPI scores will include opportunities for additional points through school climate and financial management success.
7 Achievement Score – 70% of CCRPI The Achievement Score is the largest percentage of the CCRPI, measuring 70% of the overall score. It is made up of three differing areas. Content Mastery, what we know as the basic student achievement scores on standardized tests such as the CRCT or EOCT, makes up 40% of the achievement score. In addition each grade level span has indicators for post high school, post middle school, or post elementary school readiness. This portion of the achievement score gets a weight of 30%. Finally the achievement score has an additional 30% weight given to the graduation rate of the high school or specific predictors for graduation for elementary and middle school students.
8 How Are Schools Scored Differently Under CCRPI? AYPAchievementELAMath2nd IndicatorGrad Rate/AttendanceSafe Harbor CalculationsCCRPIAchievement 70%Core Content Areas 40%Grad Rate/Predictors 15%Post School Readiness 15%Progress 15%Achievement Gap 15%Challenge PointsWhen you look at how the new scoring system is calculated, it becomes apparent just how much of a paradigm shift this will be for schools. Where there were only three areas of concern before (Reading/ELA, Math, and Grad Rate or Attendance), there are now multiple ways to gain and lose points.First, all core content areas are now addressed, which means that Science and Social Studies are equally important to math and ELA. It also means that the test scores are now a MUCH smaller part of the equation. They have gone from being the majority factor of whether or not a school met AYP to only 40% of the big picture. That is 10% for each content area of the final score before any challenge points are added. That is a huge difference for schools to wrap their arms around.Schools will have to get away from the idea of working the numbers game to make safe harbor and start looking at initiatives that will make significant differences school wide. Many of the graduation rate predictors, post-school readiness indicators, and challenge points will also impact the core content are scores, which means that you are again looking at school improvement through a much wider lens. Examples are Lexile Scores, writing skills, and STEM certification.
9 Adding It Up… ≤ 10 Points 70 Points 15 Points Content Mastery 40% Achievement70 PointsProgress15 PointsAchievement GapChallenge Points≤ 10 PointsSTAR Ratings(Do Not Impact CCRPI Score)ContentMastery40%Content Area Test GrowthGap Size and Gap ChangeEL/ED/SWD Performance(Flags)Financial EfficiencyRatingPost School Readiness30%Exceedingthe Bar IndicatorsSchool ClimateGrad Rate or Predictors
10 Achievement Component I Content Mastery—40% Weight This section measures student achievement on criterion referenced tests to determine student achievement.EOCT for High SchoolCRCT for Elementary (grades 3-5)CRCT Middle SchoolContent Mastery, the first portion of the Achievement Score section of the CCRPI, measures student achievement on standardized tests. This determines how well a school is doing with instruction. Elementary, grades 3-5, and Middle use the CRCT as the measure of content mastery while high schools use the EOCT.
11 How to Calculate Content Mastery Druid Hills High had 75.9% of its students meet and exceed on the 9th grade Literature EOCT in …75.9% x 10 = 7.6 points earned on this indicatorOther EOCT indicators: American Lit (11th grade - 8.8) , Coordinate Alg/GPS Alg/Math I (6.5), Analytic Geo/GPS Geo/Math II (5), Physical Sci (6), Biology(9th grade - 6.6), US History (11th grade - 7.2), Economics (7.9)All indicators are calculated in the same way to find a total score.= 55.6Druid Hills High had a total of 55.6 points from all eight content mastery indicators. This score is divided by the total of 80 possible points…55.6 ÷ 80 = OR 69.5 % Category PerformanceThe Category Performance is calculated at a weight of 40% to achieve the content mastery score… .695*.40 = .278.792 x .40 = Weighted PerformanceOnce you have the category performance score, you multiply it by .40 (40% of the total achievement score) to get the weighted performance score. This will be added to the other achievement component scores later.
12 Paradigm Shift Alert!!! AYP CCRPI Reading/ELA combined + Math = 100% of Achievement Calculations2/3 of AYP determinationCCRPIELA +Math +Science +Social Studies =40% of Achievement CalculationsLess than 1/3 CCRPI total scoreThis is a new world in terms of how we look at these scores. The content area scores for Science and Social Studies are EQUAL to those of Math and ELA. This completely changes the face of accountability in terms of classroom instruction. These scores are important and will impact us in a variety of ways, but they are no longer the whole story.
13 HOWEVER…. Progress Gap Size/Change Challenge Points Uses content area composite score to calculateProgressGap Size/ChangeUses state targets and subgroup targets for content area scoresChallenge PointsClearly, the accountability has changed for the core content area scores. It’s moved from two subjects to five subjects and from the majority of the total score to only part of the total score.However, it is very important to note that content mastery will come up again and again. The core content areas will be used to calculate the progress and gap scores. In addition, challenge points will be awarded only for subgroups that meet the state targets. This will become more evident as we get to those sections later in this presentation.
14 Achievement Component II: Post High/Middle/Elementary School Readiness—30% Weight This section looks at areas proven to positively impact students and prepare them for the next level of education:Career Planning/PathwaysAdvanced Content CoursesEnglish Language SupportWorld Language CoursesWriting SkillsInterpretation of Complex Text (Lexile Scores)The second section of the Achievement Score is designed to predict readiness beyond high school, middle school, and elementary school. It looks at areas that have been scientifically researched and proven to help students be prepared for the next level of school, such as career planning and pathway, advanced content courses, English Language support, foreign language, writing ability and the ability to interpret complex texts as measured through Lexile levels. This section of the Achievement Score has a weight of 30%.
15 Calculating Post -Secondary School Readiness Calculation is similar to achievement point calculation for each indicator. The total indicator score is divided by the total points possible.Druid Hills earned a total of points on seven indicators worth ten points each…53.8 ÷ 70 = OR %The Category Performance is calculated at a weight of 30% to achieve the Post High School Readiness score…x .30 = Weighted PerformanceThe calculation of the post readiness score is the same as the content mastery score.
16 Post High School Readiness Indicators % of graduates completing a career pathway within their program of study (6.4)See the Career Pathways link on the Counseling Page of our website:% of graduates entering the Georgia’s State and Technical Colleges/Universities not requiring remediation or support courses or (8);Test scores: > 22 on the Composite ACT, > 1500 on the Combined SAT, > 3 on > 2 AP exams, > 4 on > 2 IB exams
17 Post High School Readiness Indicators % graduates in Accelerated Enrollment (ACCEL, Dual Hope, Move on When Ready, Early College, Gateway to College), AP courses, or IB courses (7.5)% graduates with > 2 World Language credits (same language) – NEW for% of scores Meeting or Exceeding the GHSWT (9.4)% students with a 1275 Lexile measure on the Am. Lit. EOCT (about a 87% on the exam) (8.1)% of EOCT assessments at the exceeds level (5)Student attendance rate (9.4)
18 Achievement Component III Graduation Rate—30% Weight Calculation is similar to achievement point calculation for each indicator. The total indicator score is divided by the total points possible.Two graduation rates4-year Cohort Graduation Rate for 2013 CCRPI:= # of 2012 Cohort Members graduating with a Regular Ed Diploma in 2012# 1st time 9th graders in Transfers In –Transfers Out/Emigrate through 20125-year Extended Cohort Graduation Rate for 2013 CCRPI:= # of 2014 Cohort Members graduating w/ a Regular Ed Diploma in 2012 and 2013# 1st time 9th graders in Transfers In –Transfers Out/Emigrate through 2013
19 Achievement Component III Graduation Rate—30% Weight 2012 CCPRI4-year: % = 6.25-year: 64.56% = 6.5Druid Hills earned a total of points on two indicators worth ten points each…12.7 ÷ 20 = .635 OR 63.5%The Category Performance is calculated at a weight of 30% to achieve the Graduation Rate score….635 x .30 = Weighted Performance
20 Druid Hills High School Achievement Score—70%Druid Hills High SchoolContent Mastery+ Post High/Middle/Elementary School Readiness+ Graduation Rate/Predictors of GraduationRaw Score x 70 = Achievement Score.278.69857x 70 = 48.9Achievement Score on CCRPI = 48.9Now it’s time to calculate out total achievement score. All of the Weighted performance scores are added together and then multiplied by 70 to arrive at the Achievement Score on CCRPI.
21 Adding It Up… ≤ 10 Points 70 Points 15 Points Content Mastery 40% Achievement70 PointsProgress15 PointsAchievement GapChallenge Points≤ 10 PointsSTAR Ratings(Do Not Impact CCRPI Score)ContentMastery40%Content Area Test GrowthGap Size and Gap ChangeEL/ED/SWD Performance(Flags)Financial EfficiencyRatingPost School Readiness30%Exceedingthe Bar IndicatorsSchool ClimateGrad Rate or Predictors
22 Progress Score – 15%Describes a student’s growth relative to other students with similar prior achievementEvery student’s Student Growth Percentile has the potential to earn points towards the Progress ScoreAnalyzes Student Growth within the four core content areas: English/Language Arts, Math, Science, and Social Studies using student achievement data and is assigned a score according to a predetermined rubric by GaDOE.Total of 15 possible points (15% of total CCRPI)The College and Career Ready Performance Index Progress Score helps to describe a student’s growth relative to other students with similar prior achievement. This score goes beyond an overall measure of the school’s achievement for the current year and helps to measure our students against other, similar students statewide to look for evidence of growth from year-to-year. The progress score has a weight of 15% of the overall achievement score and measures the four core content areas: English/Language Arts, Math, Science, and Social Studies.The Progress score will be calculated based on the percentage of a school’s students demonstrating typical or high growth via their Student Growth Percentiles (SGP). An SGP describes a student’s growth on state tests relative to other students statewide with similar prior achievement. A student’s growth percentile can range from 1 to 99, and every student’s SGPs may earn points towards the Progress Score
23 Calculating the Progress Score Count of Students Meeting Typical/High Growth Count out of the number of Students with Student Growth Percentiles (SGPs)9th Grade and Amer. Lit 560/830Math I, Algebra, Math II, Geometry 420/605Biology and Physical Science 489/726US History, Economics 472/654Total 1941/2815Percent Meeting Typical/High GrowthWeighted Performance (.69852) X 15Progress Points Earned 10.3In , we had 830 students who obtained a Growth Percentile for English Language Arts. Of those 830 students, 560 students demonstrated typical to high growth as defined by a pre-determined rubric set by the GaDOE. For each content area, we compare potential for growth to actual growth until we have a total number of students meeting typical/high growth and a total number of SGPs.It should be noted that this is the SECOND time that core content mastery has an impact on the total CCRPI score.
24 Adding It Up… ≤ 10 Points 70 Points 15 Points Content Mastery 40% Achievement70 PointsProgress15 PointsAchievement GapChallenge Points≤ 10 PointsSTAR Ratings(Do Not Impact CCRPI Score)ContentMastery40%Content Area Test GrowthGap Size and Gap ChangeEL/ED/SWD Performance(Flags)Financial EfficiencyRatingPost School Readiness30%Exceedingthe Bar IndicatorsSchool ClimateGrad Rate or Predictors
25 Achievement Gap Score – 15% Assigns points to schools for the progress in closing the gaps or showing small achievement gaps on state tests.Calculates the difference between the schools’ lowest 25% of achievers and the state average.The gap change compares the previous year to the current year and is assigned a score according to a predetermined rubric by GaDOE.For each subject assessment, the higher of the gap size or gap change is taken and assigned a score to obtain a possible total of 16.The Achievement Gap Score is a standardized scale score that assigns points to schools for the gains they have made in closing the gap between the school’s lowest 25% of achievers and the state average. Schools with small gaps or non-existent gaps to begin with will likely be awarded points based on the size of the gap. Schools with significant gains will likely be awarded points for the closing of the gap.
26 Calculating the Achievement Gap Score Druid Hills High:GapSizeChangeHigher of Size/ChangePointsPossible9th Grade and Amer Lit234Math I, Alg, Math II, GeoBio, Phy SciUS Hist, EconTotal1116The gap measure includes two components - a gap size and gap change. Gap size is defined as the difference in achievement between the state benchmark and the school's high-need students. Gap change is defined as the gap size for the current year minus the gap size for last year. For each subject area, a school's final score will be the higher of the gap size and gap change score. The overall final score will be the average of the final subject area scores.
27 Calculating the Achievement Gap Score Druid Hills High:GapSizeChangeHigher of Size/ChangePointsPossibleTotal1116Percent of Higher of Gap Size/Gap Change 11 ÷ 16 =Weighted Performance = X 15Achievement Gap Points Earned : 10.3Please note that this is the THIRD time that content area scores impact the total CCRPI score.
28 Adding It Up… ≤ 10 Points 70 Points 15 Points Content Mastery 40% Achievement70 PointsProgress15 PointsAchievement GapChallenge Points≤ 10 PointsSTAR Ratings(Do Not Impact CCRPI Score)ContentMastery40%Content Area Test GrowthGap Size and Gap ChangeEL/ED/SWD Performance(Flags)Financial EfficiencyRatingPost School Readiness30%Exceedingthe Bar IndicatorsSchool ClimateGrad Rate or Predictors
29 Challenge Points Score – Up to 10 Additional Points Schools can receive “Challenge Points” to add to the total score (up to 10 additional points).EL/ED/SWD Points can be received if a school has a significant number of Economically Disadvantaged, English Learner Students and/or Students with Disabilities who are meeting expectations.Points can also be earned for going beyond CCRPI targets (Exceeding the Bar) in college and career readiness programs.
30 Performance Flags - Legend Subgroup met both State and Subgroup Performance TargetsSubgroup met Subgroup but not State Performance TargetSubgroup met State but not Subgroup Performance TargetSubgroup did not meet either the State or Subgroup Performance TargetsSubgroup met Participation Rate, State Performance Target and Subgroup Performance TargetsSubgroup met Participation Rate and Subgroup Performance Target but not State Performance TargetSubgroup met Participation Rate and State Performance Target but not Subgroup Performance TargetSubgroup met the Participation Rate, but did not meet either the State or Subgroup Performance Targets
31 Druid Hills High Performance Flags - 2012 Subgroup Performance2012 End of Course Tests2011 GraduationRate9th Grade LitAmer.LitMath IMath IIBioPhySciUSHistEconAsian/Pacific IslanderBlackHispanicMulti-RacialWhiteEconomically DisadvantagedStudents With DisabilityEnglish Learners
32 Calculating the EL/ED/SWD Challenge Points Druid Hills had Full Academic Year (FAY) Students with test scores (numbers include tests taken for all content areas)Of the 3324 FAY students, 2269 are Economically Disadvantaged, English Learners, and/or Students with Disabilities.The percent of ED/EL/SWD students with test scores is , which means that out of a possible 10 points, the school has the POTENTIAL to earn 6.8Flag Count for ED/EL/SWD = 27Flag Count for ED/EL/SWD meeting subgroup performance targets = 7% Flag Count for ED/EL/SWD meeting subgroup performance targets =6.8 x = 1.81.8 Challenge Points Awarded for EL/ED/SWD PerformancePlease note that this is the FOURTH time that the content area scores have impacted CCRPI points. It should also be noted how many of our students are in this category. It is becoming clear how important it is that our students meet their state target scores using this new model.FAY students are enrolled in 65% of the number of days for the course, beginning at the start of the marking period to the end of the marking period
33 Exceeding the BarIn addition to the points Achievement, Progress, and Achievement Gap, and EL/ED/SWD Challenge Points, the school can earn points for utilizing practices and programs that prepare students for future careers.Schools can earn up to ten extra Challenge Points for all combined indicators.
34 Exceeding the Bar Physics Course % 9th SWD students with 3 core Carnegie units + passing EOCT% 9th graders with 4 core Carnegie units + passing EOCTSTEM CertificationWork-Based Learning or Capstone Project> 3 Carnegie units in a world language (NEW in )Teachers using State Longitudinal Data System (NEW in )Innovative PracticesSchool Climate (TBD)ESOL w/positive movement on ACCESS testAdditional points can be awarded for exceeding the bar in a variety of areas. For a complete list of potential areas to earn points in elementary, middle, and high schools you can visit the CCRPI link of the Georgia DOE website. Please note that unlike other areas of the CCRPI that are uploaded by the state, these points can only be awarded if the information is uploaded by the school and/or district.Some indicators, such as innovative practices for academics or school climate, must be accompanied by supporting pre and post data.
35 Druid Hills High’s Points Earned Physics: Bar was 88.7%; DHHS was 41%9th grade SWD: Bar was 100; DHHS was 70.9%9th grade core content: Bar 93.4%; DHHS 79.2%ACCESS: Bar was 100%; DHHS was 91.6%WBL/Capstone: Bar was 99.7%; DHHS was 10.8%
36 Druid Hills High’s Score 73.1 AchievementPoints48.9Progress15 Points10.3Achievement GapChallenge Points≤ 10 Points1.8STAR Ratings(Do Not Impact CCRPI Score)ContentMastery40%.278+Content Area Test Growth.68952Gap Size and Gap Change.6875EL/ED/SWD Performance(Flags)Financial EfficiencyRatingPost School Readiness30%Exceedingthe Bar Indicators0.0School ClimateGrad Rate or Predictors.1905=.69857x 70.68952X 15.6875 X 15N/ANow lets put it all together. Remember the breakdown – Achievement is 70% or points. Progress is 15%, and Achievement Gap is 15%. In the case of this sample school we can now add it up for the final CCRPI score.
37 Coming Soon…Star Ratings Beginning in schools will also receive star ratings in two areas based on their financial efficiency and the school climate. These scores will be for public information only and will not affect the overall CCRPI score, but are valuable for stakeholders as they consider the operational structure of the school. The scores for the financial efficiency rating will be derived through system and state level audits. The school climate rating will be derived through perception data gathered through multiple surveys, such as the Safe and Drug Free School Survey and the Georgia School Personnel Survey.Beginning in schools will also receive star ratings based on their financial efficiency and school climate. These scores will be for public information only and will not affect the overall CCRPI score. Scores are derived through perception data and financial audits.
38 Additional Information The GADOE ESEA WaiverThe GADOE Accountability Web PageCCRPI Scores by School and DistrictIf you would like more information regarding understanding the new ESEA Waiver, the new CCRPI Instrument, or would like to access your child’s CCRPI data, you can visit the applicable GaDOE Web pages hyperlinked here or by visiting
39 Questions and Comments??? In 2012, the Georgia Department of Education applied for and received a waiver to the No Child Left Behind Act. This allowed states to view accountability on a more broad scope, looking beyond the sole measure of Adequate Yearly Progress, but looking also at growth and overall achievement of all students. This new accountability instrument is called the College and Career Readiness Performance Index, or CCRPI.