Understanding the College and Career Ready Performance Index (CCRPI) In 2012, the Georgia Department of Education applied for and received a waiver to the No Child Left Behind Act. This allowed states to view accountability on a more broad scope, looking beyond the sole measure of Adequate Yearly Progress, but looking also at growth and overall achievement of all students. This new accountability instrument is called the College and Career Readiness Performance Index, or CCRPI. Presented by Brittany Cunningham Principal Druid Hills High School *CCRPI data used in this presentation is from the 2011-2012 school year ** 2012-2013 CCRPI is scheduled to be published in December 2013

Why Change from AYP to CCRPI? Allows flexibility of NCLB requirements through the ESEA Flexibility Waiver. DOE and Districts are no longer required to provide: Public School Choice Supplemental Educational Services (SES) Subgroup Consequences Provides a means for all stakeholders to have access to school data and play an active role in the school’s continuous improvement process The College and Career Readiness Performance Index (CCRPI) has allowed Georgia the flexibility to discontinue some NCLB requirements such as Public School Choice, Supplemental Educational Services and other consequences given to schools for subgroup performance. If you would like more information about the Flexibility Waiver it can be found on the Georgia Department of Education website. The CCRPI also provides an easier means for all stakeholders to access school data. School stakeholders are now able to review school improvement status based on multiple criteria.

CCRPI = Easy Access to Data The CCRPI also provides an easier and more complete means for all stakeholders to access school data. Educators, students, parents, and community can easily see not just the achievement of the school, but all facets of school improvement in one location and format. CCRPI indicators allow stakeholders to access and interpret individual schools’ mastery of specific standards, achievement gaps, student academic growth, school climate data, and financial audit results.

How is CCRPI Different from AYP? Shifts the focus from targeting specific schools not meeting pre-determined Annual Measurable Objectives to overall improvement for all schools Provides a roadmap that guides schools in preparing all students to be ready for college, career, and post-secondary opportunities Utilizes a “balanced scorecard” that addresses the process of school improvement as well as the end product The CCRPI is a shift from singling out schools that were unable to meet pre-set Annual Measurable Objectives to focusing on improvement for all schools. It is a guide, measuring multiple criteria and rewarding points. The CCRPI format allows schools to set goals and work toward preparing all students for college, career and post-secondary opportunities.

How Are Schools Identified Differently Under CCRPI? AYP Title I Distinguished Schools Met AYP Did Not Meet AYP Needs Improvement Corrective Action Restructure CCRPI Title I Schools Reward Schools Focus Schools Priority Schools Title I and Non-Title I Alert Schools Schools are no longer identified as Distinguished, Met/Did Not Meet, Needs Improvement, Corrective Action, or Restructure schools. As a means of accountability, the CCRPI identifies Priority, Focus, Alert, and Reward schools based on state-determined criteria. Priority, Focus and Reward are specific to Title I schools. Georgia extended these accountability measures beyond Title I and added a fourth measure, Alert , that could be applied to non-Title I schools. If you would like more information about the Flexibility Waiver it can be found on the Georgia Department of Education website.

How is CCRPI Scored? The CCRPI will consist in an overall score awarded to schools based on three primary areas: an achievement score which is 70% of the overall score and made-up of three academic achievement components, a progress score which is 15% of the overall score, and an achievement gap score, which is 15% of the overall score. Each of these areas is weighted and the final score is based on a total of 100 possible points. Schools also have an opportunity to earn challenge points that can be added to the final score. Future CCRPI scores will include opportunities for additional points through school climate and financial management success.

Achievement Score – 70% of CCRPI The Achievement Score is the largest percentage of the CCRPI, measuring 70% of the overall score. It is made up of three differing areas. Content Mastery, what we know as the basic student achievement scores on standardized tests such as the CRCT or EOCT, makes up 40% of the achievement score. In addition each grade level span has indicators for post high school, post middle school, or post elementary school readiness. This portion of the achievement score gets a weight of 30%. Finally the achievement score has an additional 30% weight given to the graduation rate of the high school or specific predictors for graduation for elementary and middle school students.

How Are Schools Scored Differently Under CCRPI? AYP Achievement ELA Math 2nd Indicator Grad Rate/Attendance Safe Harbor Calculations CCRPI Achievement 70% Core Content Areas 40% Grad Rate/Predictors 15% Post School Readiness 15% Progress 15% Achievement Gap 15% Challenge Points When you look at how the new scoring system is calculated, it becomes apparent just how much of a paradigm shift this will be for schools. Where there were only three areas of concern before (Reading/ELA, Math, and Grad Rate or Attendance), there are now multiple ways to gain and lose points. First, all core content areas are now addressed, which means that Science and Social Studies are equally important to math and ELA. It also means that the test scores are now a MUCH smaller part of the equation. They have gone from being the majority factor of whether or not a school met AYP to only 40% of the big picture. That is 10% for each content area of the final score before any challenge points are added. That is a huge difference for schools to wrap their arms around. Schools will have to get away from the idea of working the numbers game to make safe harbor and start looking at initiatives that will make significant differences school wide. Many of the graduation rate predictors, post-school readiness indicators, and challenge points will also impact the core content are scores, which means that you are again looking at school improvement through a much wider lens. Examples are Lexile Scores, writing skills, and STEM certification.

Adding It Up… ≤ 10 Points 70 Points 15 Points Content Mastery 40% Achievement 70 Points Progress 15 Points Achievement Gap Challenge Points ≤ 10 Points STAR Ratings (Do Not Impact CCRPI Score) Content Mastery 40% Content Area Test Growth Gap Size and Gap Change EL/ED/ SWD Performance (Flags) Financial Efficiency Rating Post School Readiness 30% Exceeding the Bar Indicators School Climate Grad Rate or Predictors

Achievement Component I Content Mastery—40% Weight This section measures student achievement on criterion referenced tests to determine student achievement. EOCT for High School CRCT for Elementary (grades 3-5) CRCT Middle School Content Mastery, the first portion of the Achievement Score section of the CCRPI, measures student achievement on standardized tests. This determines how well a school is doing with instruction. Elementary, grades 3-5, and Middle use the CRCT as the measure of content mastery while high schools use the EOCT.

How to Calculate Content Mastery Druid Hills High had 75.9% of its students meet and exceed on the 9th grade Literature EOCT in 2011-2012… 75.9% x 10 = 7.6 points earned on this indicator Other EOCT indicators: American Lit (11th grade - 8.8) , Coordinate Alg/GPS Alg/Math I (6.5), Analytic Geo/GPS Geo/Math II (5), Physical Sci (6), Biology(9th grade - 6.6), US History (11th grade - 7.2), Economics (7.9) All indicators are calculated in the same way to find a total score. 8.8+6.5+5+6+6.6+7.2+7.9 = 55.6 Druid Hills High had a total of 55.6 points from all eight content mastery indicators. This score is divided by the total of 80 possible points… 55.6 ÷ 80 = .695 OR 69.5 % Category Performance The Category Performance is calculated at a weight of 40% to achieve the content mastery score… .695*.40 = .278 .792 x .40 = .3168 Weighted Performance Once you have the category performance score, you multiply it by .40 (40% of the total achievement score) to get the weighted performance score. This will be added to the other achievement component scores later.

Paradigm Shift Alert!!! AYP CCRPI Reading/ELA combined + Math = 100% of Achievement Calculations 2/3 of AYP determination CCRPI ELA + Math + Science + Social Studies = 40% of Achievement Calculations Less than 1/3 CCRPI total score This is a new world in terms of how we look at these scores. The content area scores for Science and Social Studies are EQUAL to those of Math and ELA. This completely changes the face of accountability in terms of classroom instruction. These scores are important and will impact us in a variety of ways, but they are no longer the whole story.

HOWEVER…. Progress Gap Size/Change Challenge Points Uses content area composite score to calculate Progress Gap Size/Change Uses state targets and subgroup targets for content area scores Challenge Points Clearly, the accountability has changed for the core content area scores. It’s moved from two subjects to five subjects and from the majority of the total score to only part of the total score. However, it is very important to note that content mastery will come up again and again. The core content areas will be used to calculate the progress and gap scores. In addition, challenge points will be awarded only for subgroups that meet the state targets. This will become more evident as we get to those sections later in this presentation.

Achievement Component II: Post High/Middle/Elementary School Readiness—30% Weight This section looks at areas proven to positively impact students and prepare them for the next level of education: Career Planning/Pathways Advanced Content Courses English Language Support World Language Courses Writing Skills Interpretation of Complex Text (Lexile Scores) The second section of the Achievement Score is designed to predict readiness beyond high school, middle school, and elementary school. It looks at areas that have been scientifically researched and proven to help students be prepared for the next level of school, such as career planning and pathway, advanced content courses, English Language support, foreign language, writing ability and the ability to interpret complex texts as measured through Lexile levels. This section of the Achievement Score has a weight of 30%.

Calculating Post -Secondary School Readiness Calculation is similar to achievement point calculation for each indicator. The total indicator score is divided by the total points possible. Druid Hills earned a total of 53.8 points on seven indicators worth ten points each…53.8 ÷ 70 = .76857 OR 76.86 % The Category Performance is calculated at a weight of 30% to achieve the Post High School Readiness score… .76857 x .30 = .230571 Weighted Performance The calculation of the post readiness score is the same as the content mastery score.

Post High School Readiness Indicators % of graduates completing a career pathway within their program of study (6.4) See the Career Pathways link on the Counseling Page of our website: http://www.dekalb.k12.ga.us/druidhills % of graduates entering the Georgia’s State and Technical Colleges/Universities not requiring remediation or support courses or (8); Test scores: > 22 on the Composite ACT, > 1500 on the Combined SAT, > 3 on > 2 AP exams, > 4 on > 2 IB exams

Post High School Readiness Indicators % graduates in Accelerated Enrollment (ACCEL, Dual Hope, Move on When Ready, Early College, Gateway to College), AP courses, or IB courses (7.5) % graduates with > 2 World Language credits (same language) – NEW for 2013-2014 % of scores Meeting or Exceeding the GHSWT (9.4) % students with a 1275 Lexile measure on the Am. Lit. EOCT (about a 87% on the exam) (8.1) % of EOCT assessments at the exceeds level (5) Student attendance rate (9.4)

Achievement Component III Graduation Rate—30% Weight Calculation is similar to achievement point calculation for each indicator. The total indicator score is divided by the total points possible. Two graduation rates 4-year Cohort Graduation Rate for 2013 CCRPI: = # of 2012 Cohort Members graduating with a Regular Ed Diploma in 2012 # 1st time 9th graders in 2008-2009+Transfers In –Transfers Out/Emigrate through 2012 5-year Extended Cohort Graduation Rate for 2013 CCRPI: = # of 2014 Cohort Members graduating w/ a Regular Ed Diploma in 2012 and 2013 # 1st time 9th graders in 2008-2009+Transfers In –Transfers Out/Emigrate through 2013

Achievement Component III Graduation Rate—30% Weight 2012 CCPRI 4-year: 62.13% = 6.2 5-year: 64.56% = 6.5 Druid Hills earned a total of 12.7 points on two indicators worth ten points each…12.7 ÷ 20 = .635 OR 63.5% The Category Performance is calculated at a weight of 30% to achieve the Graduation Rate score… .635 x .30 = .1905 Weighted Performance

Druid Hills High School Achievement Score—70% Druid Hills High School Content Mastery + Post High/Middle/Elementary School Readiness + Graduation Rate/Predictors of Graduation Raw Score x 70 = Achievement Score .278 + .230571 + .1905 .69857 .69857 x 70 = 48.9 Achievement Score on CCRPI = 48.9 Now it’s time to calculate out total achievement score. All of the Weighted performance scores are added together and then multiplied by 70 to arrive at the Achievement Score on CCRPI.

Adding It Up… ≤ 10 Points 70 Points 15 Points Content Mastery 40% Achievement 70 Points Progress 15 Points Achievement Gap Challenge Points ≤ 10 Points STAR Ratings (Do Not Impact CCRPI Score) Content Mastery 40% Content Area Test Growth Gap Size and Gap Change EL/ED/ SWD Performance (Flags) Financial Efficiency Rating Post School Readiness 30% Exceeding the Bar Indicators School Climate Grad Rate or Predictors

Progress Score – 15% Describes a student’s growth relative to other students with similar prior achievement Every student’s Student Growth Percentile has the potential to earn points towards the Progress Score Analyzes Student Growth within the four core content areas: English/Language Arts, Math, Science, and Social Studies using student achievement data and is assigned a score according to a predetermined rubric by GaDOE. Total of 15 possible points (15% of total CCRPI) The College and Career Ready Performance Index Progress Score helps to describe a student’s growth relative to other students with similar prior achievement. This score goes beyond an overall measure of the school’s achievement for the current year and helps to measure our students against other, similar students statewide to look for evidence of growth from year-to-year. The progress score has a weight of 15% of the overall achievement score and measures the four core content areas: English/Language Arts, Math, Science, and Social Studies. The Progress score will be calculated based on the percentage of a school’s students demonstrating typical or high growth via their Student Growth Percentiles (SGP). An SGP describes a student’s growth on state tests relative to other students statewide with similar prior achievement. A student’s growth percentile can range from 1 to 99, and every student’s SGPs may earn points towards the Progress Score

Calculating the Progress Score 2011-2012 Count of Students Meeting Typical/High Growth Count out of the number of Students with Student Growth Percentiles (SGPs) 9th Grade and Amer. Lit 560/830 Math I, Algebra, Math II, Geometry 420/605 Biology and Physical Science 489/726 US History, Economics 472/654 Total 1941/2815 Percent Meeting Typical/High Growth .69852 Weighted Performance (.69852) X 15 Progress Points Earned 10.3 In 2011-2012, we had 830 students who obtained a Growth Percentile for English Language Arts. Of those 830 students, 560 students demonstrated typical to high growth as defined by a pre-determined rubric set by the GaDOE. For each content area, we compare potential for growth to actual growth until we have a total number of students meeting typical/high growth and a total number of SGPs. It should be noted that this is the SECOND time that core content mastery has an impact on the total CCRPI score.

Adding It Up… ≤ 10 Points 70 Points 15 Points Content Mastery 40% Achievement 70 Points Progress 15 Points Achievement Gap Challenge Points ≤ 10 Points STAR Ratings (Do Not Impact CCRPI Score) Content Mastery 40% Content Area Test Growth Gap Size and Gap Change EL/ED/ SWD Performance (Flags) Financial Efficiency Rating Post School Readiness 30% Exceeding the Bar Indicators School Climate Grad Rate or Predictors

Achievement Gap Score – 15% Assigns points to schools for the progress in closing the gaps or showing small achievement gaps on state tests. Calculates the difference between the schools’ lowest 25% of achievers and the state average. The gap change compares the previous year to the current year and is assigned a score according to a predetermined rubric by GaDOE. For each subject assessment, the higher of the gap size or gap change is taken and assigned a score to obtain a possible total of 16. The Achievement Gap Score is a standardized scale score that assigns points to schools for the gains they have made in closing the gap between the school’s lowest 25% of achievers and the state average. Schools with small gaps or non-existent gaps to begin with will likely be awarded points based on the size of the gap. Schools with significant gains will likely be awarded points for the closing of the gap.

Calculating the Achievement Gap Score Druid Hills High: Gap Size Change Higher of Size/Change Points Possible 9th Grade and Amer Lit 2 3 4 Math I, Alg, Math II, Geo Bio, Phy Sci US Hist, Econ Total 11 16 The gap measure includes two components - a gap size and gap change.  Gap size is defined as the difference in achievement between the state benchmark and the school's high-need students.  Gap change is defined as the gap size for the current year minus the gap size for last year.  For each subject area, a school's final score will be the higher of the gap size and gap change score.  The overall final score will be the average of the final subject area scores.

Calculating the Achievement Gap Score Druid Hills High: Gap Size Change Higher of Size/Change Points Possible Total 11 16 Percent of Higher of Gap Size/Gap Change 11 ÷ 16 = .6875 Weighted Performance = .6875 X 15 Achievement Gap Points Earned : 10.3 Please note that this is the THIRD time that content area scores impact the total CCRPI score.

Adding It Up… ≤ 10 Points 70 Points 15 Points Content Mastery 40% Achievement 70 Points Progress 15 Points Achievement Gap Challenge Points ≤ 10 Points STAR Ratings (Do Not Impact CCRPI Score) Content Mastery 40% Content Area Test Growth Gap Size and Gap Change EL/ED/ SWD Performance (Flags) Financial Efficiency Rating Post School Readiness 30% Exceeding the Bar Indicators School Climate Grad Rate or Predictors

Challenge Points Score – Up to 10 Additional Points Schools can receive “Challenge Points” to add to the total score (up to 10 additional points). EL/ED/SWD Points can be received if a school has a significant number of Economically Disadvantaged, English Learner Students and/or Students with Disabilities who are meeting expectations. Points can also be earned for going beyond CCRPI targets (Exceeding the Bar) in college and career readiness programs.

Performance Flags - Legend Subgroup met both State and Subgroup Performance Targets Subgroup met Subgroup but not State Performance Target Subgroup met State but not Subgroup Performance Target Subgroup did not meet either the State or Subgroup Performance Targets Subgroup met Participation Rate, State Performance Target and Subgroup Performance Targets Subgroup met Participation Rate and Subgroup Performance Target but not State Performance Target Subgroup met Participation Rate and State Performance Target but not Subgroup Performance Target Subgroup met the Participation Rate, but did not meet either the State or Subgroup Performance Targets

Druid Hills High Performance Flags - 2012 Subgroup Performance 2012 End of Course Tests 2011 Graduation Rate 9th Grade Lit Amer. Lit Math I Math II Bio Phy Sci US Hist Econ Asian/Pacific Islander Black Hispanic Multi-Racial White Economically Disadvantaged Students With Disability English Learners

Calculating the EL/ED/SWD Challenge Points Druid Hills had 3324 Full Academic Year (FAY) Students with test scores (numbers include tests taken for all content areas) Of the 3324 FAY students, 2269 are Economically Disadvantaged, English Learners, and/or Students with Disabilities. The percent of ED/EL/SWD students with test scores is .68261, which means that out of a possible 10 points, the school has the POTENTIAL to earn 6.8 Flag Count for ED/EL/SWD = 27 Flag Count for ED/EL/SWD meeting subgroup performance targets = 7 % Flag Count for ED/EL/SWD meeting subgroup performance targets = ..25926 6.8 x .25916 = 1.8 1.8 Challenge Points Awarded for EL/ED/SWD Performance Please note that this is the FOURTH time that the content area scores have impacted CCRPI points. It should also be noted how many of our students are in this category. It is becoming clear how important it is that our students meet their state target scores using this new model. FAY students are enrolled in 65% of the number of days for the course, beginning at the start of the marking period to the end of the marking period

Exceeding the Bar In addition to the points Achievement, Progress, and Achievement Gap, and EL/ED/SWD Challenge Points, the school can earn points for utilizing practices and programs that prepare students for future careers. Schools can earn up to ten extra Challenge Points for all combined indicators.

Exceeding the Bar Physics Course % 9th SWD students with 3 core Carnegie units + passing EOCT % 9th graders with 4 core Carnegie units + passing EOCT STEM Certification Work-Based Learning or Capstone Project > 3 Carnegie units in a world language (NEW in 2013-2014) Teachers using State Longitudinal Data System (NEW in 2013-2014) Innovative Practices School Climate (TBD) ESOL w/positive movement on ACCESS test Additional points can be awarded for exceeding the bar in a variety of areas. For a complete list of potential areas to earn points in elementary, middle, and high schools you can visit the CCRPI link of the Georgia DOE website. Please note that unlike other areas of the CCRPI that are uploaded by the state, these points can only be awarded if the information is uploaded by the school and/or district. Some indicators, such as innovative practices for academics or school climate, must be accompanied by supporting pre and post data.

Druid Hills High’s Points Earned Physics: Bar was 88.7%; DHHS was 41% 9th grade SWD: Bar was 100; DHHS was 70.9% 9th grade core content: Bar 93.4%; DHHS 79.2% ACCESS: Bar was 100%; DHHS was 91.6% WBL/Capstone: Bar was 99.7%; DHHS was 10.8%

Druid Hills High’s Score 73.1 Achievement Points 48.9 Progress 15 Points 10.3 Achievement Gap Challenge Points ≤ 10 Points 1.8 STAR Ratings (Do Not Impact CCRPI Score) Content Mastery 40% .278+ Content Area Test Growth .68952 Gap Size and Gap Change .6875 EL/ED/ SWD Performance (Flags) Financial Efficiency Rating Post School Readiness 30% .230571+ Exceeding the Bar Indicators 0.0 School Climate Grad Rate or Predictors .1905= .69857x 70 .68952X 15 .6875 X 15 N/A Now lets put it all together. Remember the breakdown – Achievement is 70% or points. Progress is 15%, and Achievement Gap is 15%. In the case of this sample school we can now add it up for the final CCRPI score.

Coming Soon…Star Ratings Beginning in 2013-2014 schools will also receive star ratings in two areas based on their financial efficiency and the school climate. These scores will be for public information only and will not affect the overall CCRPI score, but are valuable for stakeholders as they consider the operational structure of the school. The scores for the financial efficiency rating will be derived through system and state level audits. The school climate rating will be derived through perception data gathered through multiple surveys, such as the Safe and Drug Free School Survey and the Georgia School Personnel Survey. Beginning in 2013-2014 schools will also receive star ratings based on their financial efficiency and school climate. These scores will be for public information only and will not affect the overall CCRPI score. Scores are derived through perception data and financial audits.

Additional Information The GADOE ESEA Waiver The GADOE Accountability Web Page CCRPI Scores by School and District If you would like more information regarding understanding the new ESEA Waiver, the new CCRPI Instrument, or would like to access your child’s CCRPI data, you can visit the applicable GaDOE Web pages hyperlinked here or by visiting www.gadoe.org.

Questions and Comments??? In 2012, the Georgia Department of Education applied for and received a waiver to the No Child Left Behind Act. This allowed states to view accountability on a more broad scope, looking beyond the sole measure of Adequate Yearly Progress, but looking also at growth and overall achievement of all students. This new accountability instrument is called the College and Career Readiness Performance Index, or CCRPI.