Using Student Growth Percentiles in Educator Evaluations

Warm Up The median is the middle number in a sequence of numbers On your table is a ½ sheet of paper that lists the heights of students in a teacher’s class Write the students’ heights in order from shortest to tallest Identify the median height and circle it

Norms Fully present Share your expertise Equity of voice Active listening Respect the current speaker – no side conversations Safety to share different opinions and perspectives Respectful use of technology

Connector On an index card please complete the following sentence stem “One of the most important learnings that I hope to take away today is…”

Give One, Get One! You will have 5 minutes to:  Circulate around the room  Introduce yourself to a colleague (name, position & district)  Share the information on your card, and then exchange cards  Start the process over again

Outcomes for Today To increase knowledge of Student Growth Percentiles (SGPs) and Median Student Growth Percentiles (MSGPs) Clarify the connection between SGPs and SLGs for the SY

Waiver Update On July 23, 2015,the USDOE approved Oregon’s ESEA flexibility waiver renewal request for three years through the school year

In other words… Oregon met the condition placed on our waiver the previous year to provide evidence of a statewide approach for how teachers and principals set their student learning and growth goals in tested grades and subjects to ensure rigor and consistency across the state

As a result… Beginning in the school year, as a requirement of the ESEA waiver, all districts will begin using Student Growth Percentiles (SGPs) to meet the state assessment requirement for Student Learning and Growth (SLG) in grades 4-8 in English/Language arts (ELA) and math

Request to USED for ODE has requested a modification to the waiver Districts will determine MSGPs, but not incorporate them in educator summative evaluations for SY Districts required to provide SGP training to staff ODE recommends that all educators set two goals that use Category 2 measures

Student Growth Percentiles (SGPs) Normative growth measure One year of growth Growth is relative to students with a similar score history

What do we mean by normative growth?

35% 65% Percentiles 35th

3 rd Grade 2262 Level 1 4 th Grade 2398 Level 2

Level 1 Level 2 Level 3 Level ELA/Literacy Scale Score Thresholds Oregon Score Distribution 3 rd Grade Reading

Grade 3 Grade 4 Level 1 Level 2Level 3 Level 4 4 th Grade rd Grade 2262

points

Anthony’s Comparison Group

19 All 3 rd grade test takers in Oregon …with Anthony’s Prior Score ~2262 Level 1 Level 2Level 3 Level 4

Anthony’s prior score ~2262 Anthony’s Comparison Group Level 1 Lev el 2Level 3 Level 4

Level 1 Level 2Level 3 Level 4 Anthony’s Comparison Group High score Middle score 4 th Grade Score Distribution Anthony’s prior score ~2262

Level 1 Level 2Level 3 Level 4 Anthony’s Comparison Group 4 th Grade Score Distribution 80% of students in Anthony’s comparison group scored below him 2398

Level 1 Level 2Level 3 Level 4 SGP = 80 Anthony’s Comparison Group 4 th Grade Score Distribution

Processing Time With the colleagues at your table: Talk about what you’ve heard so far Identify a question your group still has about SGPs (Up Next: Determining Median SGPs)

Term Clarification A Student Growth Percentiles (SGP) measures growth for an individual student A Median Student Growth Percentile (MSGP) represents the exact middle of a group of students’ SGPs

Median Student Growth Percentiles Students in Mr. Waters class StudentSGP Sheryl3 Hector 22 Robert36 Miranda38 Tre51 Anna54 Eric71 Anthony80 Amina93

Making a Determination of Student Growth Category 1 SLG Rating 1234 Median SGP Criteria 1 to 34 percentile 35 to 49 percentile 50 to 64 percentile 65 to 99 percentile InterpretationLow growthBelow average growth Above average growth High growth The Median Student Growth Percentile (SGP) determines the educator’s Category 1 SLG Rating

X-Axis = SLG Rating SLG performance level based on two goals Two-year cycle select two of four goals Score SLG goals Get a rating between 1 and 4; Use X-Axis thresholds to determine SLG level: 4 = both goals 4s 3 = both goals 3s; one goal 3 & one goal 4; one goal 2 & one 4 2 = both goals 2s; one goal 2 & one 3; one goal 1 & one 3; one goal 4 & one 1 1= both goals 1s; one goal 1 & one 2 Mr. Waters SGP was rated 3 Second SLG was rated 3  X-Axis Rating = Level 3 SLG Rating

Y-Axis = PP/PR Rating Add up all component scores for total points possible; Divide by number of components in your rubric; Get a rating between 1 and 4; Use Y-Axis threshold to determine PP/PR level: = = – 2.8 = 2 * < 1.99 = 1 *PP/PR Scoring Rule: If the educator scores two 1’s in any PP/PR component and his/her average score falls between , the educator’s performance level cannot be rated above a 1. Mr. Waters District rubric with 20 components Component ratings: 17 components were rated 3; and 3 were rated 2 = 57 points possible 57/20=2.85  2.85 = Level 3 PP/PR Rating

*Inquiry Process Mr. Waters: Y-axis = 3 & X-axis = 3

Questions?

Your Turn! Use the data packet provided to: Calculate Mr. Hendrick’s Y-axis rating Determine Mr. Hendrick’s median SGP Calculate Mr. Hendrick’s X-axis rating Share Out

*Inquiry Process

Timeline and Responsibilities SY ODE RESPONSIBILITIESDISTRICT RESPONSIBILITIES Fall 2015 Provide districts state criteria for determining Median Student Growth Percentiles (see Table 3 on page 5 in this guidance). Provide districts with communications and guidance. Select Option A or Option B to be used district-wide. Establish a process for determining the teacher of record. Create class rosters and establish a roster verification process School Year Provide districts with professional development and technical support. Provide training in the district to educators, evaluators, and coordinating staff. February - June 2016 Administer Smarter Balanced Assessment Educators verify class rosters. Summer 2016 Calculate Student Growth Percentiles for all students. Send districts Student Growth Percentiles and Smarter Balanced achievement data in August. Receive Student Growth Percentiles and Smarter Balanced results from ODE. Fall 2016 Provide guidance and support to districts. Determine the Median Student Growth Percentile ratings using the state criteria. Incorporate median Student Growth Percentile ratings into educator summative evaluations.

How do SGPs change the goal setting and scoring processes? Teachers and principals in grades 4- 8 in ELA and math All other educators

All Other Educators Minimum of 2 SLG goals each year Quality Review Checklist used for goal setting Goals can use either: Category 1 (statewide assessments) OR Category 2 (school or district-wide assessments) measures Goals scored using the statewide SLG Scoring Rubric Oregon Matrix used to identify summative scores Student Learning and Growth Guidance

Teachers and Principals in Grades 4 – 8 ELA and Math Minimum of 2 SLG goals each year Quality Review Checklist used for goal setting One goal must use Category 1 measure (Smarter) Method for scoring Category 1 goal depends on whether the district uses Option A or Option B Second goal can use either Category 1 or Category 2 measures Category 2 goals scored using the statewide SLG Scoring Rubric Oregon Matrix used to identify summative scores

What do districts need to do? Select Option A or B Establish procedures Create rosters

Select Option A or Option B Collaboration is key! Option AOption B Educators are not required to set a Category 1 SLG goal. There is no required goal setting process for Category 1. Educators are required to set one Category 2 SLG goal using the SLG goal template and rate their goal using the SLG scoring rubric Educators are required to set one Category 1 SLG goal using Smarter Balanced and rate their goal using the SLG scoring rubric. Educators are required to set one Category 2 SLG goal using the SLG goal template and rate their goal using the SLG scoring rubric. Student Growth Percentiles are used exclusively to determine the Category 1 SLG rating. Educators’ SLG goal rating is then compared with their Median Student Growth Percentile rating to determine their final Category 1 SLG rating.

OPTION A Fall 1.Districts determine which educators are required to use Median Student Growth Percentiles and create the educators’ class rosters for teachers and principals in grades 4-8, ELA/math. 2. Educators set a Category 2 SLG goal following the SLG goal setting template. (They do not set a Category 1 SLG goal.) Spring 3. In May educators verify their class roster through a district-determined process. Summer/ Fall 4. Districts receive Student Growth Percentiles from ODE in August following the spring test administration. 5. Using the Student Growth Percentiles data from ODE, districts calculate the Median Student Growth Percentiles for the educator’s class roster as follows: a.Rank the students’ scores in the class roster from highest to lowest. b.Locate the middle score (median) in the range to find the Median Student Growth Percentile. If the educator has an even number of students, average the two middle scores. c.Using the state criteria identify the corresponding Median Student Growth Percentile Category 1 SLG rating (1-4). 6. The educator and evaluator use the X-axis table to determine the educator’s SLG performance level for the Oregon Matrix based on the Median Student Growth Percentile and Category 2 SLG goal ratings.Oregon Matrix

Fall 1. Districts determine which educators are required to use median Student Growth Percentiles and create the educators’ class rosters for teachers and principals in grades 4-8, ELA/math. 2. Educators set two goals: Category 1 SLG goal and Category 2 SLG goal following the SLG goal setting template. Spring 3. In May, educators verify their class roster through a district-determined process. Summer/ Fall 4. Districts receive Student Growth Percentiles from ODE in August following the spring test administration. 5. Using the Student Growth Percentiles data from ODE, districts calculate the Median Student Growth Percentiles for the educator’s class roster as follows: Rank the students’ scores in the class roster from highest to lowest. Locate the middle score (median) in the range to find the Median Student Growth Percentile. If the educator has an even number of students, average the two middle scores. Using the state criteria identify the corresponding Median Student Growth Percentile Category 1 SLG rating (1-4). 6. Using the state assessment results, the educator and evaluator score the Category 1 SLG goal using the state SLG Goal Scoring Rubric.SLG Goal Scoring Rubric 7. The evaluator uses the decision table to compare the educator’s Category 1 SLG goal rating with the Median Student Growth Percentile rating to determine the combined Category 1 SLG rating (X- and Y-axes intersect). 8. The educator and evaluator use the X-axis table to determine the educator’s SLG performance level for the Oregon Matrix based on the Median Student Growth Percentile and Category 2 SLG goal ratings.Oregon Matrix 9. If the ratings differ by more than two, use the inquiry process below to determine the final rating. OPTION B

FOCUSED COLLABORATION Learning Exercise Discuss with colleagues at your table how your district might go about making the decision as to which option the district will choose Remember Districts are advised to have a collaborative team of teachers, administrators, and association representatives work collaboratively to choose between Options A and B

Before using Student Growth Percentiles, districts will need to establish procedures and a process for using Median Student Growth Percentiles district-wide. This process should be established Fall 2015 Starting to Plan…

Establish Procedures… Teacher of Record: which teachers and principals are responsible for content covered by Smarter Balanced assessments in grades 4-8 for ELA and math Roster creation and verification Provide rosters to teachers and principals in the fall for planning purposes Verify rosters in the spring for evaluation

Create rosters… Determine who is on each roster Elementary: Every student in a class that takes Smarter in ELA or math Middle: All students within a particular course who take Smarter in either ELA or math Principals: All students in a particular grade who take Smarter in either ELA or math

Impact of Class Size on SGPs Districts are required to use Median Student Growth Percentiles for educators who have at least 20 students Teachers and principals in grades 4-8 (ELA and math only) who fall below 20 students must use other measures that are valid, reliable, and comparable across the school or district (Category 2 measures)

Using an index card at your table, please identify: One learning from today; and Two questions you still have about SGPs Feedback

Resources ODE Webpage for SGPs has been added to the EE Toolkit ODE Webpage for SGPs ESD Regional Workshops Contact your ESD to find out when a regional training might be available in your area

Remaining questions?

ODE Contacts Educator Effectiveness Team: Tanya Frisendahl Sarah Martin Sarah Phillips Brian Putnam