I NFUSING V ALUE -A DDED INTO THE SLO PROCESS August 2015

T URN AND T ALK : W HAT DO YOU KNOW ABOUT VALUE ADDED DATA ?

Page 1

Beginning of Year Working collaboratively with their evaluator or a peer, educators draw upon the SLO and Outcome Summary Process Guide (see page 2) to develop a minimum of one SLO. The development of the SLO now must include the review of teacher and principal value- added, as well as graduation rates or schoolwide reading value-added (as appropriate to the role of the educator). Educators continue to document the goal within the appropriate online data management system (e.g., Teachscape or MyLearningPlan). Collaborative learning-focused conversations are required as part of the process, but flexibility exists in whom educators collaborate with in Supporting Years. However, in Summary Years, educators must conduct this process with their evaluators.

Page 2

What is new or different from last year?

Page 3

TEACHERS  Teacher Value-Added and Schoolwide Reading: When developing SLOs, teachers must review individually, as well as with teacher teams at both the grade level and across the content area (e.g., schoolwide reading value-added), to identify trends (i.e., strengths and areas for growth) across time. These trends can inform SLOs or professional practice goals, based on areas of need. Working in teams with other teachers could inform the development of a team SLO that may align to a School Learning Objective identified by the principal. Value-added trends may also illuminate strategies that have worked well, based on areas of strength, and can support ongoing instructional efforts. Working in teams with other teachers could provide the opportunity to share best practices and successful strategies which support school improvement plans and/or goals. L ET ’ S WALK THROUGH THIS …

Graduation Rate: When developing SLOs, high school teachers must review graduation rate data across time to identify positive or negative trends regarding the matriculation of their school’s students. During this review, teachers should reflect on how their practice has supported the trends within the graduation rate data. Teachers should also review the data in vertical and horizontal teams to review school (and district) practices which positively and negatively impact graduation rates. This analysis can inform the development of SLOs, as well as professional practice goals, to support the improvement of graduation rates of the educator’s students. This review can also illuminate the success of various college and career ready strategies implemented by teachers and across the school to be modified or duplicated.

Educators are not required to develop a goal based on these data or to develop a goal with the intention to improve these data, unless the data indicates that is necessary. As always, the purpose of the Educator Effectiveness System is to provide information that is meaningful and supports each individual educator’s growth in their unique roles and contexts. By reviewing multiple data points, including those listed above, the educator has access to a more comprehensive view of their practice and a greater ability to identify areas of strength and need—both of which can inform the development of goals, as well as instructional/leadership strategies which can support progress towards goals. Note: Due to the lag in data provided by DPI to districts, as well as the date in the year in which the data is provided to the districts (i.e., the following year), educators should only use the data to review trends across time when developing an SLO. Educators should not use the data to score SLOs.

Our MISSION as educators is to improve teaching and learning.

M INDSET O F I MPROVEMENT “You don’t have to be sick to get better!”- Michael Josephson

M INDSET O F I MPROVEMENT Continuous Improvement is for EVERYONE

T HERE ARE 2 GENERAL WAYS TO LOOK AT STUDENT ASSESSMENT DATA 14 Attainment model - a “point in time” measure of student proficiency compares the measured proficiency rate with a predefined proficiency goal. Growth model – measures average gain in student scores from one year to the next accounts for the prior knowledge of students.

W HAT IS V ALUE -A DDED ? It is a type of growth model that measures the contribution of schooling to student performance on the WKCE in reading and in mathematics Uses statistical techniques to separate the impact of schooling from other factors that may influence growth Focuses on how much students improve on the WKCE (or our new assessment) from one year to the next as measured in scale score points 15

More Clear Data Picture Many data pieces give us a fuller picture… STAR WKCE or Badger AIMSweb ACT WorkKeys Classroom Assessments AP Surveys Aspire Observation Data PALS VA Data Why would we care about Value Added data?

VA allows for fairer growth comparisons to be made (in contrast to pure achievement ) 17 90% Proficiency School A School B 86% Proficiency 6% Free and Reduced 90% Free and Reduced

VA ALLOWS FOR FAIRER GROWTH COMPARISONS TO BE MADE ( IN CONTRAST TO PURE GROWTH ) We know that in Wisconsin, certain groups of students do not grow (or achieve) at the same rate as others. This can be due to the achievement level of a child (lowest students can grow the most) This can also be related to demographics such as Special Ed status ELL Race/ethnicity Economically Disadvantaged etc.

Hi! I’m a 4 th grade boy. I got a scale score of 2418 on my WKCE in reading this year! And these are all the other boys in WI who had the exact same scale score as me. 4 th grade

Now I’m in 5 th grade and just got a scale score of 2449 on my reading WKCE! I grew 31 points. All of the other boys took the test again, too. Their average scale score was Their growth was 25 points. 5 th grade

So we would say that my teachers in 4 th grade had a higher Value Add than would be expected. 5 th grade Average growth was 25 points I grew 31 points

Outside the school’s influence Race/Ethnicity Gender Section 504 Economic Status Disability (by type) Prior Year Score (reading and math) English Proficiency (by category level) Mobility U SING THE SAME PROCESS, VA C ONTROLS FOR THESE FACTORS

H OW DO THEY DECIDE WHAT TO CONTROL FOR ? Check 1: Is this factor outside the school or teacher’s influence?Check 2: Do we have reliable data?Check 3: If not, can we pick up the effect by proxy?Check 4: Does it increase the predictive power of the model?

C HECKING FOR U NDERSTANDING What would you tell a 5 th grade teacher who said they wanted to include the following in the Value-Added model for their results?: A. 5 th grade reading curriculum B. Their students’ attendance during 5 th grade C. Education level of the parents D. Student motivation Check 1: Is this factor outside the school or teacher’s influence?Check 2: Do we have reliable data?Check 3: If not, can we pick up the effect by proxy?Check 4: Does it increase the predictive power of the model?

R EPORTING V ALUE -A DDED In the latest generation of Value-Added reports, estimates are color coded based on statistical significance. This represents how confident we are about the effect of schools and teachers on student academic growth. Green and Blue results are areas of relative strength. Student growth is above average. Gray results are on track. In these areas, there was not enough data available to differentiate this result from average. Yellow and Red results are areas of relative weakness. Student growth is below average.

Grade Value-Added is displayed on a 1-5 scale for reporting purposes. About 95% of estimates will fall between 1 and 5 on the scale. Most results will be clustered around represents meeting predicted growth for your students. Since predictions are based on the actual performance of students in your state, 3.0 also represents the state average growth for students similar to yours. Numbers lower than 3.0 represent growth that did not meet prediction. Students are still learning, but at a rate slower than predicted. Numbers higher than 3.0 represent growth that beat prediction. Students are learning at a rate faster than predicted.

Grade % Confidence Interval 30 READING Value-Added estimates are provided with a confidence interval. Based on the data available for these thirty 4 th Grade Reading students, we are 95% confident that the true Value-Added lies between the endpoints of this confidence interval (between 3.2 and 4.4 in this example), with the most likely estimate being

C ONFIDENCE I NTERVALS Grade READING Grade 4 36 Grade Grade Grade 4 36 Grade MATH Color coding is based on the location of the confidence interval. The more student data available for analysis, the more confident we can be that growth trends were caused by the teacher or school (rather than random events).

L ET ’ S L OOK AT THE R EPORTS A VAILABLE IN S CHOOL A CCESS F ILE E XCHANGE (SAFE)

W E BEGIN WITH SOME CAVEATS ! VA is one data source among many that provides a different perspective on student growth. VA should never be the sole data source to identify effective/ineffective schooling! Taking VA out of the Student Outcome score allows each educator to decide how (or if) this data informs the SLO process.

T HIS NEXT SECTION IS INTENDED FOR YOU TO USE WITH YOUR OWN SCHOOL VA REPORTS. Y OU MAY CHOOSE TO USE YOUR SNIPPING TOOL TO INSERT YOUR SCHOOL DATA IN THE APPROPRIATE PLACE. P RINTING COLOR COPIES OF YOUR VA REPORTS FOR STAFF MIGHT ALSO BE HELPFUL

Page 1 Introduction to VA Color Coding

Page 2 With a partner: What are some observations you can make about this data as a school? How might teacher teams use this data?

Share your thinking

Let’s look at our VA as a school With a partner: What does this data suggest about how we are growing students in reading and in math? Use your snipping tool to insert a screenshot of the top section only of your own school VA report page 2 here…it will look something like this.

Share your thinking

Let’s look at our VA by grade With a partner: What does this data suggest about how we are growing students across grades in our school? Use your snipping tool to insert a screenshot of the bottom section only of your own school VA report page 2 here…will look something like this.

Share your thinking

Pages 3 & 4 With a partner: What are some observations you can make about this subgroup data? What questions do you have?

Let’s look at our reading VA with subgroups With a partner: How effective was our school in growing different groups of students in reading? Use your snipping tool to insert a screenshot of your own school VA report page 3 here…it will look something like this.

Let’s look at our math VA with subgroups With a partner: How effective was our school in growing different groups of students in math? Use your snipping tool to insert a screenshot of your own school VA report page 4 here…it will look something like this.

Share your thinking

Page 5 Introduction to VA Scatter Plots

With a partner: How might a teacher team use this data to identify an area of focus for their SLO?

Pages 6 & 7 Grade level VA and Achievement

Let’s look at our VA and achievement plotted together Use your snipping tool to insert a screenshot of your own school VA/Achievement scatter plots here…they will look something like this. If these are too small to see you may need to print colored copies for pairs or groups. With a partner: What stands out in our school data when we look at achievement and growth together?

Share your thinking

How do/don’t these reports add to our total data picture?

How might today’s learning apply to your own SLO?