1. CORE Academic Growth Model: Introduction to Growth Models
Last updated:

2. Student Growth Models
Growth Model Overview

3. Student Characteristics
A Growth Model is Designed to Measure the Effect of the Education System on Student Growth
Student Growth
Starting Knowledge
Education System
Student Characteristics
Family Resources
Test Characteristics
In a broad sense, a growth model is designed to measure the effect of the education system on student growth.
In this graphic here, we can see there are many factors that might contribute to student growth.
Factors such as student starting knowledge, the impact of the education system, student characteristics, family resources, and test characteristics – like measurement error and how accurate and aligned the test is – might have an impact on an analysis of how much student growth might occur for any particular student.

4. Student Characteristics
Uses Statistical Techniques to Isolate the Impact of the Education System from Non-School Factors
Student Growth
Starting Knowledge
Education System
Student Characteristics
Family Resources
Test Characteristics
In the CORE Academic Growth Model, we use statistical technique to isolate the impact of educators on student assessment score growth separate from these non-school factors.
The goal is to use a method to measure what educators are contributing to student assessment score growth and give credit for that growth.

5. Unpacking the Methodology
The Oak Tree Analogy – An Introduction to Growth Metrics
In order to unpack that methodology, we are going to go through the Oak Tree Analogy, an introduction to growth metrics.

6. The Oak Tree Analogy
[Transition slide]

7. Explaining Growth by Evaluating Gardener Performance
For the past year, these gardeners have been tending to their oak trees trying to maximize the height of the trees.
Gardener A
Gardener B
In this Oak Tree Analogy, there is a scenario where we have two gardeners: Gardener A and Gardener B.
What we are going to do is evaluate the gardeners’ performance at growing their oak trees.
Each gardener was assigned an oak tree for one year and their job was to maximize the height of the tree.
Now we’re going to use a variety of methodologies to evaluate these gardeners as a way to introduce the concepts used in different growth metrics.

8. This method is analogous to using an Achievement Model.
Method 1: Measure the Height of the Trees Today (One Year After the Gardeners Began)
Using this method, Gardener B is the more effective gardener.
This method is analogous to using an Achievement Model.
Gardener A
72 in.
Gardener B
61 in.
Our first method is to measure how high these trees are at the end of the year of gardeners’ care, which is one year after the gardeners began tending to the trees.
[click]
If we use that methodology, Gardener B looks like the more effective gardener because the tree that was assigned to Gardener B was higher at the end of the year. That is analogous to using an Achievement Model to measure the performance of these two gardeners.

9. What is Missing from our Gardener Evaluation?
ACTIVITY
In small groups, discuss what factors are missing from our Gardener Evaluation.
Provide time for groups to discuss and optionally share-out to the larger group. Typical answers come in a few categories:
Growth mindset
Starting height
Last year’s height
Do taller / shorter trees grow faster / slower
Factors gardeners CAN NOT change
Soil quality
Sunshine
Weather
Rain
Insect pests
Factors gardeners CAN change
Fertilizer
Watering
Pruning techniques
If ideas are brought up in the “Factors gardeners CAN change” category, it may be strategic to discuss why a measurement of gardener performance should NOT directly adjust for those factors. In essence, we are trying to capture the effectiveness of those very things that a gardener could use as strategies. This discussion may work better closer to the end of the presentation after the reasoning behind the “Growth mindset” and “Factors gardeners CAN NOT change” are fully addressed.

10. This Achievement Result is not the Whole Story
We need to find the starting height for each tree in order to more fairly evaluate each gardener’s performance during the past year.
Gardener A
72 in.
Gardener B
61 in.
52 in.
47 in.
However, that Achievement Result does not tell the whole story.
We need to find out the starting height of each tree in order to be fairer to the two gardeners.
We want to give credit to the gardeners for what they contributed to tree growth.
We can look back at our record and see that Gardener A’s tree started at 47 inches one year ago and is now 61 inches, and Gardener B’s started at 52 inches and now it is 72 inches.
Oak A
Age 3
(1 year ago)
Oak A
Age 4
(Today)
Oak B
Age 3
(1 year ago)
Oak B
Age 4
(Today)

11. Method 2: Compare Starting Height to Ending Height
Oak B had more growth this year, so Gardener B is the more effective gardener.
This is analogous to a Simple Growth (Gain) Model.
Gardener A
72 in.
Gardener B
+20 in.
+14 in.
61 in.
52 in.
47 in.
In our second method, we use simple subtraction to compare the starting height to the ending height.
[click]
Gardener A’s tree grew 14 inches while Gardener B’s tree grew 20 inches.
In this methodology, there is more growth for Oak B, so it looks like Gardener B is the more effective gardener. That is analogous to using a Simple Growth Model to measure the performance of these gardeners.
However, there may be other factors to consider as well.
Oak A
Age 3
(1 year ago)
Oak A
Age 4
(Today)
Oak B
Age 3
(1 year ago)
Oak B
Age 4
(Today)

12. What About Factors Outside the Gardener’s Influence?
This is an “apples-to-oranges” comparison.
For our oak tree example, three environmental factors we will examine are: Rainfall, Soil Richness, and Temperature.
Gardener A
Gardener B
We want to consider other factors outside of the gardener’s influence when we are measuring the contribution of the gardeners themselves.
What we have right now is an apples-to-oranges comparison since there might have been different characteristics that these oak trees experienced during this year.
In this analogy, we picked three hypothetical environmental factors to examine: Rainfall, Soil Richness, and Temperature.

13. High Low Low High High Low
External Condition
Oak Tree A
Oak Tree B
Rainfall
Soil Richness
Temperature
High Low
Low High
High Low
Gardener A
Gardener B
If we look at the different characteristics for these trees and what they have experienced during this past year, we can see Oak Tree A had high rainfall, low soil richness, and high temperature while Oak Tree B had the opposite set of characteristics.

14. How Much Did These External Factors Affect Growth?
We need to analyze real data from the region to predict growth for these trees.
We compare the actual height of the trees to their predicted heights to determine if the gardener’s effect was above or below average.
Gardener A
Gardener B
To isolate what the gardeners contributed to growth, we need to determine how much those external factors affected the growth of those trees.
For example: Gardener A did not choose to have a high rainfall area. High rainfall was something that happened to Oak A beyond the gardener’s control. We will adjust for rainfall when measuring gardener impact on the growth of those trees.
How are we going to go about doing that? We analyze the real data from the region to predict tree growth based on various characteristics.
For example, we might find that, on average, trees with high rainfall tended to grow 3 inches faster than average, and trees with low rainfall tended to growth 5 inches slower than average.
This will tell us how much different factors affected tree growth so we can give credit to the gardeners for their contribution.
We compare the actual height of the trees to the statistical prediction that is customized for each tree’s environmental characteristics to determine if the gardener’s effect on tree growth was above or below average.

15. Make Initial Prediction for the Trees Based on Starting Height
Next, we will refine our prediction based on the growing conditions for each tree. When we are done, we will have an “apples to apples” comparison of the gardeners’ effect.
Gardener A
74 in.
Gardener B
67 in.
52 in.
47 in.
+22 Average
+20 Average
After analyzing data to determine trends and subsequent adjustments, we are going to come up with a prediction customized for each tree based on its growing conditions.
When we are done making all of those adjustments, we will have an apples-to-apples comparison of the gardeners’ effect.
In the first stage, we make an initial prediction on the height of the trees based on the starting height.
In this case we find that, oak trees that started at 47 inches one year ago today tended to grow 20 inches on average in this region.
Therefore, 20 inches of growth becomes our initial prediction for Oak Tree A.
On the other hand, for Oak Tree B we would look at all the trees that started at a height of 52 inches and find out their average growth.
In this hypothetical data we might find that those trees tended to grow 22 inches.
Therefore, 22 inches of growth becomes our initial predication for Oak Tree B.
Now we are going to start refining it further for each oak tree based on its conditions.
Oak A
Age 3
(1 year ago)
Oak A
Prediction
Oak B
Age 3
(1 year ago)
Oak B
Prediction

16. Based on Real Data, Adjusting Predictions for Rainfall
For having high rainfall, Oak A’s prediction is adjusted by +3 to compensate.
Similarly, for having low rainfall, Oak B’s prediction is adjusted by -5 to compensate.
Gardener A
70 in.
Gardener B
69 in.
52 in.
47 in.
+22 Average
+20 Average
The first environmental factor we are going to adjust for is rainfall.
We are adjusting in an attempt to make a level playing field for these two gardeners.
Our gardeners did not have any choice for how much rain their oak trees received.
Gardener A’s tree had high rainfall. If you remember back a few slides we looked at a trend for the region and found out on average that trees that have high rainfall tend to grow 3 extra inches.
So Oak Tree A’s prediction has increased by 3 inches - it used to be 67, now it is 70 inches to account for that external factor of rainfall on the growth of the tree.
Similarly, Gardener B’s tree had low rainfall so we are going to compensate for that low rainfall by bumping down the prediction by 5 inches due to the trend that we saw for low rainfall trees in the region.
- 5 for Rainfall
+ 3 for Rainfall

17. Adjusting for Soil Richness
For having poor soil, Oak A’s prediction is adjusted by -3.
For having rich soil, Oak B’s prediction is adjusted by +2.
Gardener A
71 in.
Gardener B
67 in.
52 in.
47 in.
+22 Average
+20 Average
We keep adjusting our prediction further for soil richness…
- 5 for Rainfall
+ 3 for Rainfall
+ 2 for Soil
- 3 for Soil

18. Adjusting for Temperature
For having high temperature, Oak A’s prediction is adjusted by -8.
For having low temperature, Oak B’s prediction is adjusted by +5.
76 in.
Gardener A
Gardener B
59 in.
52 in.
47 in.
+22 Average
+20 Average
… And temperature. Again, each of those adjustments come from real data in the region.
- 5 for Rainfall
+ 3 for Rainfall
+ 2 for Soil
- 3 for Soil
+ 5 for Temp
- 8 for Temp

19. Our Gardeners are Now on a Level Playing Field
The predicted height for trees in Oak A’s conditions is 59 inches.
The predicted height for trees in Oak B’s conditions is 76 inches.
76 in.
Gardener A
Gardener B
59 in.
52 in.
47 in.
+22 Average
+20 Average
After adjusting for all of these characteristics, we have come to a level playing field for our two gardeners and their trees.
Our final predicted height for Oak Tree A is 59 inches and our final predicted height for Gardener B’s tree is 76 inches.
That is after we have accounted for the starting height and the difficulty of making growth based on that starting height, as well as rainfall, soil richness, and temperature.
- 5 for Rainfall
+ 3 for Rainfall
+ 2 for Soil
- 3 for Soil
+ 5 for Temp
- 8 for Temp
_________
+24 inches
during the year
_________
+12 inches
during the year

20. Method 3: Compare the Predicted Height to the Actual Height
By accounting for last year’s height and environmental conditions of the trees during this year, we have isolated the gardeners’ contribution to the growth of the trees.
This is analogous to a Growth Model with Context Adjustments -4
76 in.
Gardener A
72 in. +2
Gardener B
61 in.
59 in.
Above
Average
Below
Average
Now that we have that customized prediction for each oak tree, we are going to compare that to the actual height that the gardeners were able to achieve with their trees after a year of care.
So our third method compares the prediction to the actual height.
[click]
We can see that Gardener A actually ended up beating the prediction by 2 inches.
Gardener B’s tree ended up not meeting its prediction by 4 inches.
By accounting for last year’s height and environmental conditions for the last year, we have isolated the gardeners’ contribution to the growth of those trees.
This is analogous to a Growth Model with Context Adjustments, such as the CORE Academic Growth Model.
In this case, Gardener A has an above average effect and Gardener B has a below average effect.
Predicted
Oak A
Actual
Oak A
Predicted
Oak B
Actual
Oak B

21. Every Tree Counts in this Group Measure
To statistically isolate a gardener’s effect, we need data from many trees under that gardener’s care.
Gardener A
Gardener B
In our analogy, we only used a single tree. However, it is important to note that every tree counts in this group measure. We need to have whole groups of trees to isolate the gardeners’ effect.

22. Linking the Analogy to Reality
Oak Tree Analogy
CORE Academic Growth Model
Goal: measure the impact of gardeners
Goal: measure the impact of the education system on Mathematics and ELA growth including principals, classroom teachers, support teachers, etc.
School A
In the analogy, our goal was to measure the performance of gardeners. In the CORE Academic Growth Model, our goal is to measure the impact of educators in Math and English Language Arts on student assessment score growth as one of multiple measures in the School Quality Improvement Index.
It is important to note that in the analogy our goal was not to measure the performance of trees. Similarly, in the CORE Academic Growth Model our goal is not to measure the performance of individual students. We are using student data in order to assess the impact of the education system.

23. Linking the Analogy to Reality
Oak Tree Analogy
CORE Academic Growth Model
Outcome: growth of tree height in inches
Outcome: growth of student test score
The outcome that we are using in the tree analogy is the growth of tree height in inches from one year to the next. In the CORE Academic Growth Model, we are using the student test scores from one year to the next.
Last Year Height
This Year Height
2015
Test Score
2016
Test Score

24. Linking the Analogy to Reality
Oak Tree Analogy
CORE Academic Growth Model
Adjustments for:
Starting Height
Rainfall
Soil Richness
Temperature
Adjustments for individual students and school average concentration:
Prior test history (both Math and ELA)
Economic disadvantaged status
Disability status (and severity level)
English learner status
Homelessness status
Foster status
What about adjustments?
In the analogy, we made adjustments for Starting Height – and subsequently if it is harder or easier to make growth based on the height of the tree – as well as adjustments for Rainfall, Soil Richness and Temperature.
In the CORE Academic Growth Model, we are making adjustments for Prior Test Score History - if it is harder or easier to make growth based on a student’s starting point in the test scale. Typically, we find that students higher in the test scale do not grow as many points on the assessment as students lower in the scale. By adjusting for that, the CORE Academic Growth Model is fairer in its measurement of educator contribution to growth.
We are also adjusting for Economic Disadvantaged Status, Disability Status (and severity level), English Learner Status, Homelessness Status, and Foster Status with that same goal of making an apples-to-apples comparison of educators serving different student populations.
Not only are these adjustments made at the student level, but the CORE Academic Growth Model also adjusts for concentration of these characteristics within the school.

25. Linking the Analogy to Reality
Actual Score
Student
Exceeded
Average Growth by 5 Points
Average Growth
Student Did Not Meet Average Growth by 4 Points
Actual Score
Average Growth
Let’s take a look at this another way:
On the left is a student who exceeded their prediction by 5 points.
On the right is a student who did not meet their prediction by 4 points.
The CORE Academic Growth Model takes into account the degree to which a student met or did not meet their prediction rather than just a “yes” or “no” on whether it was met.
2015
Test Score
2016
Test Score
2015
Test Score
2016
Test Score

26. Linking the Analogy to Reality
Oak Tree Analogy
CORE Academic Growth Model
Gardener rating based on: average effect on group of trees
Education System rating based on: average effect on group of students
In the analogy, gardener rating was based on the average effect on a group of trees.
In the CORE Academic Growth Model, school rating is based the average effect on a group of students.

27. CORE Academic Growth Model: Step-By-Step
Last updated

28. CORE Academic Growth Model
Step 1
Step 2
After Spring testing is complete, EA collects student data from the CORE Districts & EA determines demographic and other adjustments
Each student gets a customized statistical prediction based on his or her characteristics
+35 Average Growth
- 3 for Econ. Disadv.
- 4 for Disability
+ 2 for EL Status
_________
+32 points
During the year
+ 1 for Foster Status
+ 2 School Averages
- 1 for Homeless Status
[main points on slide]
Note: specific numbers on this slide for adjustments are for illustrative purposes, the actual adjustment amounts are calculated each year and for each grade/subject independently and reflect the actual observed trends across the CORE districts
Spring 2015
Test Score
Spring 2016
Predicted
Test Score

29. CORE Academic Growth Model
Step 3
Determine whether each student exceeded or did not meet prediction, and by how much
Actual Score
Student
Exceeded
Prediction by 5 Points
Predicted Score
Student Did Not Meet Prediction by 4 Points
[main points on slide]
On the left is a student who exceeded their prediction by 5 points
On the right is a student who did not meet their prediction by 4 points
The CORE Academic Growth Model takes into account the degree to which a student met or did not meet their prediction rather than just a “yes” or “no” on whether it was met
Note: “Prediction” is being used in the statistical sense of the word. These “predictions” are made after all outcome data is already received and processed rather than a forward-looking forecast about how a particular student might do on the next test. In reality, a “prediction” should be thought about as typical growth for students with a similar starting point and characteristics.
Predicted Score
Actual Score
Spring 2015
Test Score
Spring 2016
Test Score
Spring 2015
Test Score
Spring 2016
Test Score

30. CORE Academic Growth Model
Step 4
On average, did a school’s students tend to exceed or not meet their predictions, and by how much?
School A
(Average Points)
School B
(Average Points) -7 -4 +4 +8 +7 -3 +2 +4 -6
[main points on slide]
On the left is a school where students on average tended to exceed their predictions by a wide margin – on average, by a little over 3 points on the test. This is interpreted as the school having an above average impact on students’ growth, meaning this school will have an SGP well above 50.
On the right is a school where students on average tended to not meet their predictions by a small amount – on average, they grew about one point slower on the test. This is interpreted as the school having below average impact on students’ growth, meaning this school will have an SGP slightly below 50. +5 -6 -2 +3 +7 +6 -3
Above Average Impact
Below Average Impact

31. CORE Academic Growth Model
Growth result is converted to Student Growth Percentile (SGP)
Step 5
School 1
School 2
School 3
School 4 -7 -3 -2 -3 +4 +4 +2 +2 -4 -4 + -2 -2 -1 +3 +8 +2
[main points on slide]
These are four hypothetical example schools.
In School 1, most students are growing quite a bit slower than similar students across CORE, which results in this school’s SGP being low in the scale.
In School 2, students are growing on average just under typical growth for similar students, which results in this school’s SGP being slightly below 50.
In School 3, students are growing on average a little faster than similar students across CORE, which results in this school’s SGP being slightly above 50.
In School 4, most students are growing far faster than similar students across CORE, which results in this school’s SGP being high in the scale.
[NOTE: The next few slides overlap with content from the “Results Interpretation” deck – skip if you plan to use that presentation too] 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95
100
Slower Growth Average Growth Faster Growth

32. Converting to SGP to SQII Level
Growth Percentile 50
100 1 2 3 4 5 6 7 8 9 10
Level 1
Level 2
Level 3
Level 4
Level 5
Level 6
Level 7
Level 8
Level 9
Level 10
Low
High 9 10 19 20 29 30 39 40 49 50 59 60 69 70 79 80 89 90
100
SGP on the scale is converted to the CORE’s School Quality Improvement Index (SQII) so that 10 percentile points fall within each level.
For example, if a school’s SGP result is “35”, it falls within the 30th to 39th percentile in Level 4.
Color-coding of results is red for Levels 1-3, orange for 4-7, and green for 8-10.

33. Converting to SGP to SQII Level
Growth Percentile 50
100 7 57 88
Level 1
Level 6
Level 9
Here are three example results with their associated levels and color coding. 50
100 1 2 3 4 5 6 7 8 9 10
Level 1
Level 2
Level 3
Level 4
Level 5
Level 6
Level 7
Level 8
Level 9
Level 10
Low
High 9 10 19 20 29 30 39 40 49 50 59 60 69 70 79 80 89 90
100

34. Basic Results Interpretation
Slower Growth Average Growth Faster Growth 25 50 75
100 45
This grade-level team is producing…
Overall
typical growth for their students 55
6th 77
faster-than-average growth for their students
7th 26
8th
The SGP scale ranges from 0 to 100.
Results can be provided overall across grade levels or for specific grade-level teams.
Orange results mean the grade-level team is producing typical growth for their students.
Green results mean the grade-level team is producing faster-than-average growth for their students.
Red results mean the grade-level team is producing slower-than-average growth for their students – it DOES NOT mean that these students lost knowledge.
These results already have context adjustments taken into account – these are “apples-to-apples” comparisons that take into account students starting point, English Learner status, etc.
slower-than-average growth for their students*
*does not mean these students lost knowledge

35. CORE Academic Growth Model: Results Interpretation

36. Student Growth Percentiles
The CORE Academic Growth Model’s Student Growth Percentiles (SGPs) represent how fast your students are growing when compared to similar students
To make an “apples-to-apples” comparison, the growth model adjusts for students’ individual characteristics as well as school averages of:
Prior test history (both Math and ELA)
Economic disadvantaged status
Disability status (and severity level)
English learner status
Homelessness status
Foster status
[main points on slide]

37. 0-100 SGP Range
Educators are producing slower-than-average growth for their students
(does not mean these students lost knowledge)
Educators are producing typical growth based on the growth of similar students across CORE
Educators are producing faster-than-average growth for their students 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95
100
SGP ranges from 0 to 100.
An SGP close to 50 represents educators are producing typical growth based on the growth of similar students across CORE (school impact is about average).
A higher SGP indicates educators are producing faster-than-average growth for their students (school impact is above average).
A lower SGP indicates educators are producing slower-than-average growth for their students (school impact is below average).
A red result DOES NOT mean that students lost knowledge – it means that at this school, students are growing at a slower rate than similar students across CORE.
These results already have context adjustments taken into account – these are “apples-to-apples” comparisons that take into account students starting point, English Learner status, etc.
Slower Growth Average Growth Faster Growth

38. CORE Academic Growth Model
Growth result is converted to Student Growth Percentile (SGP)
Step 5
School 1
School 2
School 3
School 4 -7 -3 -2 -3 +4 +4 +2 +2 -4 -4 -2 -1 +2 +3 +8 +2
[main points on slide]
These are four hypothetical example schools.
In School 1, most students are growing quite a bit slower than similar students across CORE, which results in this school’s SGP being low in the scale.
In School 2, students are growing on average just under typical growth for similar students, which results in this school’s SGP being slightly below 50.
In School 3, students are growing on average a little faster than similar students across CORE, which results in this school’s SGP being slightly above 50.
In School 4, most students are growing far faster than similar students across CORE, which results in this school’s SGP being high in the scale.
[NOTE: The next few slides overlap with content from the “Results Interpretation” deck – skip if you plan to use that presentation too] 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95
100
Slower Growth Average Growth Faster Growth

39. Converting to SGP to SQII Level
Growth Percentile 50
100 1 2 3 4 5 6 7 8 9 10
Level 1
Level 2
Level 3
Level 4
Level 5
Level 6
Level 7
Level 8
Level 9
Level 10
Low
High 9 10 19 20 29 30 39 40 49 50 59 60 69 70 79 80 89 90
100
SGP on the scale is converted to the CORE’s School Quality Improvement Index (SQII) so that 10 percentile points fall within each level.
For example, if a school’s SGP result is “35”, it falls within the 30th to 39th percentile in Level 4.
Color-coding of results is red for Levels 1-3, orange for 4-7, and green for 8-10.

40. Converting to SGP to SQII Level
Growth Percentile 50
100 7 57 88
Level 1
Level 6
Level 9
Here are three example results with their associated levels and color coding. 50
100 1 2 3 4 5 6 7 8 9 10
Level 1
Level 2
Level 3
Level 4
Level 5
Level 6
Level 7
Level 8
Level 9
Level 10
Low
High 9 10 19 20 29 30 39 40 49 50 59 60 69 70 79 80 89 90
100

41. Basic Results Interpretation
Slower Growth Average Growth Faster Growth 25 50 75
100 45
This grade-level team is producing…
Overall
typical growth for their students 55
6th 77
faster-than-average growth for their students
7th 30
8th
The SGP scale ranges from 0 to 100.
Results can be provided overall across grade levels or for specific grade-level teams.
Orange results mean the grade-level team is producing typical growth for their students.
Green results mean the grade-level team is producing faster-than-average growth for their students.
Red results mean the grade-level team is producing slower-than-average growth for their students – it DOES NOT mean that these students lost knowledge.
These results already have context adjustments taken into account – these are “apples-to-apples” comparisons that take into account students starting point, English Learner status, etc.
slower-than-average growth for their students*
*does not mean these students lost knowledge

42. CORE Growth Model Results Reporting
Point Estimate
‘Best’ estimate of school’s impact on growth
Confidence Interval
Range of plausible values for school’s impact on growth
Narrower range reflects more reliable results
EA uses a typical 95% confidence interval
Confidence intervals that do not contain the 50th percentile offer strong evidence that a school has high or low growth impact.

43. Confidence Interval Examples
20th
60th
80th
Level 1
Level 2
Level 3
Level 4
Level 5
Level 6
Level 7
Level 8
Level 9
Level 10
50th
40th
30th
10th
70th
90th 82
School A
Confidence interval does not contain the 50th percentile. Low probability this school is labeled low growth do to random chance.
Confidence interval does not contain the 50th percentile. Low probability this school is labeled high growth do to random chance.
School B 26 73
School C
Confidence Interval past 50th percentile. Here, there is some probability that the high growth label is due to chance. However this does not make the results invalid, as 73rd percentile is still the best estimate for the school impact.

44. Factors Width of Confidence Interval
Sample Size
Reliability increases as number of students increases
Smaller number of students -> wider interval
Larger number of students -> shorter interval
Consistency of Student Level Growth Results
In cases where students tend to have similar levels of growth (e.g., consistently above or below average), we have more confidence in the growth estimate, as opposed to cases where student growth estimates bounce from above average to about average to below average.
Percentile rank scaling
Schools growth percentiles tend to be closer to average growth than above or below average
All things being equal, this means schools with average growth have larger confidence intervals for SGP estimates than those in the highest and lowest index levels because we have lower confidence in the our ability to distinguish between schools near average growth than do in identifying schools with above or below average growth.

45. Group Activity In small groups: Mathematics ELA25 50 75
100 25 50 75
100 90
4th 75
4th 80 55
5th
5th 19
6th 77
6th
In small groups:
Describe this school’s mathematics growth performance
Describe this school’s ELA growth performance
Here are Mathematics and ELA results for a hypothetical school
GROUP ACTIVITY
[questions on slide]
Answers:
In Mathematics:
All grade levels are making above average growth with their students
In ELA:
The 4th grade team is making above average growth with their students
The 5th grade team is making average growth with their students
The 6th grade team is making below average growth with their students

46. Explain to Your Neighbor
Which grade-level team is more effective at growing their students?
Can we tell which group of students has the highest proficiency rate?
If this was your school, how would you start talking about this data with your teaching teams?
ELA 25 50 75
100 26
6th
7th 85 45
8th
Red SGPs are not about
“Naming, Shaming, and Blaming”
we want to
“Uncover, Discover, and Recover”
as professional learning communities
Here are ELA results for a hypothetical school
EXPLAIN TO YOUR NEIGHBOR
[questions on slide]
Note: wait to animate in the green call-out box
Answers will vary, here are some ideas to guide conversation:
According to these growth results, the 7th grade team is most effective at growing their students. The SGP is above 50 and our bubble color is green. This indicates that these students are growing faster than similar students (in terms of starting knowledge and demographics). Something that the 7th grade team is doing is working very well with these students.
We cannot tell which group of students is highest achieving. SGP is all about student growth relative to peers. It could be the case that the 6th grade students are the highest achieving, or it could be the 7th grade students. Although both proficiency rates and SGP use student test data, that does not mean you will get the same results from these two measures.
This will of course depend on how you approach data at your schools. SGP can be most powerful when used with other data, so perhaps a data retreat or other existing data analysis opportunities would be useful to investigate this data to uncover more about the teaching going on in your building. Emphasize and celebrate areas of success. In this school, the 7th grade team is making a lot of academic growth with their students. The 8th grade team is on track (the 8th grade students grew at a rate of similar students from across the CORE districts). When looking at the 6th grade SGP, make sure this is not about “naming, blaming, and shaming”. As a building of professional educators, think about how you can use this data to “uncover, discover, and recover”. How can we better support our 6th graders next year?
[Animate in green call-out box]

47. Example Interpretation:
Subgroup Results
Mathematics 25 50 75
100 59
Growth Results are calculated for student subgroups similar to the way other metrics are reported on the School Quality Improvement Index
All Students
Lowest Performing Racial/Ethnic Subgroup 45 75
English Learners 80
Students with Disabilities
[Contents on slide]
Note: The SGP results for each subgroup compare those students’ growth to other students with similar characteristics. In the example noted, it does not mean that the “Students with Disabilities” group is growing faster than the “All Students” group, instead it means that at this school, the “Students with Disabilities” group is growing faster than other “Students with Disabilities” across the CORE District after we take into account their stating point and other characteristics.
Socio-Economically Disadvantaged Students 72
Example Interpretation:
Our school’s impact on socio-economically disadvantaged students was above average
(At our school, these students grew faster than similar students across the CORE Districts)

48. The Power of Two Measures
&
Achievement
Growth
Compares students’ performance to a standard
Does not factor in students’ background characteristics
Measures students’ performance at a single point in time
Critical to students’ post-secondary opportunities
Measures students’ individual academic growth longitudinally
Factors in students’ background characteristics outside of the school’s control
Critical to ensuring all students’ future academic success
Measures the impact of teachers and schools on academic growth
A more complete picture of student learning
Another way to look at growth results is in conjunction with other student data.
For example, educators can gain a more complete picture of student learning by using the power of two measures: achievement and growth.
Both achievement and growth use student test scores, but are different ways of analyzing these data.
Achievement compares students’ performance to a standard.
Example: Jimmy is a 4th grader and there is a standard set that we want all 4th graders to achieve. Jimmy either meets or does not meet that standard when he takes the test.
Achievement does not factor in students’ background characteristics.
Example: Whether Jimmy qualifies for SPED or not, is an English Learner or not, (etc.), there’s a standard we want all 4th graders to achieve (high expectations for all kids).
Achievement measures students’ performance at a single point in time.
When Jimmy takes the 4th grade test, it doesn’t just measure what he learned in 4th grade. It’s measuring everything Jimmy has learned in his life up until that point. That means 3rd grade, 2nd grade, 1st grade, Kindergarten, Pre-school, knowledge from his parents & siblings, things he learned on PBS and online, etc.
Achievement is critical to students’ post-secondary opportunities.
Example: We want to know along the way if Jimmy is on track to achieve at an appropriate “college and career ready” level of achievement by graduation time.
There’s another way to analyze this data to answer different questions.
When the question is not about the student, but instead is about the effectiveness of educators, we need to consider additional information.
To start, growth measures students’ individual academic growth longitudinally.
Example: Jimmy takes a test at the end of 3rd grade and another test at the end of 4th grade. We can measure the growth that occurred between those two tests to determine how much Jimmy grew academically during the 4th grade school year.
Growth factors in students’ background characteristics outside of the school’s control.
Example: We know that different kids bring different resources with them to the classroom. With growth analysis, our goal is to use real data to determine what external factors have an effect on student growth so we can account for those factors. An example is special education. We would use real data to determine if SPED students grew faster or slower than non-SPED students and incorporate that into the analysis. When measuring the impact of a particular school, we would then be able to fairly evaluate the academic growth of the students by comparing their growth to similar students.
Growth measures the impact of the education system on academic growth.
Example: By controlling for things like SPED, we can account for these factors to isolate the impact of educators on the academic growth of students.
Growth is critical to ensuring all students’ future academic success.
Example: Consider the incentive under achievement models to teach to the “bubble kids”
Bubble Kids – Under most proficiency models, there is a relatively arbitrary line that students need to pass for a school to get credit for in an accountability system.
Think about the incentive structure here – with limited time and resources, these systems are set up to emphasize getting kids above this mark.
If a student is 3 grade levels behind at the beginning of the year and a teacher moves this student to 1 grade level behind by the end of the year, this teacher gets no credit in a traditional proficiency model.
If a student is 1 grade level ahead at the beginning of the year and a teacher gets the student to 3 grade levels ahead by the end of the year, the teacher gets no additional credit since the student was already above the line to start with.
With a growth model, you get credit for moving a student in scale score points rather than moving proficiency buckets. This aligns with the goals of education – taking kids at far as possible given their starting knowledge.
Adapted from materials created by Battelle for Kids

49. Achievement and Growth Scatterplots
100
These scatter plots are a way to represent Achievement and Growth together
Achievement 80 60
Percent Standards Met (2015)
Growth 40
Achievement and growth scatterplots are a way to visualize these two pieces of data together
Along the y-axis, we can see how much students know.
Along the x-axis, we can see how much students grow relative to their peers. 20 25 50 75
100
Academic Growth ( )

50. How to Read the Scatter Plots
A. Students know a lot and are growing faster than their peers
100 C
C. Students know a lot, but are growing slower than their peers B
B. Students are behind, but are growing faster than their peers 80 E
E. Students are about average in how much they know and how fast they are growing 60
Percent Standards Met (2015) D
D. Students are behind, and are growing slower than their peers 40
[read descriptions of schools in each area of the scatterplot] 20 25 50 75
100
Schools in a district
Academic Growth ( )

51. Your Results Review What are the strengths at your school?
Are we outstanding in any areas?
Where are we “on track” with the CORE districts’ schools?
Where can we improve as a school?
Not about “naming, blaming, shaming” – we want to “uncover, discover, recover”
Conversation starters
How would you start talking about this data at your school?
What other data would you want to see?
Interpretation questions
What questions might your colleagues have about these reports?
As you look at your own results, keep the following questions and topics in mind to make meaning of your results.
[Contents on slide]