1. Using STAAR data to guide learning August 20, 2014 District Professional Learning Session #174 1

2. Intended outcomes Understand the use of thresholds to set student goals and monitor growth Identify critical TEKS to serve as the focus for learning improvement for students and teachers Model a process for performing an item analysis of STAAR and other assessment results 2

3. lead4ward resources http://lead4ward.com/resources/ – Released tests and snapshots tab Process standards – Tools to know, ways to show Released tests - items organized by SE STAAR Snapshots – readiness, supporting and process SEs TEKS Snapshots – Aligned SEs in non-tested grades TEKS Scaffolding – SEs supporting tested readiness standards from current and prior grade levels 3

4. lead4ward resources http://lead4ward.com/STAARIntervention/ PW: STAAR-Ready – Original ppt presentation – Original handout 4

5. But first... 5

6. OBJECTIVE 1 Understand the use of thresholds to set student goals and monitor growth 6

7. STAAR Performance Standards Level I Unsatisfactory Performance “Inadequately Prepared” Level II Satisfactory Performance “Sufficiently Prepared” Level III Advanced Performance “Well Prepared” SatisfactoryAdvanced

8. Performance Standards and the Phase-in of STAAR Phase 1 2011-12 2012-13 2013-14 Phase 2 2015? Recommended 2016?

9. STAAR Performance Standards Level I Unsatisfactory Performance “Inadequately Prepared” Level II Satisfactory Performance “Sufficiently Prepared” Level III Advanced Performance “Well Prepared” SatisfactoryAdvanced P1P2 Final

10. What score is needed to pass grade 5 math in 2015? 1 1

11. Psychometric Aside: Test equating 11 Performance standard = 1489 scale score points (1489 “units” of math knowledge & skill) 1489 2014 27 items

12. Psychometric Aside: Test equating 12 Items are less difficult 1489 2015 28 items Performance standard = 1489 scale score points (1489 “units” of math knowledge & skill)

13. Psychometric Aside: Test equating 13 Items are more difficult 1489 2015 26 items Performance standard = 1489 scale score points (1489 “units” of math knowledge & skill)

14. ≈ 75% ≈ 55% ≈ 85% ≈ 65% Think state, act local 1 1

15. Well Prepared (Advanced Performance) Sufficiently Prepared (Gr. 3-8 Level II Final) Getting There Sufficiently Prepared (Level II Phase 2) Really Well Prepared (Exceed Progress) Likely to pass STAAR this year 3 3 Goal for highest performing students (2 points Index 2) Likely to pass STAAR at final standard (Index 4) Meeting Level III Performance (Index 2 and Index 3) Knows more than half the content OR Knows most but can’t apply

16. Let’s PLAY Fact or Fib SHOWDOWNSHOWDOWN

17. FactFib All students can exceed progress and earn 2 points for your campus in Index 2 Fact 1 = Fact; 2 = Fib

18. Index 2: Student progress Grade 3 Math Grade 4 Math 1529 Exceeded Progress 2 points for campus Met Progress 1 point for campus Did Not Meet Progress 0 points for campus 1599 1677 148 pts 70 pts <70 pts Top performing students receive 2 pts (0-2 incorrect) Students in guessing range earn 0 points Level III Level II Final Level I

19. Student progress with thresholds Grade 3 Math Grade 4 Math 75% Exceeded Progress Met Progress Did Not Meet Progress 75% or more 85% 95% Level III Level II Final Level I <75% Leveling Up

20. STAAR 2014 Goal for 2015 3 3 T H R E S H O L D S Leveling Up

21. 5 5 Met Progress What do they all have in common?

22. Exceeded Progress What do they have in common?

23. Exceeded Progress Well almost… but…

24. Did NOT Meet Progress

25. 5 5 STAAR Should Ava have the same Local Assessment performance goals as Michael? Unit 1 Unit 2 Leveling Up

30. OBJECTIVE 2 Identify critical TEKS to serve as the focus for learning improvement for students and teachers 30

31. Using Heat Maps FOCUS How did we do?

32. Start with what we are helping kids learn…the TEKS Readiness Supporting Process

34. Readiness Standards ≈ 30% of assessed TEKS ≈ 65% of STAAR BROAD and DEEP ideas IN-DEPTH instruction 34 Concepts Complexity 9 9

37. 1 + 1 + 1 = 9 Benchmark Test

38. Identifying focus standards Compare 2013 STAAR to 2014 STAAR Classify readiness and process standards – Increase/decrease of more than 5 points – Greater than/less than campus target Identify areas of strength and concern Select standards for teacher learning and student growth Most customarily an August activity 38

39. How? Subtract Map Select Commit

40. Things we will need 2013 and 2014 STAAR results, analysis by content and process SEs – Aware Heat Maps – District produced item analysis Performance analysis sheet Mapping standards sheet 40

41. Let’s try it together 41

42. p. 40 16 6.1B6.2C 6.2B6.3C 6.10D 6.4A 6.2E 6.5A6.6C 6.8B All of us helped more kids OR One of us figured it out ! All of us helped more kids OR One of us figured it out ! For Students Engage the Emerging For Teachers Learn the Low Positive outcomes Not so positive

43. What might teachers want to learn? For Teachers Learn the Low

44. Select 3 Focus SEs

45. p. 40 16 6.1B6.2C 6.2B6.3C 6.10D 6.4A 6.2E 6.5A6.6C 6.8B For Students Engage the Emerging For Teachers Learn the Low Positive outcomes Not so positive Pick 3 Pick 3

46. Subtract Map Select Commit

47. p. 40 16 6.2B 6.8B 6.5A 6.4A 6.6C 6.2C 4 612 135135 211 14 Questions to consider How have these standards been taught and assessed in the past? What will need to be learned by teachers? How will student tasks be modified this year to better align with STAAR?

48.  ≥75% questions in Math (Grades 3-8)  ≥40% questions in Science  ≥30% questions in Social Studies 48 ≈ 82% ≈ 60% ≈ 55%  Reading? ≈ 50% Fig. 19 Process Standards Assessed in Context Readiness Supporting STAAR process standards are assessed with Readiness or Supporting Standards in the same question (i.e. double coded).

49. Process Standards… “Game Changers” 8.5 (E) identify the foreign policies of presidents Washington through Monroe and explain the impact of Washington's Farewell Address and the Monroe Doctrine; Readiness Standard IDENTIFY and EXPLAIN Potential Rigor… Cause/Effect Compare/Contrast Predict 8.29 (B) analyze information by sequencing, categorizing, identifying cause-and-effect relationships, comparing, contrasting, finding the main idea, summarizing, making generalizations and predictions, and drawing inferences and conclusions; RIGOR

50. Process Standards… “Game Changers” Which of the following foreign policies are best associated with Presidents Washington through Monroe? RIGOR IDENTIFY and EXPLAIN Potential Rigor… Cause/Effect Compare/Contrast Predict What issues are common in both Washington’s Farewell address and the Monroe doctrine?

51. 1 + 1 + 1= 24 Benchmark Test

52. 17 8 + 6 + 10 = 24

53. 53

54. FOCUS! Focus Readiness Standards – Linked Supporting Standards Highly tested Process Standards

55. Considering your focus SEs What goals will you set for student performance in these areas? How will your PLCs work to increase understanding of readiness and process SEs? What will you do differently this year when planning for learning and assessing for learning? How will you help students understand the content, context and cognitive rigor of assessed SEs? How will you ensure that students have ample experience with process standards? 55

56. OBJECTIVE 3 Model a process for performing an item analysis of STAAR and other assessment results 56

57. Item analysis 57

58. Item analysis 58

59. Item analysis 59

60. 60

61. 61

62. Item analysis process 1.Write standards assessed in margin 2.Write percentage for each answer choice 3.Circle correct answer – What must students know and be able to do to answer correctly? 4.What is content, context and cognitive rigor evident in the item and in the assessed standard(s)? 5.Inspect distractors – Is one distractor attractive to students? What errors in thinking may cause students to choose it? Are guessing patterns evident? Are differences in answering patterns evident by student group? 6.What types of prompts/graphics were used? Were they needed to answer correctly? If not, what prior knowledge and skills were needed? 62

63. Item analysis process 7.What academic or general vocabulary must be understood in order to answer correctly? With which terms would students most likely struggle? Were these same terms used as part of instruction? 8.Identify the most difficult items assessed. When these standards were taught, what tasks were students assigned to assist in their learning? How well were the tasks aligned with what students are expected to do on STAAR? 9.What changes in instruction will be considered based on the analysis? 63