1. Performance Pathways Users Conference 3-18-2009 Using Multiple Assessments

2. 2 Assessments have various purposes, provide answers to different questions, address different users, and have varying implications for an assessment system.

3. Inquiry/Problem Solving Data should be an important part of collaborative inquiry and problem solving in schools. 3

4. 4 A Data Coach’s Guide to Improving Learning for All Students: Unleashing the Power of Collaborative Inquiry © 2008 by Corwin Press. All rights reserved. The Using Data Process

5. Data Data have NO meaning. They are simply data. Data have NO meaning. They are simply data. Using Data/Getting Results, Nancy Love. Norwood, MA: Christopher Gordon Press, 2002. 5

6. 6 Elements of High Quality Local Assessment Systems System of Collaboration Committed Leadership Aligned Curriculum Intentional and Multiple Assessments Data Informed Instruction Relevant Professional Development

7. Elements of High Quality Local Assessment Systems 7 EmergingFunctionalStrongExemplary System of Collaboration Committed Leadership Aligned Curriculum Intentional and Multiple Assessments Data Informed Instruction Relevant Professional Development

8. Draft NSD Assessment Plan 8 Grade DIBELS Scott Foresman CBM Everyday Math CBM NECAP NWEA (Reading & Math) BAM BAR HS Competency Assessments K 1 2 3 4 5 6 7 8 9 10 11 12

9. 9 Multiple Measures, Multiple Sources A solid foundation for understanding and formulating a student-learning problem! NECAP Benchmark Assessments BAM & BAR Student Work NECAP

10. Data Drill Down Aggregate data (all students) Disaggregated data (a subset of students) Content strand data (a subset of a construct, such as “reading”) Individual item data Individual student data Student work (test items, assignments, etc.) 10

11. Performance Tracker Report Options 11

12. One Assessment— Multiple Reports aggregate data disaggregate data content strand data individual item data 12

13. NSD Grade 3 NECAP Reading 2008 (aggregate data) 13

14. NSD Grade 3 NECAP Reading 2008 (disaggregated data) Title I Schools (5) Non-Title I Schools (7) 14

15. Title I Grade 3 NECAP Reading 2008 (disaggregated data) All Students Absent 20+ ½-days in 07/08 15

16. Student Detail (individual student data) 16

17. Individual Student Data 17

18. Disaggregated Data: LEP Subgroup 18 Report: Proficiency Level - Pie Chart Subject: Mathematics Grade: Eighth Grade Filter: Include: LEP-Receiving, Assessments: NECAP 2007 - Math - Grade 8 10/15/2007, Sections: Math Scale Score

19. Student Level Data (LEP) 19

20. NSD Grade 5 NECAP Math: Average Proficiency Level (Strand data) 20

21. Drill Down Thru Buildings 21

22. Drill Down Thru Buildings: Bicentennial Grade 5 Math Strands (strand data) 22

23. Drill Down Thru Buildings: Sunset Heights Grade 5 Math Strands (strand data) 23 ol

24. Item Analysis Report (individual item data) 24

25. Time Series Data The same measurement used at various points of time aggregate data disaggregate data content strand data individual student data 25

26. Comparative Reports – Proficiency Levels (aggregate data) 26

27. Comparative Reports – Proficiency Levels 27

28. NWEA Reading Data Comparative Reports (school-level data) Comparative Reports 28 Student ID NWEA Fall 2008 - Reading Survey 6+ V4 - Gr 7-Total RIT Score 10/1/2008 NWEA Winter 2009 - Reading Survey 6+ V4 - Gr 7-Total RIT Score 2/1/2009 TOTAL RIT SCORE NWEA Fall 2008 - Reading Survey 6+ V4 - Gr 7-Word Identification 10/1/2008 NWEA Winter 2009 - Reading Survey 6+ V4 - Gr 7-Word Identification 2/1/2009 WORD IDENTIFICATION NWEA Fall 2008 - Reading Survey 6+ V4 - Gr 7-Literary Texts 10/1/2008 NWEA Winter 2009 - Reading Survey 6+ V4 - Gr 7- Literary Texts 2/1/2009 LITERARY TEXT NWEA Fall 2008 - Reading Survey 6+ V4 - Gr 7- Informational Texts 10/1/2008 NWEA Winter 2009 - Reading Survey 6+ V4 - Gr 7- Informational Texts 2/1/2009 INFORMATIONAL TEXT NWEA Fall 2008 - Reading Survey 6+ V4 - Gr 7- Comprehensi on Strategies 10/1/2008 NWEA Winter 2009 - Reading Survey 6+ V4 - Gr 7- Comprehensio n Strategies 2/1/2009 COMPREHENSION STRATEGIES 6245245021228224-4231227-4223215-8235226-92252272 1336114838227223-42232241228215-132282313228220-8 3928355052230227-32342351236222-1421722912230225-5 58244090602342451123924782292481922924213242 0 423215207521922910231 02192289215223821323219 1328314355202199-3206198-81962015209198-111961982 254744209321923112230233320823022217238212202255 1836132090213227142112198 240212072158 23318 953441509022822912282324234230-42182268230 0 1441512093209215621022414205207220520612172236 132823704421022212219234152022232120121817216215 163611709722222312212309228224-42162237 214-9 5629307029195186-918118321881913201178-23206193-13 96324480532302355241237-42292345228238102232329 1322159069244243250238-12252247-523624913239 0 8336255017223233102182301222724215223234112232285 79465030102372447238233-5254249-52242421823425319 86264077431711821117118211171179815519035188180-8 7737248313221198-23214194-20225193-32226213-13219190-29 238 566 216 267 -25 0.75 1.78 0.68 0.84 -0.08

29. Comparative Reports – Standards (content strand data) 29

30. 30

31. Title I Schools DIBELS Data 31

32. DIBELS (student level data) 32

33. BAM/BAR Benchmark assessments in math & reading Developed in conjunction with Measured Progress Administered 5 times during grades 9-10 33

34. BAM/BAR 34 Form 1 Start of Grade 9Grade 7 GLEs Form 2 End of 1st Semester (9)Grade 8 GLEs Form 3 End of Grade 9Grade 8 GLEs Form 4 End 1st Semester (10)Gr. 9-10 GSEs Form 5 End of Grade 10Gr. 9-10 GSEs

35. NSD-Measured Progress Partnership Assessment Decisions (grade level targets, test matrices, assessment intervals, assessment items) Assessment Scoring (rubrics, anchor papers, PD, qualifying process) Assessment Literacy PD (CIA teams, head teachers and classroom teachers, capacity building, CIA teams helped in data analysis) 35

36. 36 North BAM 1: Proficiency Level Results L4 = 46+/50 = 91-100% (1.9%) L3 = 35-45/50 = 68-90% (18.0%) L2 = 18-34/50 = 34-67% (50.5%) L1 = 0-17/50 = 0-33% (29.6%)

37. 37 North BAM 1: NECAP-BAM Comparisons 37

38. 38 Based on the BAM Form 1 results and your knowledge of HS math programs… Predict what you think the Form 2 results might look like compared to the Form 1 results. Remember that the Form 2 is a full grade-level higher BUT the majority of grade 9 students are in a 2-credit, every day math course for one semester before the BAM Form 2.

39. 39 North BAM 1-2 Comparison: Proficiency Levels 39

40. 40 North BAM 1 Strand Analysis 40

41. 41 North BAM 2: Strand Analysis 41

42. South BAM 1-BAR 1 Comparison 42

43. 43 Based on the BAR Form 1 results, the BAM1-BAR 1 comparison and your knowledge of the students, teachers & programs at North… Predict what you think the Form 2 results might look like compared to the Form 1 results. Remember that roughly half the grade 9 students had an English class the 1 st semester, but that literacy strategies should be involved in all classes.

44. South BAR 1-2 Comparison: Proficiency Levels 44

45. South BAR 1-2 Comparison: 2 nd Semester English Students 45

46. South BAR 1-2 Comparison: 1 st Semester English Students 46

47. 47 South BAR 1-2 Comparison: 1 st Semester Extensions English Students

48. South BAR 1-2 Comparison: 1 st Semester Honors English Students 48

49. Elements of High Quality Local Assessment Systems (BAM/BAR) 49 EmergingFunctionalStrongExemplary System of Collaboration Committed Leadership Aligned Curriculum Intentional and Multiple Assessments Data Informed Instruction Relevant Professional Development