1. USING DATADIRECTOR ASSESSMENTS TO INCREASE USE OF FEEDBACK TO STUDENTS AND TEACHERS Stan Masters Coordinator of Instructional Data Services Lenawee Intermediate School District Adrian, Michigan Michigan Digital Learning Conference November 13, 2013

2. WE MUST UTILIZE AN INQUIRY APPROACH TO DATA ANALYSIS WE MUST USE MULTIPLE SOURCES OF DATA We need a data warehouse for our 21 st century schools WE MUST FOCUS ON DATA TO INCREASE STUDENT ACHIEVEMENT Data Warehousing Talking Points

3. DATA DIALOGUES

4. WAYS OF TALKING Norms of Collaboration DialogueDiscussion Outcome: Deep Understanding Outcome: Decisions That Stick Culture of Collaboration Conversation Deliberation The Center for Adaptive Schools www.adaptiveschools.com

5. DATA DRIVEN DIALOGUE Predictions Observations Inferences Adapted from Deb Clancy, Washtenaw ISD, 2008, based upon the work of Nancy Love, “Using Data/Getting Results” (2002)

6. FEEDBACK Best gains in student achievement involve description :  Corrective in nature  Timely in nature  Specific to a criterion  Including students in the feedback Source: Marzano, R. J., Pickering, D. J. and Pollock, J. E. Classroom Instruction That Works: Research-Based Strategies for Increasing Student Achievement (2001). Alexandria, VA: ASCD

7. COMMON ASSESSMENTS A common assessment is an assessment typically created collaboratively by a team of teachers responsible for the same grade level, course, or content area.

8. Existing Summative and Formative Classroom Tests Not Aligned with Expectations Classroom Summative and Formative Tests Aligned to Expectations Common Classroom Summative and Formative Assessments Aligned to Expectations Common Formative and Summative Assessments Aligned to Expectations and Delivered Online Through DataDirector Implementing Assessments with DataDirector Adapted from St. Clair RESA

9. MAKING IT FORMATIVE  Get the scores into the students’ hands  Develop multiple worksheet Excel file  Data feeds into form with student names  Students identify “simple mistakes” and “need help” with wrong answers

10. SAMPLE REPORT

11. COLLEGE AND CAREER READINESS

12. ACT’S COLLEGE READINESS BENCHMARK SCORES 12 EXPLORE PLAN ACT EnglishEnglish Composition 13 15 18 ReadingSocial Sciences 15 17 22 Math Algebra 17 19 22 ScienceBiology 20 21 23 ACT Subject Area Test College Course(s)

13. “On Target” met or exceeded CRB “Nearly On Target” <2 points from CRB “Off Target” >2 points from CRB

14. PREDICTIONS USING EXPLORE TO PLAN TO ACT SOURCE: HTTP://WWW.ACT.ORG/RESEARCH/POLICYMAKERS/PDF/REASONABLEGROWTH.PDFHTTP://WWW.ACT.ORG/RESEARCH/POLICYMAKERS/PDF/REASONABLEGROWTH.PDF Average Growth Points Between Tests “On Target” (met or exceeded CRB) “Nearly On Target” (<2 points from CRB) “Off Target” (>2 points from CRB) Test EXPLORE to PLAN PLAN to ACT EXPLORE to PLAN PLAN to ACT EXPLORE to PLAN PLAN to ACT English 2-3 3-41 1 Math 2-3 1-2 2-31-2 Reading 1-24-53-42-33-41-2 Science 1-22-31-22-3 1

15. ITEM ANALYSIS OF EXPLORE AND PLAN  Robert Hanvey at SCCRESA developed program that pulls raw data from files  File format allows DataDirector to “read” data like an Answer Sheet Assessment  Answer sheet organized by sections aligned to test’s content areas and subscores

17. WHERE DO WE GO? Present State Future State

18. SCHOOLS ARE CELEBRATING WITH SMART GOALS  More measurable outcomes related to content expectations  More use of assessment for learning  More strategic use of resources to help students who are not meeting expectations  Making continual school improvement more meaningful

19. SUGGESTED NEXT STEPS  Move from scores to criteria around the scores  Move from existing rubric/scoring guides to more concise rubric/scoring guides  Move from individual analysis to team analysis

20. WORDS OF ENCOURAGEMENT FROM OTHER ASSESSMENTS MINERS… All assessments are finite resources Having a variety of tools makes your mining experience more worthwhile It is better to work together while in the mines!

21. Stan Masters Coordinator of Instructional Data Services Lenawee Intermediate School District Fireside Building 4107 N. Adrian Highway Adrian, Michigan 49921 517-265-1606 (phone) 517-265-7079 (fax) stan.masters@lisd.us http://www.lisd.us/instructional-services/curriculum-assessment--instruction/data-warehousing/ http://www.lisd.us/instructional-services/curriculum-assessment--instruction/classroom-assessment/ CONTINUE THE CONVERSATION