1. Science Assessment Update WSTA Conference, October 2015, Shorecrest High School

2. Agenda  Development of the next generation of science assessments  State testing in the mean time

3. Science Assessment Staff Dawn Cope—Secondary Assessment Specialist (Lead) dawn.cope@k12.wa.us Kara Todd—Elementary Assessment Specialist kara.todd@k12.wa.us Cinda Parton—Director of Assessment Development cinda.parton@k12.wa.us Jessica Cole—Administrative Assistant jessica.cole@k12.wa.us

4. Science Teaching & Learning Staff Ellen Ebert—Science Director ellen.ebert@k12.wa.us Amber McCulloch—K-12 Science Specialist amber.mcculloch@k12.wa.us Rochelle Gandour-Rood—Environmental and Sustainability Education, Program Supervisor rochelle.gandourrood@k12.wa.us Sultana Shah—Administrative Assistant sultana.shah@k12.wa.us

5. General Science email account:  science@k12.wa.us

6. Stay informed and get involved  Sign up for GovDelivery messages  Go to the Subscribe page for GovDelivery. Enter your email address. On the Subscriptions page, select Content Areas > Science, then select the grade band(s) for which you would like to receive information.Subscribe page  Email from “OSPI GovDelivery” or just “OSPI” (waopsi@public.govdelivery.com)  Check calendar posted at: http://www.k12.wa.us/Science/ProfDevelopment.aspx http://www.k12.wa.us/Science/ProfDevelopment.aspx

7. Next Generation of Science Assessment Development and Implementation

8. New Learning Standards = New Assessment  Next Generation Science Standards (NGSS) adopted as our state science learning standards in October of 2013  Official name: Washington State 2013 K-12 Science Learning Standards

9. Current assessment timeline—At the earliest…  Fall 2015: begin development of assessment  Spring 2016: limited pilot test  Spring 2017: full pilot test  Spring 2018: operational test for entire state

10. Major assessment shifts…  All the tested grade levels will be tested online  Science and Engineering Practices (SEPs) embedded throughout  Comprehensive for high school:  all of the domains—PS, LS, ESS, ETS—will be tested  Grade 5 test to assess 3 rd, 4 th, and 5 th grade standards

11. Steps to building a new assessment:  Develop item specifications from standards  Determine the test map/blueprint  Develop test items  Develop Achievement Level Descriptors (ALDs) from standards  Administer an operational test  Set achievement levels (Standard Setting)

12. Science Assessment Item Collaborative SAIC—January 2014  Led by CCSSO, Achieve, and WestEd  Membership includes 14 states and the Virgin Islands  Arkansas  California  Connecticut  Delaware  Hawaii  Illinois  Kentucky  Maryland  Massachusetts  Michigan  Nevada  Oregon  Washington  Virgin Islands  West Virginia

13. SAIC Products  Assessment Framework documentdocument  Item Specification Guidelines documentdocument  Prototype items

14. Item Specifications—began spring 2015  What can be asked on a statewide assessment?  What types of items will be used?  Contributing documents:  A Framework for K-12 Science Education  NRC Report: Developing Assessments for the NGSS  Washington State 2013 K-12 Science Learning Standards (NGSS)  Evidence Statements (from Achieve)  Assessment Framework (from Science Assessment Item Collaborative—SAIC)  Item Specifications Guidelines (from SAIC)  Washington Item Specifications  Will be revised through stages of the assessment development cycle  First published in fall 2017, revised annually

15. Test map/blueprint—begin fall 2015  What percent of the test will be about what part of the standards?  How many items will be on the test?  What item types will be used?  What information will be reported? Resources and processes:  Assessment Framework (SAIC)  Educator/public input via web surveys—Sept/Oct 2015  Meeting with teachers to make recommendations—Summer 2016?

16. Test Item Development  Cluster Development*—October 2015, March 2016  Content Review*—December 2015, July 2016  Bias/Sensitivity Review—December 2015, July 2016  Pilot Testing—Spring 2016, Spring 2017  Pilot Range Finding*—Summer 2016, Summer 2017  Content Review with Data*—Fall 2016, Fall 2017  Achievement Level Descriptors*—2016  First Operational Exams—Spring 2018  Achievement Level Setting*—Summer 2018 *Educator Committees

17. Piloting  Spring 2016: limited pilot test  Grades 5 and 8  Pilot items embedded in online operational MSP  Spring 2017: full pilot test  Grades 5 and 8, embedded in online operational MSP  High School, separate online pilot test

18. Operational Test  Alignment Study (teachers)—winter 2018  Test administered in spring 2018  5 th grade  8 th grade  High school  Scores not available until fall 2018 because of Achievement Level Setting meeting in summer 2018

19. Decisions pending:  At what grade level will high school students be tested?  Which cohort will have to pass the new high school assessment in order to graduate?  Will the Biology EOC continue to be available as a graduation option? If so, for how long?

20. What about the graduation requirement?  Legislative intent regarding high school science assessment  2013 Engrossed House Bill 1450  2015 Senate Bill 6145  Classes of 2017 and beyond must pass the science exam to graduate  Biology EOC until a comprehensive NGSS Test is administered (Spring 2018)  Transition period where either the biology EOC or the high school NGSS assessment could be used for graduation purposes, much like math’s transition to Smarter Balanced assessments.

21. Questions?

22. State testing in the mean time…

23. Federal assessment requirements:  No Child Left Behind (NCLB) requires that our state’s science standards must be assessed:  Once in elementary school (we give Measurements of Student Progress in 5 th grade)  Once in middle school (we give MSP in 8 th grade)  Once in high school (we give Biology End-of-Course exam)  We will continue to give these assessments through spring 2017 at least  Items are written to the 2009 science standards  Scored and equated the same way as we have since 2011 (MSP) and 2012 (Bio EOC)

24. Scores—percent passing 5 th 8 th Bio-10 th 201155.661.6 — 201266.266.361.3 201366.664.871.5 201466.867.277.7 201563.460.772.5

25. Measurements of Student Progress  Online testing encouraged, same engine as ELA/Math assessments  Paper/pencil testing still available  Resources available:  Teacher Resource page: http://www.k12.wa.us/Science/EducatorResources.aspx http://www.k12.wa.us/Science/EducatorResources.aspx  Updates documents—practice questions  Scoring Training videos—how some short-answer questions are scored  Online Training test Online Training test

26. Biology EOC  Paper/pencil  Resources available:  Teacher Resource page: http://www.k12.wa.us/Science/EducatorResources.aspx http://www.k12.wa.us/Science/EducatorResources.aspx  Updates documents—practice questions  Scoring Training videos—how some short-answer questions are scored

27. Alternatives for ELL and Spec Ed  MSP and EOC available in 6 translation languages  Spanish, Russian, Korean, Chinese, Vietnamese, and Somali  IEP can designate Level 2 (Basic) to meet graduation requirement  DAPE is now the “Off-Grade Level” assessment  Online in November and March  WA-Access to Instruction & Measurement (WA-AIM)  More info: Toni Wheeler, Alternate Assessment Coordinator Toni.Wheeler@k12.wa.us

28. 2015 Legislative Session: SB 6145 Summary of Bill (from Senate Bill Report): Legislative intent is provided to delay for no more than two years, but not to eliminate, the high school graduation requirement of meeting the state standard on the high school science assessment. Instead of students in the graduating class of 2015 being required to meet the state standard on the state science assessment to graduate from high school, the requirement to meet the state standard on the science assessment is delayed for two years. The delay applies retroactively to students in the graduating class of 2015. Beginning with the graduating class of 2017 students must meet the state standard on the state science assessment to graduate from high school.

29. Who Takes the Biology EOC?  Current Graduation Requirement: Class of 2017 and beyond  Winter (January/February) 2016  Students (class of 2017+) who took EOC previously and did not meet standard  Students (class of 2017+) completing a biology course mid-year  Spring 2016  Any student (class of 2017+) enrolled in a high school level biology course  All 10th graders who have not yet met standard  Meets the high school science testing requirement of NCLB

30. CAA Options Available for Biology EOC  GPA comparison  ACT— A score of 16 or higher on the science portion of the ACT.  Advanced Placement (AP) score of 3 or higher:  Biology, Physics, Chemistry, or Environmental Sciences  International Baccalaureate(IB) score of 4 or higher:  Biology, Physics, Chemistry  Biology Collection of Evidence (COE)— next submission in June 2016 for the class of 2017  For more information:  http://www.k12.wa.us/assessment/CAAoptions/default.aspx http://www.k12.wa.us/assessment/CAAoptions/default.aspx

31. Questions?