1. Next Generation Science Science Assessment Updates
Ellen K. Ebert, PHD: Teaching and Learning Science
Dawn Cope; Secondary Science Assessment
December 19, 2013
Next Generation Science
and
Science Assessment Updates
December 19, 2013

2. Washington Next steps
December 2013

3. Our Time today…
Welcome Architecture of a Standard Transition planning Assessment Updates and NGSS Considerations Resources

4. Before We Start
A little polling… Who is with us today? Please use the text box to let us know what questions you may have before we start.

5. NGSS State Adoption Update
Rhode Island
Kentucky
Kansas
Maryland
Vermont
California
Delaware
Washington State
Washington DC

6. The NGSS were built on the principles of A Framework for K-12 Science Education
Children are born investigators
Understanding builds over time
Science and Engineering require both knowledge and practice
Science connects to students’ interests and experiences
Instruction focuses on core ideas and practices
Science learning standards promote equity

7. National Current and Upcoming NGSS Projects that will benefit WA State
SciMath Assessment Items – January 2014 Sample Available
Evidence Statements – January 2014
Additional Model Course Maps – Winter 2014
Science EQuIP – Winter 2014 Available Now
State of Science Education Research – Winter 2014
Publishers Criteria – Spring 2014 In Progress
STEM Works – Late Spring/Early Summer 2014
Alignment Institutes – Early Summer 2014

8. 9/17/2018
NGSS Performance Expectation Example Layers of an Earth and Space Science (ESS)
This High School ESS PE is a new Core Ideal Earth & Human Activity
Note: Describe the parts as they animate in using the titles but not reading them. The print is too much, and too small for all to read so keep in mind the wealth of information that science educators can use to implement the standards.
Ask participants to open their copy of the standards to this PE. Probe participant understanding by ASKING:

9. Implementation and Transitions
Advice from Stephen Pruitt, Achieve
Develop a thoughtful and deliberate implementation plan that supports the overall education plan
Focus
Be patient

10. Washington Timeline
Moving forward in the slow lane

11. PD = Professional Development
Years 0 - 3: Awareness, State-wide Capacity Building
Study Appendices
Build PD modules
Identify best placement of current instructional materials
Determine policy shifts
Work with other programs like CTE; Community-based education partners
Consider all students all standards -equity
Years 1 - 3: Phase in Practices and Crosscutting Concepts
Construct PD - Practices and Crosscutting Concepts: Asking questions and defining problems ; Analyzing and interpreting data; Constructing explanations; Engaging in argumentation Patterns; Systems and System Models; Scale and Proportion;
Infuse MSP designed curricula
Years 2 - 3:
Secondary pathways; Full implementation
Construct PD - Practices and Crosscutting Concepts:
Develop and use models; Plan and construct explanations; Use mathematics and computational thinking; Obtain, evaluate and communicate information
Cause and effect; energy and matter; structure and function
Stability and change
PD = Professional Development
Community-Based Education Partners = Museums, Science Centers, etc.
SEPs = Science and Engineering Practices
CCCs = Crosscutting Concepts: DCIs = Disciplinary Core Ideas

12. 2013–14 Building each year: Year Zero
Professional Learning
From the Framework  Standards: What should teachers know and be able to do?
Equity
Best pedagogical practices;
Community resources;
Thinking thru instructional materials
Policy shifts
PESB Teacher competencies and NGSS; Assessment Considerations
Data to Inform
NAEP; TIMMS; PISA; MSP; EOC; Course-taking; STEM career choices (NCES)
Awareness and Capacity Building
Who/How; Messaging; Retuning the State Science Leadership Team;
Collaboration with community-based science educator providers

13. 2014–15 Building each year: Year One
Awareness and Capacity Building 
Identify new Professional Learning; Focus on Equity; SEPs; CCCs
Instructional Materials Work; Best
Kit Placement;
Explore (e) Innovations
Policy shifts; Assessment;
Data
Each box represents work of different entities: OSPI, ESDs; LASER; Districts; Teachers

14. 2015–16 Building each year: Year Two
Awareness and Capacity Building 
Continue Professional Learning; Focus on Appendices; SEPs; CCCs
Instructional Materials Best Placement
Policy shifts; Assessment Design
Data
Updates
Each box represents work of different groups: OSPI, ESDs; LASER; Districts; Teachers

15. 2016–17 Building each year: Year Three
Professional Learning Designed; SEPs; CCCs are in place
DCIs are in place
Policy shifts; Assessment piloting
(Test 2017–18)
Data Collection Continues
Awareness and Capacity Building
Continues

16. Shifting Instruction…
Implementation in the classroom.
How will the NGSS impact me?

17. Key Shifts in NGSS
Focus: The NGSS are Focused on deeper understanding and application of science content reflecting real-world interconnectedness Coherence: Science and engineering Build Coherently across K–12. Integration: Science and Engineering are Integrated across K–12 in the NGSS.

18. Three Dimensions Intertwined….
The NGSS are written as Performance Expectations
NGSS will require contextual application of the three dimensions by students.
Focus is on how and why as well as what

19. Instructional Shifts in the NGSS
Focus on big picture, not lessons
Learning Progressions
Science and Engineering
Evidence of learning

20. All Standards All Students
Appendix D
Equity

21. The Three Dimensions

22. Washington Bias and Sensitivity Process
Effective Strategies for Student
Engagement
Classroom
Home and Community
School
Washington Bias and Sensitivity Process
We cannot miss the equity opportunities afforded by the
Next Generation Science Standards. Resources from the home and community, school and classroom lead to effective strategies for student engagement.

23. Effective classroom strategies can include…
connecting science education to students’ sense of place,
applying their funds of knowledge, and cultural practices,
using project-based learning,
using culturally relevant pedagogy,
capitalizing on community involvement and social activism,
using role models,
providing accommodations and modifications for students with disabilities,
adopting language support strategies,
home language support, and home culture connections.

24. Effective school-based resources include…
Material resources – curricular materials, professional development, supplies, and other expenditures.
Human capital – content and cultural knowledge and leadership.
Social capital – norms and values surrounding learning, teaching, and relating to others.

25. Effective home and community connections can include…
identifying resources and strengths in the family and home environments of non-dominant student groups,
involving parents and extended family
defining problems and designing solutions for community projects in local neighborhoods
focusing on science learning in informal environments.

26. Why focus on equity?
Reaching out to all students to engage their interest in learning science is the right thing to do.
A few well-placed simple steps can make all the difference in the world for reducing the opportunity gap in science.
The NGSS represent a new opportunity to make science relevant, interesting and meaningful for all students, their families and the broader community, if implemented correctly.
Implementing the NGSS in a bias-free and culturally sensitive manner will help reduce the opportunity gap and increase interest in science, technology, engineering and math-related careers.

27. Where can I find additional NGSS information?
Resources
Where can I find additional NGSS information?

28. Where do we get more NGSS information?
Science Teaching & Learning:
Ellen Ebert, Ph.D.,
Amber Farthing,
Environmental and Sustainability Education:
Gilda Wheeler,
Science Support Staff:
Sultana Shah,
NGSS OSPI Website:
Report from Symposium on Science Assessment:

29. Office of the Superintendent of Public Instruction
Science Assessment Updates

30. Questions & Answers about the Science Exams
OSPI Science Assessment
Information Update
Session 4.4

31. Presenters Dawn Cope—Secondary Science Assessment Specialist
Kara Monroe—Elementary Science Assessment Specialist
Science Assessment—WERA December 2013

32. Today’s Topics Next Generation Science Standards (NGSS) update
Spring 2013 results
MSP/EOC overview
Biology EOC
Assessment resources available
Test development
Upcoming events
Science Assessment—WERA December 2013

33. Quick poll Who is in the room with us today? Teachers Administrators
High school
Middle school
Elementary
Science Assessment—WERA December 2013

34. Washington adopted the NGSS…what happens to our state exams?
Science Assessment—WERA December 2013

35. We keep giving them…
If you hear “2014 is the last year of the MSP,” add “except for science.”
NCLB and state law require that we give a state science exam once each in elementary, middle, and high school
We will continue to give our state exam (based on 2009 standards) until an exam based on the NGSS is developed
Science Assessment—WERA December 2013

36. Next Generation Science Standards
February 20, 2012
Adopted:
June 2009
First assessed:
2011 (MSP)
2012 (EOC)
Adopted:
October 2013
Possible first
assessment:
2017 or 2018 (?)

37. What are the steps to building a new assessment?
Develop item specifications from the standards
Determine the test map
Develop test items (including a pilot test)
Develop Performance Level Descriptors (PLDs) from the standards
Administer an operational test
Set performance level standards (Standard Setting)
For the 2009 standards, this process took 25 months
Science Assessment—WERA December 2013

38. WA’s NGSS Involvement & Process Summer 2011 to Present
DEVELOPMENT
K-12 Framework for Science Education
NGSS Drafting Process
Confidential Drafts
Summer 2011
WA INVOLVEMENT:
- WA Selected as NGSS Lead State – Fall 2011
- Drafting Process – Fall 2011 – Spring 2012
- Statewide educator, stakeholder input
REVIEW/INPUT
Public Review
Revision Process
- Student input
- National input
- Comments on Final Drafts
ADOPTION
States have discretion to voluntarily adopt NGSS
Final April 2013
WA STATUS:
- Comparisons
- Bias and Sensitivity
- SBE Presentations
- Adoption
October 2013
BUILD AWARENESS & CAPACITY
State Collaboration and Sharing
Focus on understanding Science and Engineering Practices
Crosscutting Concepts
Appendices
Examine Equity Case Studies
Build PD modules
TRANSITION &
APPLICATION
- Intentional transition plans
- Best use and placement of instructional materials and resources
-Identify community resources
- Assessment system adjustments
We are here
Science Assessment—WERA December 2013

39. Still to be determined:
Will the science tests be developed by Washington or with a consortium of states?
When and how will pilot and/or field testing occur?
What year will be the first year of operational testing?
If the high school test is comprehensive, will it be administered at grade 10 or grade 11?
Will the elementary test cover just grade 5 standards or a broader grade band of standards?
Science Assessment—WERA December 2013

40. Engrossed House Bill 1450 From 2013 legislature
Legislature intends that we transition to a new high school science assessment as is being done with ELA and Mathematics
Science Assessment—WERA December 2013
9/17/2018

41. How do we prepare for state exams in 2014-2016?
Will my state test scores go down if I shift my instruction to the NGSS now?
Science Assessment—WERA December 2013

42. What are the key shifts in the NGSS?
Focus: The NGSS are focused on deeper understanding and application of science content reflecting real-world interconnectedness
Coherence: Science and engineering build coherently across K-12
Integration: Science and engineering are integrated across K-12
Science Assessment—WERA December 2013

43. What are the key shifts in the NGSS?
Focus: The NGSS are focused on deeper understanding and application of science content reflecting real-world interconnectedness
Coherence: Science and engineering build coherently across K-12
Integration: Science and engineering are integrated across K-12
Science Assessment—WERA December 2013

44. Embed the Science & Engineering Practices
~50% of points on MSP/Biology EOC are from Systems, Inquiry, and Application standards
Science Assessment—WERA December 2013

45. Grade 8 example Practice 2: Develop and use models
Crosscutting 2: Cause and effect
Crosscutting 3: Scale, proportion and quantity
More?
Core Idea 2: Life science
From 2014 Updates
Science Assessment—WERA December 2013

46. Grade 5 (et al) example Practice 6: Design solutions More?
Crosscutting 2: Cause and effect
Core Idea 1: Physical sciences
From 2012 Updates
Science Assessment—WERA December 2013

47. Biology EOC example Practice 6: Construct explanations More?
Crosscutting 2: Cause and effect
Core Idea 2: Life science
From 2013 Updates
Science Assessment—WERA December 2013

48. Biology (et al) example
Practice 3: Plan and carry out investigations
Crosscutting 2: Cause and effect
More?
Core Idea 2: Life science
From 2014 Updates (and many others)
Science Assessment—WERA December 2013

49. Where do we get more NGSS information?
Science Teaching & Learning:
Ellen Ebert, Ph.D.,
Amber Farthing,
WERA session 5.2 at 12:45pm today
Environmental and Sustainability Education:
Gilda Wheeler,
Science Support Staff:
Sultana Shah,
NGSS OSPI Website:
Report from Symposium on Science Assessment:
Science Assessment—WERA December 2013

50. What were the 2013 spring MSP and EOC results?
Science Assessment—WERA December 2013

51. Statewide Measurements of Student Progress Results
Science Assessment—WERA December 2013

52. Statewide Biology EOC Results
Science Assessment—WERA December 2013

53. State Report Card
Science Assessment—WERA December 2013

54. Test Overview—MSP Test Length Grade 5: Single session 75-90 minutes*
*additional time needed for passing out materials and reading directions
Test Window
April 23 to May 15 for paper/pencil tests
April 23 to May 30 for online tests
Online Testing
Voluntary in grades 5 and 8 in 2014
Science Assessment—WERA December 2013

55. Online Testing—MSP Tutorial Videos Online Tools Training (OTT)
Learn about the features of the test engine
Non-interactive
Installing test engine is not required to view
Online Tools Training (OTT)
Requires test engine installation on computer
Interactive
Practice using features of the test engine
Versions A and B—version B was new in 2013
OTT Lesson Plan
Available for grade 5
Uses version A of OTT
Flexible interaction for teachers and students
Guidance for leading students through login and directions
Suggestions for using specific features (tools) of the test engine with specific items
To be updated by January 13, 2014
Science Assessment—WERA December 2013

56. Online Testing—MSP
Science Assessment—WERA December 2013

57. Test Overview—EOC Test Window Winter—January 2 to February 7
Spring—May 5 to June 20
Locally determined schedule, during last 3 weeks of the course
Test Length
Three sessions: 50 minutes each OR
Single session: about 150 minutes*
*additional time needed for passing out materials and reading directions
Science Assessment—WERA December 2013

58. Test & Item Specifications
Scenario formats
Test map (item types and percentages)
Item specification statements matched to the standards
Vocabulary lists
Science Assessment—WERA December 2013

59. Test & Item Specifications
Science Assessment—WERA December 2013

60. What about the Biology EOC?
Science Assessment—WERA December 2013

61. Is the Biology EOC still a graduation requirement?
Yes. Remember the…
Legislative intent regarding high school science assessment (2013 Engrossed House Bill 1450, Section 4 )
Classes of 2015 and beyond must pass to graduate
Biology EOC—Until NGSS are adopted, implemented and assessed
Comprehensive NGSS Test—When NGSS are adopted, implemented and assessed
Science Assessment—WERA December 2013

62. Who and when? Winter (January/February) 2014 Spring 2015
Any student (2015+) who took the EOC previously and did not meet standard
Students completing a biology course mid-year
Spring 2015
Any student (class of 2015+) enrolled in a high school level biology course
All 10th graders who have not yet met standard
Meets the high school science testing requirement of NCLB
9th grade scores from 2012 were banked for NCLB reporting in 2013
9th grade scores from 2013 were banked for NCLB reporting in 2014
Science Assessment—WERA December 2013

63. Special Education and ELL alternatives:
Biology EOC available in 6 translation languages
Spanish, Russian, Korean, Chinese, Vietnamese, and Somali
IEP can designate Level 2 (Basic) to meet graduation requirement
Developmentally Appropriate Proficiency Exam(DAPE)
ES DAPE and MS DAPE available fall 2013, spring 2014
For more information:
John Bresko Special Education Program Supervisor
Lesley Siegel Alternate Assessment Coordinator
Science Assessment—WERA December 2013

64. CAA Options:
Begins with students in class of 2015 (current 11th graders)
GPA comparison—draft
A student’s grades in science courses are compared with the grades of students who took the same courses and passed the Biology EOC.
Available to students in their 12th-grade year who have an overall grade-point average of 3.2 or higher.
Students must attempt the Biology EOC at least once before attempting this CAA option.
Advanced Placement (AP) score of 3 or higher:
Biology, Physics, Chemistry, or Environmental Sciences
International Baccalaureate(IB) score of 4 or higher:
Biology, Physics, Chemistry
For more information:
Science Assessment—WERA December 2013

65. CAA Options: Collection of Evidence (COE) available fall 2013
Must take EOC twice
First submission June 2014
Independent work of students
6-8 tasks chosen from a bank of 16 Inclusion Tasks
Completed under the supervision of a teacher
Two tasks “On Demand”
Cut scores will be determined in August 2014.
Selected tasks must include items which assess each of the six reporting strands (System, Application, Inquiry, LS1, LS2, LS3) three-four times. Task Matrix:
Science Assessment—WERA December 2013

66. Biology COE Task Matrix
Science Assessment—WERA December 2013

67. Biology COE Resources ESD 113 http://www.coe.k12.wa.us/domain/49
Guidelines, policies, and sufficiency requirements
Generate staff and student groups and accounts, access and complete tasks, submit collections
Recorded webinars
Task Matrix
Brief description of the 16 tasks available
Biology COE Moodle
Forum
Task development information
Links to recorded webinars
Salmonberry Habitat Practice COE task (adapted from Bio EOC scenario- Updates 2013)
WERA session 5.5 at 12:45pm today
Kim Andersen COE Mathematics & Science Specialist OSPI
Science Assessment—WERA December 2013

68. What resources are available?
Science Assessment—WERA December 2013

69. OSPI Resources
Science Assessment—WERA December 2013

70. Science Assessment—Educator Resources

71. Updates for 2014
Science Assessment—WERA December 2013

72. Lessons Learned
Science Assessment—WERA December 2013

73. Short Answer Templates
Science Assessment—WERA December 2013

74. Released Item Documents (RID)
Science Assessment—WERA December 2013

75. Who develops and scores the science assessments?
Science Assessment—WERA December 2013

76. Science Assessment Development Cycle
Test and Item Specifications
Scenario & Item Writing Committee
Content Review & Bias/Sensitivity Committees
Scenario & Items reviewed for content by OSPI/contractor
Scenario & Item
Pilot Testing
Pilot
Range Finding
Committee
Items available for Operational Testing
Data Review
Committee
Pilot Scoring
Operational
Rangefinding
Operational Scoring 76

77. What about scoring? Who are the scorers?
Professionals; must have a college degree. Many are teachers.
Trained before scoring by Scoring Director (SD):
Scenario, item, and rubric
Anchor and Practice sets
Qualifying sets. Must be 90% correct to qualify to score that item.
During scoring:
Use the rubric and training sets to score live responses
Team Leaders and SD available
Statistics:
Inter-rater reliability
Validity papers
If a scorer is unable to improve after retraining, they are removed from project and ALL responses they scored are re-scored.
Science Assessment—WERA December 2013

78. Upcoming assessment events
Date
Event
Jan/Feb 2014
Biology EOC Exam Winter Administration
February 2014
Scenario and Item Writing Workshop
April 2014
Content Review
April/May 2014
MSP Administration
May/June 2014
Biology EOC Exam Spring Administration
July 2014
Pilot Rangefinding
Sept 2014
Data Review
Science Assessment—WERA December 2013

79. SALT and PEPPER Teams PEPPER SALT
PreSALTers Enthusiastically Promoting Powerful Educational Resources
Members include science educators throughout Washington interested in receiving Science Assessment updates.
Members receive invitations to participate in various events such as Scenario Writing Workshops, Content Reviews, Range Findings and Data Review.
SALT
Science Assessment Leadership Team
PEPPERS who complete an application to participate in a science assessment event become members of SALT.
Science Assessment—WERA December 2013

80. SALT Information: http://www.k12.wa.us/Science/ProfDevelopment.aspx
Science Assessment—WERA December 2013

81. More questions?
Science Assessment Contact Information
Dawn Cope, Secondary Science Assessment
Kara Monroe, Elementary Science Assessment
Jessica Cole, Administrative Assistant
Cinda Parton, Director of Assessment Development
Science Assessment Web Page
Science Assessment—WERA December 2013