Presentation is loading. Please wait.

Presentation is loading. Please wait.

OSPI Assessment Update

Similar presentations


Presentation on theme: "OSPI Assessment Update"— Presentation transcript:

1 OSPI Assessment Update
Cindy Knisely Beth Simpson 9/11/14

2 Current Timelines All components of Smarter Balanced will be operational in Digital Library available fall 2014 Preview began June 3 – sign-ups needed Interim assessments available late fall 2014 (Dec?) Summative assessments administered in spring 2015 11th grade – last 7 weeks of year 3-8th grade – last 12 weeks of year (3rd gr ELA adjusted) Grade 3 ELA results must be returned in time for principals to meet with parents before the end of the year so window is short and early Student score reports available June 2015

3 So What Happened This Summer?
August 7, 2014 So What Happened This Summer? Final MSP for ELA and mathematics! Washington transitioned to a new service provider: Multi-agency cooperative includes Washington, Hawaii, Idaho, South Dakota, US Virgin Islands, West Virginia The selected service provider will be announced very soon

4 Current Activities Online Panel In-Person Panel
Crowd sourcing – thousands of participants Recommendations broken down by subgroup (teachers, higher education, etc.) In-Person Panel 500 participants in grade/subject panels Nominated by states Bookmark procedure, are provided Online Panel results Vertical Articulation Committee 60 panelists from In-Person Panel Review Online Panel and In-Person Panel results Recommend changes

5 Early Fall - Achievement Level Setting
Formerly known as ‘Standard Setting’ Three major activities Online input – everyone welcome 3 hour commitment Sign-up now through Sept 19, 2014 In-person panel 17-20 from WA Applications closed May 16 Articulation committee Initial achievement levels will be revisited in 2015

6 Achievement Level Setting Timeline
State chiefs approve plan/process for Achievement Level Setting April 30 Online Panel open to thousands of educators and other constituents October 6-17 In-Person panels convene to recommend grade-level performance standards October 13-19 Vertical Articulation by subgroup of In-Person panels looks at across-grade coherence October 20 Technical Advisory Committee reviews proceedings October 30 State chiefs vote to endorse achievement level recommendations November 6 This is a summary of major activities in the process for achievement level setting.

7 Understanding the Resources
Practice Test All item types and Performance Tasks Available to all on Web since May 2013 Updated periodically with new features Training Test Shorter than Practice Test Trains students on features and tools

8 Summative Assessments in 2014–15 and beyond
August 7, 2014 Summative Assessments in 2014–15 and beyond English/LA Mathematics Science (no change) Grade 3 Smarter Grade 4 Grade 5 MSP Grade 6 Grade 7 Grade 8 Grade10 (or below for EOCs) (until Class of 2019) Comprehensive ELA exit exam Year 1 or Year 2 EOC exit exam EOC Biology exit exam (until NGSS) Grade 11 Grade 11 or 12 (class of 2015 & 2016) HSPE Reading and/or Writing Retake Smarter=Smarter Balanced Assessment; MSP=Measurements of Student Progress; EOC=End of Course exams; HSPE=High School proficiency Exam

9 Challenge Due to delayed availability of Smarter Balanced item bank for state use in exit exams, ELA exit exam for 10th graders won’t be ready until May 2015 May conflicts with AP testing, so we will offer schools an alternate date of May 19-20 11th -12th graders can retake HSPE in Reading and Writing in March (typical timeframe) since May is too late to get scores back for graduation (not for the classes of 2017 or beyond).

10 HS Testing for Graduation (new June 30, 2013 from HB 1450)
Graduation Assessment Requirements Class of 2014 HSPE Reading, HSPE Writing, 1 Math EOC Classes of 2015 – 2018 ELA comprehensive exam, 1 Math EOC exit exam, Biology EOC Class of 2019 and beyond (this year’s 8th graders) Smarter Balanced Assessments in ELA and Math, and a Science assessment (EOC Biology until NGSS assessment)

11 High School Assessment Graduation Requirements by Class
Class of…  English Language Arts Mathematics Science 2014 Reading HSPE Writing HSPE Either Algebra or Geometry EOC 2015 & 2016 HSPEs or ELA Exit Exam or 11th Smarter Balanced Either Algebra or Geometry EOC or EOC Exit Exam or Biology EOC (until Next Gen Science Standards) 2017 & 2018 ELA exit exam or 2019 and beyond 11th Smarter Balanced ELA 11th Smarter Balanced Math

12 High School Assessment Graduation Requirements by Class
August 7, 2014 High School Assessment Graduation Requirements by Class Assessments will continue to be available for students with IEPs at all tested grade levels and include WA-AIM, Off-grade (DAPE), and Basic. Options for high school graduation will continue to be available to students who attempt the state assessment at least once. These options include GPA Comparison, AP, IB, ACT, SAT, and COE.

13 Assessments That Fulfill High School Graduation Requirements
Class of 2014 Class of 2015 Class of 2016 Class of 2017 Class of 2018 Class of 2019 ELA Rdg & Wtg HSPE X CCSS 10th ELA Exit Exam 11th Smarter Balanced ELA Math Alg 1/Geom EOCs Alg 1/Geom EOC Exit Exams 11th Smarter Balanced Math Science Biology EOC X? NGSS Next Gen SS

14 So the 2015 HS test administration calendar…
March April May June 12th – if retake is needed 16th 17th HSPE Wrt 18th HSPE Wrt Math EOC Exit Exams & Biology EOC (last 3 weeks – paper/pencil) 11th - Accountability Smarter Balanced ELA and Math (last 7 weeks - online) 11th – if retake is needed 10th – grad requirements 12th-13th or19th-20th ELA Exit Exam (PP) 9th & 10th – grad requirements

15 2014 Summative Field Test Updates
4/12/2017 2014 Summative Field Test Updates A Test of the Test

16 Field Test Update Field test completed by 186,800 students in Washington, and 4,200,935 across the consortium Purpose of field test was to: Help ensure assessments are valid, reliable, and fair for all students Provide teachers, schools, and students an opportunity to participate in a practice run of the assessment system Evaluate performance of 20,000+ assessment items and performance tasks Set preliminary achievement standards that help determine student preparedness for college and career

17 Field Test Update, cont.’
Field testing was remarkably smooth Feedback regarding technology was very positive Small glitches but nothing widespread. Concurrent users not a factor No major local network issues. Bandwidth seems to not have been a problem. Some device related problems. Districts have a sense of relief that things worked out. Challenge for next year seems to be ironing out glitches as well as scheduling problems due to inadequate number of devices at some schools.

18 Field Test Update: What did we learn?
Content stood out as a challenge rather than technology Familiarity with keyboarding and digital tools (e.g., calculator) is important Scheduling (longer sessions vs. several shorter sessions) is worth a significant discussion Consider having staff take practice test Interim assessments will provide a run-through opportunity Rigor does not seem to be too shocking, but certainly some sense of “harder”

19 Field Test Update- Think Abouts…
Considering the districts and schools you work with, how would you rate their involvement in… Practice tests Training materials Technology readiness Contingency planning

20 Digital Library Preview Period
June 3 – September 25, 2014 Test the initial software application Provide users access to an initial set of resources that will grow

21 The Digital Library: By the Numbers
Open review June 6 – Sept 25 for all K-12 teachers in member states Currently 1,856 resources Forums available on every resource State-of-the-art tagging and search features can quickly find resources by CCSS and other topics After Sept 30: Access for teachers in subscribing states only

22 Digital Library Basics
The Digital Library will be accessed through a single sign-on with user permission levels so educators have access to all of the instructional and professional learning resources for each grade band (Grades K-2, 3-5, 6-8, 9-12). There will be resources that educators can share or use with students and families, but students and families will not be able to access materials directly. All resources will have the formative assessment process embedded within them. But the Digital Library WILL NOT be a “bank” of formative assessment items alone. All submitted materials will be vetted through a Quality Criteria Review Process by reviewers across the nation. Each resource will be reviewed and rated by at least 3 trained educators If resources do not meet the quality criteria, they will not be included in the library ELA/Literacy – Proposed Modules Balance of Inf. and Literary Text Literary in the Content Areas Increased complexity of text Text-Based questions and answers Academic Vocabulary Writing using evidence Mathematics – Proposed Modules Focus Coherence Fluency Duel Intensity Deep Understanding Math Practices across various standards

23 Digital Library Functionality
Illustrative Enables State Networks of Educators and State Leadership Teams to submit, review, and publish resources Allows educators to view, download, and rate resources Uses state-of-the-art tagging and search to quickly find resources by CCSS and other topics Enables educators from across the Consortium to collaborate and share their knowledge Facilitates access to resources that are stored in participating libraries The Digital Library is the tool that the Consortium will use to disseminate resources to teachers. The Library will present resources in a in a graphically compelling way and will provide state-of-the-art functionality for educators, including the ability for educators from across the Consortium to collaborate and share their knowledge.

24 Resources in the Digital Library
Assessment Literacy Modules Commissioned professional development modules Resources for students and families Frame formative assessment within a balanced assessment system Articulate the formative assessment process Highlight formative assessment practices and tools Exemplar Instructional Modules Commissioned professional development modules Instructional materials for educators Instructional materials for students Demonstrate/support effective implementation of the formative process Focus on key content and practice from the Common Core State Standards for Mathematics and English Language Arts Education Resources High-quality vetted instructional resources and tools for educators High-quality vetted resources and tools for students and families Reflect and support the formative process Reflect and support the Common Core State Standards for Mathematics and English Language Arts Create Professional Learning Communities * Resources include the following file types: Video, HTML5, Audio, PPT, Excel, Word, and PDF.

25 Digital Library: Collaboration
Digital Library users can participate in a discussion with other educators about a specific resource by accessing the collaboration tab on the resource profile. Users can choose to join an active discussion or start a new topic.

26 Digital Library: Collaboration
After a Digital Library user clicks on a particular topic, they can view the topic title, description, and any attached materials. Users can view the discussion thread and choose to reply to the topic or an individual post. Users can recommend discussion posts that they find helpful, so that other users can quickly find the information they are looking for.

27 Digital Library: Collaboration
Digital Library users can flag discussion topics and posts by selecting a flag reason and rationale

28 Digital Library: Collaboration
Digital Library users can also access forums by selecting the Forums tab from the navigation header. Resource forums contain the discussions that occurred on the collaboration tab of a resource. Each resource forum is the name of a resource.

29 Digital Library: Collaboration
A resource forum displays the summary of the resource and the discussion topics. The topics tab is the same as the collaboration tab on the resource profile.

30 Grounded in this Definition of Formative Assessment Process
Formative Assessment is a deliberate process used by teachers and students during instruction that provides actionable feedback that is used to adjust ongoing teaching and learning strategies to improve students’ attainment of curricular learning targets/goals. ~ Compiled by the Digital Library National Advisory Panel

31 All Resources are Grounded in the Four Attributes of the Formative Assessment Process and Reviewed using Quality Criteria Clarify Intended Learning Elicit Evidence Act on Interpret

32 Quality Criteria for Professional Learning Resources
The resource… 1) Reflects research and/or the principles of effective professional learning 2) Incorporates formative assessment practices 3) Supports learner differences and personalized learning 4) Demonstrates utility, engagement, and user-friendliness 5) Integrates technology and media effectively Amber/Cathy

33 Quality Criteria for Instructional Resources
The resource… 1) Aligns with the intent of the Common Core State Standards 2) Incorporates formative assessment practices 3) Contains accurate, complete, high-quality curriculum and instruction 4) Supports learner differences and personalized learning 5) Demonstrates utility, engagement, and user-friendliness 6) Integrates technology and media effectively Amber/Cathy

34 Smarter Balanced Digital Library: Formative Assessment Practices and Professional Learning – educator involvement National Advisory Panel (NAP) 11-20 experts Begins December 2012 Provides policies and criteria for resources State Leadership Team (SLT) 10-14 WA members Provides support and training for State Network of Educators Promote statewide communications State Network of Educators (SNE) 50 WA Members (900+ nationally) Representation from LEAs, AEAs, content leaders, ELL, IHE Serve Summer 2013 – Late Fall 2014 Submit and review resources National Advisory Panel Dr. Lynne Anderson-Inman (University of Oregon) Dr. Robert Calfee (Stanford University, UC Riverside) Dr. Bridget Dalton (University of Colorado) Dr. Linda Darling-Hammond (Stanford University) Dr. Diane Heacox (St. Catherine University) Dr. Joan Herman (UCLA – CRESST) Dr. John Hill (Purdue University) Dr. Yvette Jackson (National Urban Alliance for Effective Education) Dr. Henry Kepner (University of Milwaukee) Dr. Katherine McKnight (National Louis University) Valerie L. Mills (National Council of Supervisors of Mathematics) Dr. James Popham (UCLA)

35 4/12/2017 Interim Assessments WASA-AWSP June 30, 2014

36 Interim Assessment Design Principles
August 7, 2014 Interim Assessment Design Principles Administered through the same system as Summative Can be administered at various points in the year Optional for districts Online administration Adaptive as appropriate Adhere to Usability, Accessibility, and Accommodations Guidelines Items drawn from same pool as Summative; full array of item types Not intended for accountability decisions

37 Interim Assessment Components
August 7, 2014 Interim Assessment Components Interim Assessment Interim Comprehensive Assessment (ICA) Interim Assessment Blocks (IAB) Two different assessment types provides flexibility for use More details (e.g., content of IABs, what is reported for) in following slides, but want participants familiar with the terms.

38 Interim Assessment User Interface, Scoring and Reporting
August 7, 2014 Interim Assessment User Interface, Scoring and Reporting User interface Details for accessing items are not yet determined. Interim test engine is still in development. Scoring Interim assessments will have various item types, most of which will be machine scored Hand scoring will be a local (school/classroom) responsibility Rubrics and training will be provided

39 Interim Assessment User Interface, Scoring and Reporting, continued
August 7, 2014 Interim Assessment User Interface, Scoring and Reporting, continued Reporting Interim Comprehensive Assessment (ICA) Report same information as Summative Assessment Overall composite scale score Achievement levels Claim level information Interim Assessment Blocks (IABs) Report information consistent with claim level information Item level reporting is a future feature (not on current work plan)

40 IABs for ELA: Current Thinking on Coverage
Proposed Interim Assessment Blocks (IAB) 1 Read Literary Texts 2 Read Informational/Explanatory Texts 3 Write Brief Narrative Text 4 Narrative Performance Task 5 Write Brief Informational/Explanatory Texts 6 Informational Performance Task 7 Write Brief Opinion** Texts 8 Opinion** Performance Task 9 Revise/Edit (across Narrative, Informational/Explanatory, and Opinion texts) 10 Listen/Interpret 11* Speaking 12 Research *Placeholder until items are developed **”Opinion” is “Argumentative” for grades 6-8 and 11

41 Interim Assessments Timeline
Interim Assessments will be available in late fall of 2014 Items have to get through field testing, scoring, and standard setting Initial release will include a fixed form Interim Comprehensive Assessment (ICA) for each grade level and content area Adaptive forms will be available as the item pool allows Initial release will also include a fixed form Interim Assessment Block (IAB) for most blocks Adaptive IABs will be available as the item pool allows All blocks will have adaptive IABs after

42 A System of Assessments


Download ppt "OSPI Assessment Update"

Similar presentations


Ads by Google