2 Current TimelinesAll components of Smarter Balanced will be operational inDigital Library available fall 2014Preview began June 3 – sign-ups neededInterim assessments available late fall 2014 (Dec?)Summative assessments administered in spring 201511th grade – last 7 weeks of year3-8th grade – last 12 weeks of year (3rd gr ELA adjusted)Grade 3 ELA results must be returned in time for principals to meet with parents before the end of the year so window is short and earlyStudent score reports available June 2015
3 So What Happened This Summer? August 7, 2014So What Happened This Summer?Final MSP for ELA and mathematics!Washington transitioned to a new service provider:Multi-agency cooperative includes Washington, Hawaii, Idaho, South Dakota, US Virgin Islands, West VirginiaThe selected service provider will be announced very soon
4 Current Activities Online Panel In-Person Panel Crowd sourcing – thousands of participantsRecommendations broken down by subgroup (teachers, higher education, etc.)In-Person Panel500 participants in grade/subject panelsNominated by statesBookmark procedure, are provided Online Panel resultsVertical Articulation Committee60 panelists from In-Person PanelReview Online Panel and In-Person Panel resultsRecommend changes
5 Early Fall - Achievement Level Setting Formerly known as ‘Standard Setting’Three major activitiesOnline input – everyone welcome3 hour commitmentSign-up now through Sept 19, 2014In-person panel17-20 from WAApplications closed May 16Articulation committeeInitial achievement levels will be revisited in 2015
6 Achievement Level Setting Timeline State chiefs approve plan/process for Achievement Level SettingApril 30Online Panel open to thousands of educators and other constituentsOctober 6-17In-Person panels convene to recommend grade-level performance standardsOctober 13-19Vertical Articulation by subgroup of In-Person panels looks at across-grade coherenceOctober 20Technical Advisory Committee reviews proceedingsOctober 30State chiefs vote to endorse achievement level recommendationsNovember 6This is a summary of major activities in the process for achievement level setting.
7 Understanding the Resources Practice TestAll item types and Performance TasksAvailable to all on Web since May 2013Updated periodically with new featuresTraining TestShorter than Practice TestTrains students on features and tools
8 Summative Assessments in 2014–15 and beyond August 7, 2014Summative Assessments in 2014–15 and beyondEnglish/LAMathematicsScience (no change)Grade 3SmarterGrade 4Grade 5MSPGrade 6Grade 7Grade 8Grade10(or below for EOCs)(until Class of 2019)Comprehensive ELAexit examYear 1 or Year 2EOC exit examEOC Biologyexit exam (until NGSS)Grade 11Grade 11 or 12(class of 2015 & 2016)HSPE Reading and/or Writing RetakeSmarter=Smarter Balanced Assessment; MSP=Measurements of Student Progress;EOC=End of Course exams; HSPE=High School proficiency Exam
9 ChallengeDue to delayed availability of Smarter Balanced item bank for state use in exit exams, ELA exit exam for 10th graders won’t be ready until May 2015May conflicts with AP testing, so we will offer schools an alternate date of May 19-2011th -12th graders can retake HSPE in Reading and Writing in March (typical timeframe) since May is too late to get scores back for graduation (not for the classes of 2017 or beyond).
10 HS Testing for Graduation (new June 30, 2013 from HB 1450) Graduation Assessment RequirementsClass of 2014HSPE Reading, HSPE Writing, 1 Math EOCClasses of 2015 – 2018ELA comprehensive exam, 1 Math EOC exit exam, Biology EOCClass of 2019 and beyond (this year’s 8th graders)Smarter Balanced Assessments in ELA and Math, and a Science assessment (EOC Biology until NGSS assessment)
11 High School Assessment Graduation Requirements by Class Class of… English Language ArtsMathematicsScience2014Reading HSPEWriting HSPEEither Algebra or Geometry EOC2015 & 2016HSPEs orELA Exit Exam or11th Smarter BalancedEither Algebra or Geometry EOC or EOC Exit Exam orBiology EOC (until Next Gen Science Standards)2017 &2018ELA exit exam or2019 and beyond11th Smarter Balanced ELA11th Smarter Balanced Math
12 High School Assessment Graduation Requirements by Class August 7, 2014High School Assessment Graduation Requirements by ClassAssessments will continue to be available for students with IEPs at all tested grade levels and include WA-AIM, Off-grade (DAPE), and Basic.Options for high school graduation will continue to be available to students who attempt the state assessment at least once. These options include GPA Comparison, AP, IB, ACT, SAT, and COE.
13 Assessments That Fulfill High School Graduation Requirements Class of 2014Class of 2015Class of 2016Class of 2017Class of 2018Class of 2019ELARdg & Wtg HSPEXCCSS10th ELA Exit Exam11th Smarter Balanced ELAMathAlg 1/Geom EOCsAlg 1/Geom EOC Exit Exams11th Smarter Balanced MathScienceBiology EOCX?NGSSNext Gen SS
14 So the 2015 HS test administration calendar… MarchAprilMayJune12th – if retake is needed16th 17th HSPE Wrt18th HSPE WrtMath EOC Exit Exams & Biology EOC (last 3 weeks – paper/pencil)11th - AccountabilitySmarter Balanced ELA and Math(last 7 weeks - online)11th – if retake is needed10th – grad requirements12th-13th or19th-20thELA Exit Exam (PP)9th & 10th – grad requirements
15 2014 Summative Field Test Updates 4/12/20172014 Summative Field Test UpdatesA Test of the Test
16 Field Test UpdateField test completed by 186,800 students in Washington, and 4,200,935 across the consortiumPurpose of field test was to:Help ensure assessments are valid, reliable, and fair for all studentsProvide teachers, schools, and students an opportunity to participate in a practice run of the assessment systemEvaluate performance of 20,000+ assessment items and performance tasksSet preliminary achievement standards that help determine student preparedness for college and career
17 Field Test Update, cont.’ Field testing was remarkably smoothFeedback regarding technology was very positiveSmall glitches but nothing widespread.Concurrent users not a factorNo major local network issues. Bandwidth seems to not have been a problem.Some device related problems.Districts have a sense of relief that things worked out.Challenge for next year seems to be ironing out glitches as well as scheduling problems due to inadequate number of devices at some schools.
18 Field Test Update: What did we learn? Content stood out as a challenge rather than technologyFamiliarity with keyboarding and digital tools (e.g., calculator) is importantScheduling (longer sessions vs. several shorter sessions) is worth a significant discussionConsider having staff take practice testInterim assessments will provide a run-through opportunityRigor does not seem to be too shocking, but certainly some sense of “harder”
19 Field Test Update- Think Abouts… Considering the districts and schools you work with, how would you rate their involvement in…Practice testsTraining materialsTechnology readinessContingency planning
20 Digital Library Preview Period June 3 – September 25, 2014Test the initial software applicationProvide users access to an initial set of resources that will grow
21 The Digital Library: By the Numbers Open review June 6 – Sept 25 for all K-12 teachers in member statesCurrently 1,856 resourcesForums available on every resourceState-of-the-art tagging and search features can quickly find resources by CCSS and other topicsAfter Sept 30: Access for teachers in subscribing states only
22 Digital Library Basics The Digital Library will be accessed through a single sign-on with user permission levels so educators have access to all of the instructional and professional learning resources for each grade band (Grades K-2, 3-5, 6-8, 9-12).There will be resources that educators can share or use with students and families, but students and families will not be able to access materials directly.All resources will have the formative assessment process embedded within them. But the Digital Library WILL NOT be a “bank” of formative assessment items alone.All submitted materials will be vetted through a Quality Criteria Review Process by reviewers across the nation.Each resource will be reviewed and rated by at least 3 trained educatorsIf resources do not meet the quality criteria, they will not be included in the libraryELA/Literacy – Proposed ModulesBalance of Inf. and Literary TextLiterary in the Content AreasIncreased complexity of textText-Based questions and answersAcademic VocabularyWriting using evidenceMathematics – Proposed ModulesFocusCoherenceFluencyDuel IntensityDeep UnderstandingMath Practices across various standards
23 Digital Library Functionality IllustrativeEnables State Networks of Educators and State Leadership Teams to submit, review, and publish resourcesAllows educators to view, download, and rate resourcesUses state-of-the-art tagging and search to quickly find resources by CCSS and other topicsEnables educators from across the Consortium to collaborate and share their knowledgeFacilitates access to resources that are stored in participating librariesThe Digital Library is the tool that the Consortium will use to disseminate resources to teachers.The Library will present resources in a in a graphically compelling way and will provide state-of-the-art functionality for educators, including the ability for educators from across the Consortium to collaborate and share their knowledge.
24 Resources in the Digital Library Assessment Literacy ModulesCommissioned professional development modulesResources for students and familiesFrame formative assessment within a balanced assessment systemArticulate the formative assessment processHighlight formative assessment practices and toolsExemplar Instructional ModulesCommissioned professional development modulesInstructional materials for educatorsInstructional materials for studentsDemonstrate/support effective implementation of the formative processFocus on key content and practice from the Common Core State Standards for Mathematics and English Language ArtsEducation ResourcesHigh-quality vetted instructional resources and tools for educatorsHigh-quality vetted resources and tools for students and familiesReflect and support the formative processReflect and support the Common Core State Standards for Mathematics and English Language ArtsCreate Professional Learning Communities* Resources include the following file types: Video, HTML5, Audio, PPT, Excel, Word, and PDF.
25 Digital Library: Collaboration Digital Library users can participate in a discussion with other educators about a specific resource by accessing the collaboration tab on the resource profile.Users can choose to join an active discussion or start a new topic.
26 Digital Library: Collaboration After a Digital Library user clicks on a particular topic, they can view the topic title, description, and any attached materials. Users can view the discussion thread and choose to reply to the topic or an individual post. Users can recommend discussion posts that they find helpful, so that other users can quickly find the information they are looking for.
27 Digital Library: Collaboration Digital Library users can flag discussion topics and posts by selecting a flag reason and rationale
28 Digital Library: Collaboration Digital Library users can also access forums by selecting the Forums tab from the navigation header. Resource forums contain the discussions that occurred on the collaboration tab of a resource. Each resource forum is the name of a resource.
29 Digital Library: Collaboration A resource forum displays the summary of the resource and the discussion topics. The topics tab is the same as the collaboration tab on the resource profile.
30 Grounded in this Definition of Formative Assessment Process Formative Assessment is a deliberate process used by teachers and students during instruction that provides actionable feedback that is used to adjust ongoing teaching and learning strategies to improve students’ attainment of curricular learning targets/goals.~ Compiled by the Digital Library National Advisory Panel
31 All Resources are Grounded in the Four Attributes of the Formative Assessment Process and Reviewed using Quality CriteriaClarifyIntendedLearningElicitEvidenceAct onInterpret
32 Quality Criteria for Professional Learning Resources The resource…1) Reflects research and/or the principles of effective professional learning2) Incorporates formative assessment practices3) Supports learner differences and personalized learning4) Demonstrates utility, engagement, and user-friendliness5) Integrates technology and media effectivelyAmber/Cathy
33 Quality Criteria for Instructional Resources The resource…1) Aligns with the intent of the Common Core State Standards2) Incorporates formative assessment practices3) Contains accurate, complete, high-quality curriculum and instruction4) Supports learner differences and personalized learning5) Demonstrates utility, engagement, and user-friendliness6) Integrates technology and media effectivelyAmber/Cathy
34 Smarter Balanced Digital Library: Formative Assessment Practices and Professional Learning – educator involvementNational Advisory Panel (NAP)11-20 expertsBegins December 2012Provides policies and criteria for resourcesState Leadership Team (SLT)10-14 WA membersProvides support and training for State Network of EducatorsPromote statewide communicationsState Network of Educators (SNE)50 WA Members (900+ nationally)Representation from LEAs, AEAs, content leaders, ELL, IHEServe Summer 2013 – Late Fall 2014Submit and review resourcesNational Advisory PanelDr. Lynne Anderson-Inman (University of Oregon)Dr. Robert Calfee (Stanford University, UC Riverside)Dr. Bridget Dalton (University of Colorado)Dr. Linda Darling-Hammond (Stanford University)Dr. Diane Heacox (St. Catherine University)Dr. Joan Herman (UCLA – CRESST)Dr. John Hill (Purdue University)Dr. Yvette Jackson (National Urban Alliance for Effective Education)Dr. Henry Kepner (University of Milwaukee)Dr. Katherine McKnight (National Louis University)Valerie L. Mills (National Council of Supervisors of Mathematics)Dr. James Popham (UCLA)
35 4/12/2017Interim AssessmentsWASA-AWSP June 30, 2014
36 Interim Assessment Design Principles August 7, 2014Interim Assessment Design PrinciplesAdministered through the same system as SummativeCan be administered at various points in the yearOptional for districtsOnline administrationAdaptive as appropriateAdhere to Usability, Accessibility, and Accommodations GuidelinesItems drawn from same pool as Summative; full array of item typesNot intended for accountability decisions
37 Interim Assessment Components August 7, 2014Interim Assessment ComponentsInterim AssessmentInterim Comprehensive Assessment (ICA)Interim Assessment Blocks(IAB)Two different assessment types provides flexibility for useMore details (e.g., content of IABs, what is reported for) in following slides, but want participants familiar with the terms.
38 Interim Assessment User Interface, Scoring and Reporting August 7, 2014Interim Assessment User Interface, Scoring and ReportingUser interfaceDetails for accessing items are not yet determined. Interim test engine is still in development.ScoringInterim assessments will have various item types, most of which will be machine scoredHand scoring will be a local (school/classroom) responsibilityRubrics and training will be provided
39 Interim Assessment User Interface, Scoring and Reporting, continued August 7, 2014Interim Assessment User Interface, Scoring and Reporting, continuedReportingInterim Comprehensive Assessment (ICA)Report same information as Summative AssessmentOverall composite scale scoreAchievement levelsClaim level informationInterim Assessment Blocks (IABs)Report information consistent with claim level informationItem level reporting is a future feature (not on current work plan)
40 IABs for ELA: Current Thinking on Coverage Proposed Interim Assessment Blocks (IAB)1Read Literary Texts2Read Informational/Explanatory Texts3Write Brief Narrative Text4Narrative Performance Task5Write Brief Informational/Explanatory Texts6Informational Performance Task7Write Brief Opinion** Texts8Opinion** Performance Task9Revise/Edit (across Narrative, Informational/Explanatory, and Opinion texts)10Listen/Interpret11*Speaking12Research*Placeholder until items are developed**”Opinion” is “Argumentative” for grades 6-8 and 11
41 Interim Assessments Timeline Interim Assessments will be available in late fall of 2014Items have to get through field testing, scoring, and standard settingInitial release will include a fixed form Interim Comprehensive Assessment (ICA) for each grade level and content areaAdaptive forms will be available as the item pool allowsInitial release will also include a fixed form Interim Assessment Block (IAB) for most blocksAdaptive IABs will be available as the item pool allowsAll blocks will have adaptive IABs after