1. SMARTER BALANCED: TEST SPECIFICATIONS, PERFORMANCE TASKS, RUBRICS, OH MY! OCTOBER 15, 2012PORTLAND, OR Rachel A. Aazzerah Science and Social Sciences Assessment Specialist Oregon Department of Education Email: rachel.aazzerah@state.or.us

2. AUDIENCE SURVEY Raise your hand if:  You work in elementary grades K-5  You work in middle school 6-8  You work in high school  You are a TOSA  You work in the district office  You are a curriculum specialist  You are just interested Using one hand (0-5), show your knowledge of:  Common Core Standards  Smarter Balanced Assessment in General  Smarter Balanced Assessment Performance Tasks

3. OVERVIEW 1.Introduction to Smarter Balanced 2.Claims 3.Targets 4.Test Specifications 5.Summative Assessment Item Types 6.Performance Tasks 7.Rubrics 8.Public Release of Sample Smarter Balanced Items 9.Resources 10. Questions

4. INTRODUCTION TO SMARTER BALANCED

5. OAKS-SMARTER BALANCED ASSESSMENT TRANSITION TIMELINE  OAKS Reading based on 2002 ELA Content Standards Writing based on current scoring guide Mathematics based on 2007/2009 Math Content Standards Smarter Balanced Assessment Based on Common Core State Standards adopted by Oregon in 2010 OAKS  Reading based on 2002 ELA Content Standards  Writing based on current scoring guide  Mathematics based on 2007/2009 Math Content Standards Smarter Balanced Assessment  Based on Common Core State Standards adopted by Oregon in 2010 2011-20122012-20132013-20142014-2015 OAKS Smarter OAKS  Reading based on 2002 ELA Content Standards  Writing based on current scoring guide  Mathematics based on 2007/2009 Math Content Standards Smarter Balanced Assessment  Based on Common Core State Standards adopted by Oregon in 2010

6. SMARTER ITEM DEVELOPMENT n

7. SMARTER ITEM TYPES OVERVIEW TEXT TXT EXT Assess a broad range of content. Scoring is objective, fast, and inexpensive to score. Difficult to understand a student’s reasoning process and to assess higher-order thinking skills. Require the student to generate a response as opposed to selecting a response. Include both short and extended responses. Allow students to demonstrate their use of complex thinking skills consistent with the expectations for college and career readiness. Require students to demonstrate ability to think and reason, and produce fully developed products. Measure complex “assessment targets.” Provide evidence of college and career readiness.

8. CLAIMS FOR MATHEMATICS SUMMATIVE ASSESSMENT Claim #1 Concepts & Procedures: “Students can explain and apply mathematical concepts and interpret and carry out mathematical procedures with precision and fluency.” Claim #2 Problem Solving: “Students can solve a range of complex well- posed problems in pure and applied mathematics, making productive use of knowledge and problem solving strategies.” Claim #3 Communicating Reasoning: “Students can clearly and precisely construct viable arguments to support their own reasoning and to critique the reasoning of others.” Claim #4 Modeling and Data Analysis: “Students can analyze complex, real-world scenarios and can construct and use mathematical models to interpret and solve problems.”

9. SMARTER ELA CLAIMS Place text here Students can read closely and analytically to comprehend a range of increasingly complex literary and informational texts. Claim 1 Reading Students can produce effective and well- grounded writing for a range of purposes and audiences. Claim 2 Writing Students can employ effective speaking and listening skills for a range of purposes and audiences. Claim 3 Speaking & Listening Students can engage in research/inquiry to investigate topics, and to analyze, integrate, and present information. Claim 4 Research

10. SMARTER BALANCED ASSESSMENT TARGETS For each of the different claims, Smarter Balanced has developed assessment targets (i.e. assessable content that will be on the summative assessments). Math: Claim 1- By Grade Level (In Packet)* Claim 2, 3, 4- Mathematical Practices (Same for all grade levels) ELA: Targets by Grade Level for each Claim

11. SUMMATIVE ASSESSMENT TEST SPECIFICATIONS MATH *Computer Adaptive Test (CAT) with SR, CR, TE items *Performance Task(s) Given last 12-15 weeks of school year ELA *Computer Adaptive Test (CAT) with SR, CR, TE items *Performance Task(s) Given last 12-15 weeks of school year

12. SAMPLE MATH ITEMS *Number Line *Painting a Barn *Soybean Field *Julie’s Jackets *Frogs and Flies *All sample items are found in the presentation packet. Additional Sample Items can be found on the Smarter Balanced website: www.smarterbalanced.org (Assessments).www.smarterbalanced.org

13. SAMPLE ELA ITEMS *Excerpt from Summer on Wheels (ELA Selective Response Item) *Sojourner Truth (ELA Technology Enabled Item) *Annie John (ELA Constructed Response Item) *All sample items are found in the presentation packet Additional Sample Items can be found on the Smarter Balanced website: www.smarterbalanced.org (Assessments).www.smarterbalanced.org

14. GUIDELINES FOR DEVELOPMENT OF SMARTER BALANCED PERFORMANCE TASKS  Represent content that is relevant and meaningful to students  Allow for demonstration of important knowledge and skills, including such 21 st century skills as critically analyzing and synthesizing information presented in a variety of formats, media, etc.  Incorporate knowledge and skills of prior grades, even though the major focus is on the standards for the current grade level.  Allow for multiple points of view and interpretations.  Are scored using multiple rubrics uniquely matched to the primary content claims and targets identified by the task developer in the task forms.  Be feasible for the school/classroom environment. (From: Smarter Balanced Assessment Consortium: Performance Task Specifications, April 16, 2012)

15. PERFORMANCE TASKS Extended projects demonstrate real- world writing and analytical skills May include online research, group projects, presentations Require 1-2 class periods to complete Included in both interim and summative assessments Applicable in all grades being assessed Evaluated by teachers using consistent scoring rubrics The use of performance measures has been found to increase the intellectual challenge in classrooms and to support higher-quality teaching. - Linda Darling-Hammond and Frank Adamson, Stanford University The use of performance measures has been found to increase the intellectual challenge in classrooms and to support higher-quality teaching. - Linda Darling-Hammond and Frank Adamson, Stanford University Performance Tasks

16. PERFORMANCE TASKS SUMMARY Performance tasks:  should incorporate real-world, college- and career-related skills that require students to accomplish complex goals during multiple testing sessions.  involve a significant interaction of students with stimulus materials leading to an exhibition of the students’ application of knowledge and skills, often in writing or spoken language.  should be multi-stepped and allow for reflection and revision.  are used because the ability to integrate knowledge and skills across multiple content standards is a critical skill that cannot be assessed with selected response or constructed response items.

17. MATH PERFORMANCE TASK PREVIEW Grade 5: School Festival You serve on a committee that is in charge of planning a school festival. The following tasks need to be completed by committee members as part of the planning for the school festival. Determine the budget for the festival. Choose the food and drinks for the festival. Determine amounts of supplies for making a dessert. Make a schedule of the different activities. Make some decisions on the games and prizes used during the festival. Sample Smarter Math Performance Task * Details and rubrics are in the session packet. Up to two class sessions (90 minutes) are suggested for this task, with no pre-teaching necessary.

18. ELA PERFORMANCE TASK PREVIEW Robot Pets  Session 1 (60 minutes) o Read 1 article and watch 2 brief videos on robots as pets, taking notes o Respond to 3 constructed-response questions: 1 addressing reading comprehension, 2 addressing research skills  Session 2 (45 minutes) o Read 1 article and watch 1 short video, taking notes o Small discussion group work  Session 3 (90 minutes) o Compose full-length argumentative essay on robots as pets o May use notes and refer back to articles o Pre-writing, drafting, and revising will be involved Sample Smarter English Language Arts Performance Task

19. ELA PERFORMANCE TASK PREVIEW Robot Pets  Video 1: Fujitsu’s cute teddy-bear robot shows what it can do, May 2010. http://www.youtube.com/watch?v=AwWeN1ARy74  Video 2: Pleo: Robot, pet or both? December 2007 http://www.youtube.com/watch?v=F6LCEFr8SxQ  Video 3: Maya’s Human Interaction http://www.youtube.com/watch?v=9b4jx5RzqAk Sample Smarter English Language Arts Performance Task

20. SMARTER GENERIC WRITING RUBRIC Five Attributes (4-point scale) Statement of Purpose/Focus Organization Elaboration of Evidence Language and Vocabulary Conventions Individual scores contribute to the overall score on the summative assessment

21. RESOURCES  Smarter Balanced Website http://www.smarterbalanced.org/  Smarter Sample Items and Performance Tasks http:// www.smarterbalanced.org/smarterbalanced-assessments /#itemhttp:// www.smarterbalanced.org/smarterbalanced-assessments /#item  Smarter Item Writing and Review Materials http://www.smarterbalanced.org/smarter-balanced-assessments/item- writing-and-review/  Common Core State Standards Toolkit http://www.ode.state.or.us/search/page/?id=3430  Common Core State Standards Assessment Resources http://www.ode.state.or.us/search/page/?id=3298

22. PUBLIC RELEASE OF SAMPLE SMARTER BALANCED MATH AND ELA ITEMS * Smarter Balanced will release 60 Math and 60 ELA Sample items (both Computer Adaptive Test items and Performance Tasks) for all grade levels (3-8 and High School (11) on October 9, 2012 http://www.smarterbalanced.org/sample-items-and-performance- tasks/http://www.smarterbalanced.org/sample-items-and-performance- tasks/. *The public will be able to take a sample test, in which they can score some of the questions to see if they answered it correctly or not (rubrics included). http://www.smarterbalanced.org/sample-items-and- performance-tasks-questions-and-feedback/. http://www.smarterbalanced.org/sample-items-and- performance-tasks-questions-and-feedback/

23. QUESTIONS Thank you for attending this presentation! Rachel Aazzerah: rachel.aazzerah@state.or.usrachel.aazzerah@state.or.us Additional ODE Contacts- Mark Freed (Math): mark.freed@state.or.usmark.freed@state.or.us Ken Hermens (English): ken.hermens@state.or.usken.hermens@state.or.us Derek Brown (Essential Skills): derek.brown@state.or.usderek.brown@state.or.us ODE Webpage: www.ode.state.or.us