1. MSC #26 Ready or Not: Next Generation Assessments Susan Gendron Senior Fellow Policy Coordinator, SMARTER July 2013

2. Agenda Next Generation of Assessments Welcome Closing RR Framework Assessment: Overview & Information Item Types Applications

3. Resources

4. Backward Design “To begin with the end in mind means to start with a clear understanding of your destination. It means you know where you’re going…so the steps you take are always in the right direction.”

5. Evidence Based Design

6. 1. Define the domain 2. Define claims to be made 3. Define assessment targets 4. Define evidence required 5. Develop Task Models 6. Performance Tasks

7. Matrix of Accessibility Features Available to AllAvailable with ISAAP Available with Documentation EmbeddedEnglish Glossaries Highlighter Mark for Review Masking Writing Tools Zoom Expandable Passages Calculator Digital Notepad Tab-enter Navigation Embedded Math Tools Color Overlays Color Contrast Guided Line Reader Magnification Reverse Contrast Text-to-Speech ASL Audio Captions Braille Translation Option Auditory Calming Non-EmbeddedBreaks Scratch Paper Color OverlaysAbacus Hand-held Calculator Print on Demand Quiet Environment

8. Figure 1: Conceptual Model of the Smarter Balanced Accessibility and Accommodations Framework A very small percentage of students participate in alternate assessments aligned to the Common Core State Standards

9. Three Item Types Evidence-Based Selected Response (EBSR) Selected-response question with a second selected-response question that asks students to show evidence from the text Examples include: Multiple-choice +; true-false + Technology- Enhanced Constructed Response (TECR) Uses technology to capture student comprehension of texts Examples include: drag and drop, cut and paste, shade text, move items to show relationships Range of Prose Constructed Responses (PCR) Read and can communicate understanding both in terms of written expression and knowledge of language and conventions Examples include: Multipage Essay 3 3 1 1 2 2

10. Six Item Types Selected Response Students select one response from a provided list Examples include: Multiple-choice, true- false, matching Constructed Response Student organizes and uses knowledge and skills to answer a question or complete a task Examples include: short answer, open response, extended response, essay, performance assessment Extended Response Students prepare a written answer, often a short phrase, a list, or a more substantial composition Examples include: Multipage Essay 3 3 1 1 2 2

11. Six Item Types Performance Task/Assessment Activity that requires students to construct a response, create a product or perform a demonstration. Open- ended-may not have one right answer, rubric used to grade. Technology- Enhanced Items (TEI) are computer-delivered items that include specialized interactions for collecting response data. Examples include: Select a single piece of text and type in a replacement for that text, select options from drop down menu Technology Enabled Allow for non-traditional layout of items that use constructed-response and/or selected- responses. Examples include: sound, computer read aloud, video, interactive widget 6 6 5 5 4 4 11

12. Claims and Targets Broad statements of the assessment system’s learning outcomes, each of which requires evidence. For each Claim, a set of “Assessment Targets” are provided. Claims Ways in which students may be expected to learn and demonstrate their knowledge A target represents the prioritized content for summative assessment Targets

13. Overall Claim (3-8 or 9-12) Informational Texts Literacy Texts Relationship Between Claims and Targets Claim # 2 (WRITING) Claim # 1 (LITERACY) Target 2 Target 3 Target 4 -7 Target 1 Target 8 Target 9 Target 10-14

14. How do Targets relate to Standards? Overall Claim (3-8 or 9-12) Informational Texts Literacy Texts Claim # 2 (WRITING) Claim # 1 (LITERACY) Target 2 Target 3 Target 4-7 Target 1 Target 8 Target 9 Target 10-14 CCSS RL-1 CCSS RL-2 CCSS RL-4 CCSS RL-5 CCSS L-5 CCSS L-5c CCSS L-4

15. No longer are we looking at standards in isolation. Instead, how do these groups of standards work together to accomplish a task or target? Overall Claim (3-8 or 9-12) Informational Texts Literacy Texts Claim # 2 (WRITING) Claim # 1 (LITERACY) Target 2 Target 3 Target 4-7 Target 1 Target 8 Target 9 Target 10-14 CCSS RL-1 CCSS RL-2 CCSS RL-4 CCSS RL-5 CCSS L-5 CCSS L-5c CCSS L-4

16. Rigor/Relevance Framework

17. Cognitive Rigor and Depth of Knowledge The level of complexity of the cognitive demand – Level 1/ Quad A: Recall and Reproduction Requires eliciting information such as a fact, definition, term, or a simple procedure, as well as performing a simple algorithm or applying a formula. – Level 2/ Quad B: Basic Skills and Concepts Requires the engagement of some mental processing beyond a recall of information. – Level 3/Quad C: Strategic Thinking and Reasoning Requires reasoning, planning, using evidence, and explanations of thinking. – Level 4: Extended Thinking Requires complex reasoning, planning, developing, and thinking most likely over an extended period of time.

18. Defining Relevance

19. Compare Learning to: Student’s life Family’s life Student’s community and friends Our world, nation, state World of work World of service World of business and commerce Use the Real World Moral, ethical, political, cultural points of view and dilemmas Real world materials Internet resources Video and other media Scenarios, real life stories News—periodicals, visual media Adding Relevance to Any Lesson

20. Rigor/Relevance Framework

21. Bloom’s Taxonomy— Technology Version educationaltechnologyguy.blogspot.com

22. The “two-second rule” is used by a driver who wants to maintain a safe following distance at any speed. A driver must count two seconds from when the car in front of him or her passes a fixed point, such as a tree, until the driver passes the same fixed point. Drivers use this rule to determine the minimum distance to follow a car traveling at the same speed. A diagram representing this distance is shown. As the speed of the cars increases, the minimum following distance also increases. Explain how the “two-second rule” leads to a greater minimum following distance as the speed of the cars increases. As part of your explanation, include the minimum following distances, in feet, for cars traveling at 30 miles per hour and 60 miles per hour. 2 Second Rule

30. Answer: ¾ of a sandwich is Left for Oscar