Presentation on theme: "Student Assessment Updates Susie Morrison, Deputy Superintendent Chief Education Officer Mary OBrian, Director of Assessment Illinois State Board of Education."— Presentation transcript:
Student Assessment Updates Susie Morrison, Deputy Superintendent Chief Education Officer Mary OBrian, Director of Assessment Illinois State Board of Education
3 Welcome to 2013-2014 School Year PARCC 2014 ISAT Change in performance level cut scores Growth model
Changes in Assessment Content contained is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License
Key ELA and Literacy Shifts Reading –Balance of literature and informational texts –Focus on text complexity Writing –Emphasis on argument and informative/ explanatory writing –Writing to sources –Writing analytical essays Speaking and Listening –Inclusion of formal and informal talk 5
Key Mathematics Shifts Each grade focuses on fewer standards: Greater depth Coherent progression across grades Conceptual understanding of topics Extend knowledge to real-life modeling and application 6
What Is PARCC? The Partnership for Assessment of Readiness for College and Careers: Made up of 19 states + DC and US Virgin Islands KY and PA are participating states Developing common, high-quality math and English language arts (ELA) tests for grades 3–11 Computer-based and linked to what students need to know for college and careers Field Testing: Spring 2014 For use starting in the 2014–15 school year 7
8 Getting All Students College and Career Ready Optional K–2 assessment being developed, aligned to the Common Core State Standards Timely data showing whether ALL students are on track for college and career readiness College readiness score to identify who is ready for college- level coursework Success In first-year, credit-bearing, postsecondary coursework Ongoing student support/interventions Professional development for educators
ELA: Grade 7 Sample Item 10 Students read the text that introduces the topic Items are designed to help students gather information from the texts to lead to the final writing prompt Items require different types of responses to allow students to demonstrate a command of evidence with complex text s
Part A: Highlight the claim that is supported by the most relevant and sufficient facts within Earharts Final Resting Place Believed Found. Part B: Click on two facts within the article that best provide evidence to support the claim selected in Part A. ELA: Grade 7 Sample Item 11 Claims Earhart and Noonan lived as castaways on Nikumaroro Island. Earhart and Noonans plane crashed into the Pacific Ocean People dont really know where Earhart and Noonan died.
Math: Grade 3 Sample Item 13 This a fairly traditional fraction task in a computer-based setting. Unlike traditional multiple choice, it is difficult to guess the correct answer or use a choice elimination strategy and there is more than one correct solution. Unlike paper and pencil tests, students can create a visual representation even though the task is scored automatically.
Math: Grade 3 Sample Item 14 Second part of multi-step problem, and, unlike traditional multiple choice, it is difficult to guess the correct answer or use a choice elimination strategy.
Math: High School Sample Item 15 Item has two possible solutions Students have to recognize the nature of the equation to know how to solve Technology prevents guessing and working backward
PARCC Comprehensive Accessibility Policies 16 * Available to all participating students **For students with disabilities, English learners, and English learners with disabilities
Accessibility Features for All Students 17 Accessibility Features for All Students Audio Amplification Blank Paper (provided by test administrator) Eliminate Answer Choices Flag Items for Review General Administration Directions Clarified (by test administrator) General Administration Directions Read Aloud and Repeated (by test administrator) Highlight Tool Headphones Magnification/Enlargement Device NotePad Pop-Up Glossary Redirect Student to Test (by test administrator) Spell Checker Writing Tools
Accessibility Features Identified in Advance 18 Accessibility Features Identified in Advance Answer Masking Background/Font Color (Color Contrast) General Masking Text-to-Speech for the Mathematics Assessments Line Reader Tool
Administrative Considerations for All Students Detailed guidelines will be included in the PARCC Test Administration Manual. Principals may determine that any student may require one or more of the following test administration considerations, regardless of the students status as a student with a disability or an English learner: –Small group testing –Frequent breaks –Time of day –Separate or alternate location –Specified area or seating –Adaptive and specialized equipment or furniture 19
Presentation Accommodations 20 Content AreaPresentation Accommodations ELA/Literacy Text-to-Speech or Video of a Human Interpreter for the ELA/Literacy Assessments, including items, response options, and passages* Braille Edition of ELA/Literacy Assessments (Hard-copy braille tests and refreshable braille displays for ELA/Literacy) Closed-Captioning of Multimedia Passages on the ELA/Literacy Assessments Descriptive Video Mathematics Video of a Human Interpreter for the Mathematics Assessments for a Student Who is Deaf or Hard of Hearing Braille Edition of Mathematics Assessments (Hard-copy braille tests for Mathematics) Both Content Areas Additional Assistive Technology (Guidelines available fall 2013) Tactile Graphics Video of a Human Interpreter for Test Directions for a Student Who is Deaf or Hard of Hearing Paper-and-Pencil Edition
Response Accommodations 21 Content AreaResponse Accommodations ELA/Literacy Scribing or Speech-to-Text (i.e., Dictation/Transcription or Signing) for constructed responses on the English Language Arts/Literacy Assessments* Word prediction on the ELA/Literacy Performance-Based Assessment* Mathematics Calculation Device and Mathematics Tools* (on Non-calculator Sessions of Mathematics Assessments) Both Content Areas Additional Assistive Technology (Guidelines available fall 2013) Braille note-taker Scribing or Speech-to-Text (i.e., Dictation/Transcription or Signing) for the Mathematics assessments, and for selected response items on the English Language Arts/Literacy assessments
PARCC Technology Platform 22 PEARSONs TestNav platform has been selected for the Field Test (Spring 2014) and 1 st Operational assessment in 2014-15. TestNav will provide a Proctor Caching solution that will allow for test downloads to individual computers for testing and then uploads when testing is completed reducing the amount of bandwidth needed during test administration. TestNav specifications (including bandwidth) will be released in August.
Looking Ahead 23 April 2013 Draft Performance Level Descriptors for public review (April 10-May 8) Draft Accommodations Manual for students with disabilities and English learners for public review (April 18-May 13) Spring 2013 Test Blueprints and Evidence Statements (~May 1) Guidance on Participation in Field Test and Practice Tests June 2013 Final Subject- and Grade-Level Performance Level Descriptors Final Accommodations Manual for Students with Disabilities and English Learners Summer 2013 Additional Sample Items Estimates for Assessment Cost Fall 2013 Design of Student Score Reports Minimum Technology Specifications, version 3.0
Looking Ahead 24 Throughout 2013-14 Additional Guidance to Districts on Assessment Administration Spring 2014Field Test Administration and Practice Test Fall 2014Operational Assessment Administration Manual SY 2014-15 Operational Administration of PARCC Summative Assessments Summer 2015 Standard Setting
PARCC Field Testing PARCC is developing a stratified random sample for classrooms to participate in field testing Classrooms will be chosen within schools given identified characteristics –Most students will take either Performance- based assessments OR End of Year assessments Content contained is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License
Change reading approximately 20 percentage points Change in mathematics approximately 25 percentage points Content contained is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License Change in Performance Level Cut Scores
Content contained is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License Backmapping process was used with data from 2011 PSAE and 2008 8 th grade ISAT –Equipercentile equating was used to determine performance categories –Maximizes the reliability of these data Reliability and stability of the new performance levels was tested through analysis of trend data for all ISAT scores for five years
2014 ISAT 100% of the test items are connected to the Common Core State Standards Test maps will be available soon Content contained is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License
ISAT Online Pilot 15 districts have been invited to participate in online pilot –One grade level at one school within each district Districts are at all levels of technology readiness Content contained is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License
Growth model metrics: Underlying assumptions –Valid, reliable, and fair –Transparent –Value proficiency at the Meets Standards level –Value changes in achievement level of students
School A Performance Level in Year 2 1A1B2A2B3A3B4A4B Performance Level in Year 1 1A 1B 1 2A 1 2 2B 1367 3A 13321 3B 211911 4A 4644 4B 1512 77.5% of Students Meet/Exceed Standards Growth Value: 94.5
School B Performance Level in Year 2 1A1B2A2B3A3B4A4B Performance Level in Year 1 1A 1 1B 113851 2A 412164 2B 16125 1 3A 1263 3B 23 1 4A 1 4B 28% of Students Meet/Exceed Standards Growth Value: 111.2
School C Performance Level in Year 2 1A1B2A2B3A3B4A4B Performance Level in Year 1 1A 13 1B 49511 2A 8141761 2B 4546315 3A 11850162 3B 5192464 4A 31372 4B 11374 58.4% of Students Meet/Exceed Standards Growth Value: 101.5
Each student within the school/district is placed within a cell of the table based on his or her ISAT scores over two years The scores of all the students within the school or district are averaged to determine a total growth value Implementation Process