Computerized Adaptive Testing for Students with Disabilities in K-12: Promises and Challenges Marty McCall Smarter Balanced Assessment Consortium CCSSO – NCSA June, 2015 – San Diego, CA

Conceptual Model of the Smarter Balanced Accessibility and Accommodations Framework

Embedded Tools Universal tools Breaks Calculator Digital Notepad English Dictionary English Glossary Expandable Psgs Global Notes Highlighter Keyboard Navg. Mark for Review Math Tools Spell Check Strikethrough Writing Tools Zoom Designated supports American Sign Language Braille Closed Captioning Streamline Text-to-Speech Color Contrast Masking Text-to-Speech Translated Test Directions Translations (Pop- up Glossary) Translations (Stacked) Turn off Any Universal Tools Accommodations

Non-Embedded Tools Universal tools Breaks English Dictionary Scratch Paper Thesaurus Designated supports Abacus Alternate Response Options Calculator Multiplication Table Print on Demand Read Aloud Scribe Speech-to-Text Bilingual Dictionary Color Contrast Color Overlay Magnification Read Aloud Noise Buffers Scribe Separate Setting Translated Test Directions Translations (Glossary) Accommodations

Change from paper to online Advantages New ways to present items – audio – large print – filters – ASL, Braille, embossing printers Expanded response modes – Input devices/keyboards – Interaction/engagement – Electronic supports Ability to standardize accommodations Issues Innovative item types may not be universal Controversy over some tools Plethora of solutions causes high volume and complexity

Comfort levels change Used to be controversial –Electronic calculators –Keyboards –Spellcheck Still controversial –Not requiring decoding in reading –Translations

Accommodations available only to those who need them Not controversial Controversial

Making tests adaptive Components –Test blueprint –Item Pool –Algorithm

Advantages More precise scores, particularly for high and low performers Better information for growth models Student experience is more engaging – Questions are at an appropriate level Issues Enormous item pools, limited budgets. Need to prioritize Legal framework – Does every item need to be available in every mode? – Are translations all or none? Belief that students will not show skills

Thank you for your attention