1. Configuring Online Student Test Settings in TOMS Test Settings in TOMS 1 – 2 p.m. December 18, 2014 California Assessment of Student Performance and Progress (CAASPP)

2. Configuring Online Student Test Settings in TOMS 2 Agenda Overview One by One Process in the User Interface File Upload Process Live Demonstration Questions

3. Configuring Online Student Test Settings in TOMS 3 Purpose To instruct local educational agency (LEA) CAASPP Coordinators on how to set embedded and non-embedded designated supports and accommodations for students in the Test Operations Management System (TOMS).

4. Overview

5. Configuring Online Student Test Settings in TOMS 5 Overview Q: Why do I need to set online test settings for students in TOMS? A: To ensure students receive the assigned accessibility supports for the online Smarter Balanced assessments.

6. Configuring Online Student Test Settings in TOMS 6 Overview Q: Who can set online test settings for students in TOMS? A: LEA CAASPP Coordinators and Test Site Coordinators (SCs) have the authorization to configure online test settings in TOMS. Please note that LEAs may designate the number of SCs needed to meet their needs.

7. Configuring Online Student Test Settings in TOMS 7 Overview Q: Which embedded and non-embedded designated supports and accommodations can I configure for students in TOMS? A: All embedded and non-embedded designated supports and accommodations may be assigned and activated through TOMS except the following, which must be activated through the test delivery system: Turning off a universal tool Stacked translations

8. Configuring Online Student Test Settings in TOMS 8 Overview A: *Must be activated in the test delivery system. **Print on demand for stimuli only can be activated in TOMS. If a student(s) need print on demand for items and/or items and stimuli, contact the CDE. EmbeddedNon-Embedded Designated SupportAccommodationDesignated SupportAccommodation Color Contrast American Sign Language (ELA listening and math items) Bilingual Dictionary (ELA performance task full writes) Abacus MaskingBrailleColor Contrast Alternate Response Options Text-to-Speech (math and ELA items) Closed Captioning (ELA listening items) Color OverlaysCalculator Translated Test Directions (math items) Streamlined InterfaceMagnificationMultiplication Table Translations (glossaries) (math items) Text-to-speech (ELA reading passages) Noise BuffersPrint on Demand** Translations (stacked) (for math items)* Read Aloud (math and ELA items) Read Aloud (ELA reading passages) Turn off any universal tools* Scribe (ELA non-writing and math items) Scribe Permissive ModeSeparate SettingSpeech-to-Text Print SizeTranslated Test DirectionsIndividualized Aids Translation (glossaries) (math items) Special Lighting or Acoustics Translated Test Directions (math items)

9. Configuring Online Student Test Settings in TOMS 9 Overview Q: Where can I get more information about designated supports and accommodations? A: Refer to the CAASPP Matrix One for available accessibility supports and the Smarter Balanced Usability, Accessibility, and Accommodations Guidelines for details on recommended uses of the supports. In addition, the CAASPP Individual Student Assessment Accessibility Profile (ISAAP) Tool may be used to facilitate selection of the accessibility supports to match student access need for Smarter Balanced assessments.CAASPP Matrix OneSmarter Balanced Usability, Accessibility, and Accommodations Guidelines

10. Configuring Online Student Test Settings in TOMS 10 Overview Q: What is the CAASPP ISAAP Tool? A: The CAASPP ISAAP Tool is an Excel workbook with specially designed formulas; the tool facilitates selection of the designated supports and accommodations that match students’ access needs for the Smarter Balanced assessments. The CAASPP ISAAP Tool can also be used to produce the online student test settings file that can be uploaded to TOMS.

11. Configuring Online Student Test Settings in TOMS 11 Overview Q: Where can I get more information on the CAASPP ISAAP Tool? A:A tutorial of the CAASPP ISAAP Tool as well as the actual tool will be made available later this month.

12. Configuring Online Student Test Settings in TOMS 12 Overview Q: How can I configure online test settings for students in TOMS? A: There are two options to set designated supports and accommodations in TOMS: 1.One by one manual configuration in the user interface 2.File upload −Use the online student test settings template −Use the CAASPP ISAAP Tool to create an upload file

13. One by One Process

14. Configuring Online Student Test Settings in TOMS 14 One by One 1.Select the [Test Operations Management System (TOMS)] button on the CAASPP portal at http://caaspp.org. http://caaspp.org 2.Log onto TOMS using your sign in credentials.

15. Configuring Online Student Test Settings in TOMS 15 One by One (cont.) 3.On the left navigation bar, select the [Students] button.

16. Configuring Online Student Test Settings in TOMS 16 One by One (cont.) 4.Upon selecting [Students], a dropdown menu will open. Select the [Search] button.

17. Configuring Online Student Test Settings in TOMS 17 One by One (cont.) 5.Enter details about the student in the search fields or select the LEA the student is associated with by selecting the [Select Organization] link.

18. Configuring Online Student Test Settings in TOMS 18 One by One (cont.) 6.Select the [Search] button.

19. Configuring Online Student Test Settings in TOMS 19 One by One (cont.) 7.Upon selecting [Search], search results will populate in a table underneath the fields.

20. Configuring Online Student Test Settings in TOMS 20 One by One (cont.) 8.To view and/or edit a student’s profile, select the magnifying glass [View] icon.

21. Configuring Online Student Test Settings in TOMS 21 One by One (cont.) 9.The selected student’s profile will open and the student’s demographic information will be displayed.

22. Configuring Online Student Test Settings in TOMS 22 One by One (cont.) 10.To configure the student’s online test settings, select the [Test Settings] tab.

23. Configuring Online Student Test Settings in TOMS 23 One by One (cont.) 11.Set embedded and non-embedded designated supports and accommodations for the student by selecting the appropriate selection(s) in the dropdown menus and checkboxes.

24. Configuring Online Student Test Settings in TOMS 24 One by One (cont.) 12.Select the [Update] button at the bottom of the page.

25. Configuring Online Student Test Settings in TOMS 25 One by One (cont.) 13.Upon selecting [Update], a confirmation message will display.

26. File Upload Process

27. Configuring Online Student Test Settings in TOMS 27 Online Student Test Settings Template 1.Select the [Test Operations Management System (TOMS)] button on the CAASPP portal at http://caaspp.org.http://caaspp.org 2.Log onto TOMS using your sign in credentials.

28. Configuring Online Student Test Settings in TOMS 28 3.On the left navigation bar, select the [Students] button. Online Student Test Settings Template (cont.)

29. Configuring Online Student Test Settings in TOMS 29 4.Upon selecting [Students], a dropdown menu will open. Select the [Online Test Settings] button. Online Student Test Settings Template (cont.)

30. Configuring Online Student Test Settings in TOMS 30 5.Select the [Download Spreadsheet Template] link to download the online student test settings template. Online Student Test Settings Template (cont.)

31. Configuring Online Student Test Settings in TOMS 31 Do not move or change the order of the columns –Column widths can be expanded for easier viewing Accepted file format: –.csv only Maintain the column headers in row 1 and 2 Do not use formulas Save your file frequently! Online Student Test Settings Template (cont.)

32. Configuring Online Student Test Settings in TOMS 32 Online Student Test Settings Template (cont.)

33. Configuring Online Student Test Settings in TOMS 33 6.Fill in the necessary fields of the template. −Column A: Student’s Statewide Student Identifier (SSID)  Must be 10 numeric characters  Required field  Acceptable values: 0, 1, 2, 3, 4, 5, 6, 7, 8, 9 −Column B: Abacus  Mathematics  Acceptable values: NEA_Abacus (abacus), leave field blank to deselect abacus −Column C: Alternate Response Options  Mathematics, ELA, performance task (PT)  Acceptable values: NEA_AR (alternate response options), leave field blank to deselect alternate response options Online Student Test Settings Template (cont.)

34. Configuring Online Student Test Settings in TOMS 34 6.Fill in the necessary fields of the template. −Column D: American Sign Language (ASL) for ELA Listening and Math Items  Mathematics, ELA, PT  Acceptable values: TDS_ASL0 (do not show ASL videos), TDS_ASL1 (show ASL videos), leave field blank to deselect ASL −Column E: Bilingual Dictionary for ELA Full Writes  ELA, PT  Acceptable values: NEDS_BD (bilingual dictionary), leave field blank to deselect bilingual dictionary Online Student Test Settings Template (cont.)

35. Configuring Online Student Test Settings in TOMS 35 6.Fill in the necessary fields of the template. −Column F: Language  Mathematics, ELA, PT  Acceptable values: ENU (English—default), ENU-Braille (braille), ESN (Spanish—math only) −Column G: Calculator (NON-EMBEDDED)  Mathematics  Acceptable values: NEA_Calc (calculator), leave field blank to deselect calculator Online Student Test Settings Template (cont.)

36. Configuring Online Student Test Settings in TOMS 36 6.Fill in the necessary fields of the template. −Column H: Closed Captioning for ELA Listening Items  ELA  Acceptable values: TDS_ClosedCap0 (not available), TDS_ClosedCap1 (available) −Column I: Color Contrast (EMBEDDED)  Mathematics, ELA, PT  Accepted values: TDS_CC0 (black on white), TDS_CCInvert (reverse contrast), TDS_CCMagenta (black on rose), TDS_CCMedGrayLtGray (medium gray on light gray), TDS_CCYellowB (yellow on blue), leave field blank to deselect color contrast Online Student Test Settings Template (cont.)

37. Configuring Online Student Test Settings in TOMS 37 6.Fill in the necessary fields of the template. −Column J: Color Contrast (NON-EMBEDDED)  Mathematics, ELA, PT  Acceptable values: NEDS_CC (color contrast), leave field blank to deselect color contrast −Column K: Color Overlays  Mathematics, ELA, PT  Acceptable values: NEDS_CO (color overlays), leave field blank to deselect color overlays −Column L: Magnification  Mathematics, ELA, PT  Acceptable values: NEDS_Mag (magnification), leave field blank to deselect magnification Online Student Test Settings Template (cont.)

38. Configuring Online Student Test Settings in TOMS 38 6.Fill in the necessary fields of the template. −Column M: Masking  Mathematics, ELA, PT  Acceptable values: TDS_Masking0 (not available), TDS_Masking1 (available) −Column N: Multiplication Table  Mathematics  Acceptable values: NEA_MT (multiplication table), leave field blank to deselect multiplication table Online Student Test Settings Template (cont.)

39. Configuring Online Student Test Settings in TOMS 39 6.Fill in the necessary fields of the template. −Column O: Noise Buffers  Mathematics, ELA, PT  Acceptable values: NEA_NoiseBuf (noise buffers), leave field blank to deselect noise buffers −Column P: Print On Demand  Mathematics, ELA, PT  Note: If your student needs print on demand for items, you must contact the California Department of Education  Acceptable values: TDS_PoD0 (none), TDS_PoD_Stim (stimuli), leave field blank to deselect print on demand Online Student Test Settings Template (cont.)

40. Configuring Online Student Test Settings in TOMS 40 6.Fill in the necessary fields of the template. −Column Q: Read Aloud for ELA  ELA, PT  Acceptable values: NEDS_RA_Stimuli (read aloud), leave field blank to deselect read aloud for ELA −Column R: Read Aloud for Math and ELA Items (NON- EMBEDDED)  Mathematics, ELA  Acceptable values: NEDS_RA_Items (read aloud for math and ELA items), NEDS_RA_Stimuli (read aloud for math and ELA stimuli), leave field blank to deselect read aloud for math and ELA items Online Student Test Settings Template (cont.)

41. Configuring Online Student Test Settings in TOMS 41 6.Fill in the necessary fields of the template. −Column S: Scribe  ELA, PT  Acceptable values: NEA_SC_WritItems (scribe), leave field blank to deselect scribe −Column T: Scribe (for ELA non-writing items and Math items)  Mathematics, ELA, PT  Acceptable values: NEDS_SC_Items (scribe), leave field blank to deselect scribe Online Student Test Settings Template (cont.)

42. Configuring Online Student Test Settings in TOMS 42 6.Fill in the necessary fields of the template. −Column U: Separate Setting  Mathematics, ELA, PT  Acceptable values: NEDS_SS (separate setting), leave field blank to deselect separate setting −Column V: Speech-to-text  Mathematics, ELA, PT  Acceptable values: NEA_STT (speech-to-text), leave field blank to deselect speech-to-text Online Student Test Settings Template (cont.)

43. Configuring Online Student Test Settings in TOMS 43 6.Fill in the necessary fields of the template. −Column W: Text-to-speech for ELA Reading Passages Grades 6–8 and 11  ELA, PT  Acceptable values: TDS_TTS0 (none), TDS_TTS_Stim (passages), leave field blank to deselect text-to-speech for ELA reading passages for grades 6–8 and 11 Online Student Test Settings Template (cont.)

44. Configuring Online Student Test Settings in TOMS 44 6.Fill in the necessary fields of the template. −Column X: Text-to-speech for Math and ELA Items  Mathematics, ELA, PT  Acceptable values: TDS_TTS0 (none), TDS_TTS_Item (items), TDS_TTS_Stim&TDS_TTS_Item (passages and items), leave field blank to deselect text-to-speech −Column Y: Translated Test Directions  ELA, PT  Acceptable values: NEDS_TransDirs (translated test directions), leave field blank to deselect translated test directions Online Student Test Settings Template (cont.)

45. Configuring Online Student Test Settings in TOMS 45 6.Fill in the necessary fields of the template. −Column Z: Translated Test Directions for Math Items  Mathematics  Acceptable values: NEDS_TransDirs (translated test directions), leave field blank to deselect translated test directions for math items Online Student Test Settings Template (cont.)

46. Configuring Online Student Test Settings in TOMS 46 6.Fill in the necessary fields of the template. −Column AA: Translation Glossaries for Math Items  Mathematics, PT  Accepted values: TDS_WL_Glossary (English), TDS_WL_ArabicGloss (Arabic), TDS_WL_CantoneseGloss (Cantonese), TDS_WL_ESNGlossary (Spanish), TDS_WL_KoreanGloss (Korean), TDS_WL_MandarinGloss (Mandarin), TDS_WL_PunjabiGloss (Punjabi), TDS_WL_RussianGloss (Russian), TDS_WL_TagalGloss (Filipino), TDS_WL_UkrainianGloss (Ukrainian), TDS_WL_VietnameseGloss (Vietnamese), TDS_WL_ArabicGloss&TDS_WL_Glossary (Arabic & English), TDS_WL_CantoneseGloss&TDS_WL_Glossary (Cantonese & English), TDS_WL_ESNGlossary&TDS_WL_Glossary (Spanish & English), TDS_WL_KoreanGloss&TDS_WL_Glossary (Korean & English), TDS_WL_MandarinGloss&TDS_WL_Glossary (Mandarin & English), TDS_WL_PunjabiGloss&TDS_WL_Glossary (Punjabi & English), TDS_WL_RussianGloss&TDS_WL_Glossary (Russian & English), TDS_WL_TagalGloss&TDS_WL_Glossary (Filipino & English), TDS_WL_UkrainianGloss&TDS_WL_Glossary (Ukrainian & English), TDS_WL_VietnameseGloss&TDS_WL_Glossary (Vietnamese & English), TDS_WL0 (none) Online Student Test Settings Template (cont.)

47. Configuring Online Student Test Settings in TOMS 47 6.Fill in the necessary fields of the template. −Column AB: Translation Glossaries for Math Items (NON-EMBEDDED)  Mathematics  Acceptable values: NEDS0 (none), English (English), NEDS_TRussian (Russian), NEDS_TArabic (Arabic), NEDS_TCantonese (Cantonese), NEDS_TSpanish (Spanish), NEDS_TKorean (Korean), NEDS_TMandarin (Mandarin), NEDS_TPunjabi (Punjabi), NEDS_TFilipino (Filipino), NEDS_TUkrainian (Ukrainian), NEDS_TVietnamese (Vietnamese) Online Student Test Settings Template (cont.)

48. Configuring Online Student Test Settings in TOMS 48 6.Fill in the necessary fields of the template. −Column AC: Permissive Mode  Mathematics, ELA, PT  Acceptable values: TDS_PM0 (disabled), TDS_PM1 (enabled) −Column AD: Print Size  Mathematics, ELA, PT  Acceptable values: TDS_PS_L0 (no default zoom applied), TDS_PS_L1 (1.5X), TDS_PS_L1 (1.75X), TDS_PS_L3 (2.5X), TDS_PS_L4 (3X) −Column AE: Streamlined Interface  Mathematics, ELA, PT  Acceptable values: TDS_SLM0 (standard), TDS_SLM1 (streamlined) Online Student Test Settings Template (cont.)

49. Configuring Online Student Test Settings in TOMS 49 6.Fill in the necessary fields of the template. −Column AF: Special Lighting or Acoustics (NON-EMBEDDED) Designated Support  Mathematics, ELA, PT  Acceptable values: Y (yes), N (no—default) −Column AG: Translated Test Directions for Math (NON- EMBEDDED) Designated Support  Mathematics, ELA, PT  Acceptable values: Y (yes), N (no—default) −Column AH: Individualized Aids (NON-EMBEDDED) Accommodation  Mathematics, ELA, PT  Acceptable values: Y (yes), N (no—default) Online Student Test Settings Template (cont.)

50. Configuring Online Student Test Settings in TOMS 50 7.Save the file in.csv format and upload it on the Upload Online Student Test Settings page in the TOMS interface. Online Student Test Settings Template (cont.)

51. Configuring Online Student Test Settings in TOMS 51 8.Check on the status of your uploaded file(s) on the Upload Online Student Test Settings page in the TOMS interface. : Processing : Complete : Delete file: Download errors Online Student Test Settings Template (cont.)

52. Configuring Online Student Test Settings in TOMS 52 The recorded tutorial on the CAASPP ISAAP Tool will include instructions and a demonstration of how to use the tool to create an upload file. The tutorial will be made available on caaspp.org. Creating the Upload File through the CAASPP ISAAP Tool

53. Live Demonstration

54. Updates and Announcements

55. Configuring Online Student Test Settings in TOMS 55 Updates and Announcements Target release date for Interim Assessment Comprehensive Forms is January 15. Target release date for Interim Assessment Blocks is January 27. Target release date for Summative Assessments is March 10. −Note: Assessments will be available to LEAs as dictated by their testing windows.

56. Resources and Support

57. Configuring Online Student Test Settings in TOMS 57 Resources TOMS Configuring Online Student Test Settings User Guide is forthcoming Matrix One (PDF; Updated Sep-2014)Matrix One Usability, Accessibility, and Accommodations Guidelines (PDF)Usability, Accessibility, and Accommodations Guidelines Guidelines: Frequently Asked Questions (PDF)Guidelines: Frequently Asked Questions

58. Configuring Online Student Test Settings in TOMS 58 Help Desk Support The California Technical Assistance Center (CalTAC) is here to support all LEA CAASPP coordinators! Monday–Friday from 7 a.m.–5 p.m. PT E-mail: caltac@ets.orgcaltac@ets.org Phone: 800-955-2954 Web site: http://caaspp.orghttp://caaspp.org