2016–17 California Alternate Assessments Test Administration Workshop

2016–17 California Alternate Assessments Test Administration Workshop
Presented by Educational Testing Service (ETS)

Target Audience This workshop is designed for:
Local educational agency (LEA) California Assessment of Student Performance and Progress (CAASPP) coordinators CAASPP test site coordinators California Alternate Assessments (CAAs) test examiner trainers Any other staff at your LEA involved with the CAAs 2016–17 California Alternate Assessments Test Administration Workshop

Learning Goals Participants will understand:
The purpose and use of the CAAs for English language arts/literacy (ELA), mathematics, and science The various components of preparing for the CAA administration for ELA, mathematics, and science The step-by-step procedures for administering the CAAs for ELA, mathematics, and science to students How to train test examiners to administer the CAAs for ELA, mathematics, and science 2016–17 California Alternate Assessments Test Administration Workshop

Success Criteria Participants can:
Identify the purpose of the CAAs and the students for whom the assessment is designed Identify the tools and resources needed to set up the CAA administration at their LEA Administer the CAAs to a student Train others (test examiners) on how to administer the CAAs to students 2016–17 California Alternate Assessments Test Administration Workshop

Preparing for Test Administration 1:30–1:45 p.m.
Afternoon Session Topic 1–1:15 p.m. Overview of the CAAs 1:15–1:30 p.m. Preparing for Test Administration 1:30–1:45 p.m. Accessibility Resources 1:45–2:55 p.m. Administering the CAAs 2:55–3 p.m. Test Security 3–3:10 p.m. Resources and Support 3:10 –3:30 p.m. Questions and Answers 2016–17 California Alternate Assessments Test Administration Workshop

Overview of the CAAs

How to View These Slides
ELA/Mathematics How to View These Slides Science 2016–17 California Alternate Assessments Test Administration Workshop

About the CAAs For students with the most significant cognitive disabilities and whose individualized education program (IEP) team designates the use of an alternate assessment Online summative grade-level assessment Part of the California Assessment of Student Performance and Progress (CAASPP) System One-on-one assessment 2016–17 California Alternate Assessments Test Administration Workshop

Student Eligibility A student is eligible to take the CAAs if the IEP team designates the use of an alternate assessment. The California Department of Education recommends IEP teams base their decision on the use of an alternate assessment on the following criteria: The student has a significant cognitive disability. The student is learning content derived from the California Standards The student requires extensive and direct individualized instruction and substantial supports to achieve measurable gains in the curriculum. 2016–17 California Alternate Assessments Test Administration Workshop

Overview: Student Participation
All students who are eligible to take the CAAs are required to participate. Students in ungraded programs must be assigned grade levels for testing purposes. Test examiners must assign the appropriate grade for students in ungraded programs at the time of testing by subtracting 5 from their chronological age on September 1, 2016. For example, a student who was 10 years old on September 1 would be given the grade five test (10 years – 5 = grade five). All students attempting the CAA for ELA and mathematics will receive a scale score and achievement level. Only participation is being tracked for CAA for science. 2016–17 California Alternate Assessments Test Administration Workshop

What’s New for the 2016–17 CAAs
New CAA for Science Pilot test The CAA tests, including the CAA for Science pilot, will be available starting on March 20, 2017. LEAs start testing according to their selected CAASPP testing window (instead of a single CAA window for the whole state). More streamlined ELA/mathematics test: The Survey of Student Characteristics is shorter and will be integrated as the last segment of each test. In the Student Response Check, the test examiner will be able to end the CAA test using the [End Test] button, which will be available on the first and fourth question. 2016–17 California Alternate Assessments Test Administration Workshop

CAA for ELA and mathematics practice tests for each grade in grades three through eight and grade eleven will be available in January 2017. CAA for Science Training Sample will be available by late January/early February 2017. 2016–17 California Alternate Assessments Test Administration Workshop

The student grade coming from the California Longitudinal Pupil Achievement Data System (CALPADS) will be “locked” in the Test Operations Management System (TOMS) as soon as the student starts his or her first test. Be sure the grade is correct before the student starts testing; otherwise a test reset will be necessary. “CA-” is no longer needed as a prefix for the Statewide Student Identifier (SSID) at test logon. 2016–17 California Alternate Assessments Test Administration Workshop

CAAs for ELA and Mathematics Overview
2016–17 California Alternate Assessments Test Administration Workshop

Purpose of the CAAs ELA/Mathematics
To provide students with the most significant cognitive disabilities the opportunity to demonstrate achievement by taking a test commensurate with their abilities as indicated in the student’s IEP Students are assessed through alternate achievement standards linked to Common Core State Standards (CCSS). The tests are aligned to core content connectors (Connectors) developed by the National Center and State Collaborative. The items are written to grade-level Connectors. 2016–17 California Alternate Assessments Test Administration Workshop

CAAs for ELA and Mathematics Test Administration
ELA/Mathematics CAAs for ELA and Mathematics Test Administration The CAAs for ELA and mathematics are administered to students in grades three through eight and grade eleven. The CAAs for ELA and mathematics are administered online only; there are no paper versions. They are administered one-on-one by a test examiner. CAA administration requires two Internet-connected devices: Student testing device Test examiner device A CAASPP secure browser must be installed on the student testing devices. Test examiners must use the proper grade- and version- specific Directions for Administration (DFA). 2016–17 California Alternate Assessments Test Administration Workshop

CAAs for ELA and Mathematics DFAs
ELA/Mathematics CAAs for ELA and Mathematics DFAs Each DFA includes both ELA and mathematics directions. DFAs are downloaded from TOMS. They are grade- and version-specific PDFs. Versions are assigned at the school level. Example: John Doe Elementary School is assigned Version 1 of the grade three, four, five, and six CAA DFAs. Version assignments for each school will be posted at assignments html in March 2017. DFAs include alternative text, which provides descriptions of the images, graphics, and/or animations used in test stimuli. Alternative text is meant to make visual information accessible for learners with visual disabilities or those who are not familiar with the type of graphic being used. 2016–17 California Alternate Assessments Test Administration Workshop

CAAs for ELA and Mathematics Multistage Design
ELA/Mathematics CAAs for ELA and Mathematics Multistage Design STAGE 1 STAGE 2 SSC (13 items) Tier 1 (15 items) Student Response Check (4 items) OR Tier 2 (15 items) Survey of Student Characteristics (Questions to be completed by test examiner) OR Tier 3 (15 items) (Some students will stop testing after Stage 1 based on their performance in Stage 1.)

CAAs for ELA and Mathematics Stopping Points
ELA/Mathematics CAAs for ELA and Mathematics Stopping Points There are four locations where a test may end for a student: After the first question in the Student Response Check After the fourth question in the Student Response Check At the end of Stage 1, if the system determines a student is struggling At the end of the test However, a test examiner may make the determination to end a test at any time if student productivity and engagement significantly decline, even after giving the student breaks. 2016–17 California Alternate Assessments Test Administration Workshop

CAA for Science Pilot Test Overview

For the pilot, the CAA for Science will be administered via an embedded performance task (PT) that will be available as a PDF in TOMS. An embedded PT is a series of related test questions that are administered following classroom instruction. For this year’s pilot, administer within testing window when convenient for test examiner The embedded PTs will have instructions for how the test examiner is to administer the embedded PT. Student surveys will be filled out in the test delivery system. This login and student survey is used to capture participation for accountability. DFAs will be included at the front of the embedded PTs. They are also available as a two-page pullout within the Online Test Administration Manual for CAASPP Testing. 2016–17 California Alternate Assessments Test Administration Workshop

The CAA for science will be a new type of alternate assessment for science. Tasks are designed to be adjustable according to how each student is taught science concepts. The embedded Performance Task explains which parts can and cannot be changed by the test examiner. Remember, this year is a pilot, and we want feedback on… How it works for your students. How it works for test examiners. 2016–17 California Alternate Assessments Test Administration Workshop

Example of CAA for Science

CAA for Science Pilot Test Administration
All students in grades five and eight who are eligible to take the CAAs for ELA and mathematics will also take the pilot CAA for Science. Students in grades ten, eleven, or twelve will also take the CAA for Science according to assignments for each school. The assigned grade will be the same as the assigned grade for the California Science Test (CAST) pilot. Find the assigned grade here: e-assignments.html 2016–17 California Alternate Assessments Test Administration Workshop

Preparing for Test Administration

Assigning Student Tests for the CAAs
Students must be assigned to the CAAs in TOMS in one of two ways: Via the user interface (one student at a time) OR Through spreadsheet template upload (multiple students) If a student is assigned to “Alternate Assessment” within TOMS, the student is automatically registered for the CAAs for ELA, mathematics, and science, depending on the student’s grade. 2016–17 California Alternate Assessments Test Administration Workshop

TOMS will not process CAA registration if the student does not have an IEP in CALPADS (“special education” indicator and a primary disability code). For students in ungraded programs (UE or US), test examiners must assign the appropriate grade in the Test Administrator Interface or Student Testing Interface at the time of testing by subtracting 5 from the student’s chronological age on September 1, For example, a student who was 10 years old on September 1 would be given the grade five test (10 years – 5 = grade five). 2016–17 California Alternate Assessments Test Administration Workshop

Students should already be registered for the CAAs in TOMS. If not, do so as soon as possible (see the [Test Admin] tab in TOMS). Recommended: Complete registration as soon as possible so student rosters reflect the correct test assignments and to allow for IEP addendums. Register students for the correct test before assigning accessibility resources in TOMS. The student grade coming from CALPADS will be “locked” in TOMS as soon as the student starts his or her first test. Be sure the grade is correct before the student starts testing; otherwise a test reset using STAIRS will be necessary. 2016–17 California Alternate Assessments Test Administration Workshop

Indicating Parent/Guardian Exemptions
Set the PGE condition code in TOMS prior to testing. Set in the [Score Status] tab of the student’s profile in TOMS. 2016–17 California Alternate Assessments Test Administration Workshop

Assigning Accessibility Resources
Ensure that accessibility resources assigned to the student in TOMS are consistent with the student’s IEP through one of three methods available in TOMS: User interface (one student at a time) Spreadsheet template upload (multiple) Individual Student Assessment Accessibility Profile (ISAAP) Tool and upload (multiple) 2016–17 California Alternate Assessments Test Administration Workshop

Preparing Technology All online CAASPP assessments have the same technological requirements. CAASPP secure browsers must be installed on all student testing devices: A list of supported systems, devices, and browsers can be found at browsers/. The CAA for Science pilot is not administered online. The CAA for Science student survey will need to be completed online in the Test Delivery System and the secure browser. 2016–17 California Alternate Assessments Test Administration Workshop

Preparing Technology Two devices needed:
Test examiner device Log onto the Test Administrator Interface. Create a test session. Display an electronic version of the DFA. Student testing device Log onto and take a test or CAA for science survey on the Student Testing Interface. Additional assistive devices may be used. They are: Identified in a student’s IEP or Section 504 plan, and Used according to the communication and response method of each student. 2016–17 California Alternate Assessments Test Administration Workshop

Technology Resources The following technology-oriented manuals are available at Technical Specifications and Configuration Guide for CAASPP Online Testing—for instructions on preparing technology for testing Online Test Administration Manual for CAASPP Testing—for general instructions on CAASPP systems TOMS Pre-Administration Guide for CAASPP Testing—for information about assigning accessibility tools and supports 2016–17 California Alternate Assessments Test Administration Workshop

CAAs for ELA and Mathematics Training Tests vs. Practice Tests
ELA/Mathematics CAAs for ELA and Mathematics Training Tests vs. Practice Tests Training Tests for CAAs Practice Tests for CAAs Purpose Provide students, teachers, parents, and stakeholders with the opportunity to quickly become familiar with the test delivery system, question types, and interactions provided in the DFAs Designed to allow students, teachers, parents, and stakeholders to experience grade-level CAA test questions Grade Levels One test each for ELA and mathematics One test each for ELA and mathematics for each grade between grades three through eight and grade eleven Number and Types of Questions 13 questions for mathematics 15 questions for ELA Approximately 11–22 questions for each content area Universal Tools, Designated Supports, and Accommodations All that are available for the CAAs Scoring Not scored Not scored; scoring rubrics will be provided at a later date. New

Using the Training Test
ELA/Mathematics Using the Training Test Designed to allow test examiners and students to try out the accessibility resources in order to establish the most optimal test setting experience for the student Familiarizes test examiners and students with item types, the testing interface, and functionalities Includes one ELA and one mathematics training test, used in conjunction with the CAA Training Test DFA Includes 15 items for ELA, 13 items for mathematics Is not grade-specific Is not to be used to measure content knowledge Does not produce scores 2016–17 California Alternate Assessments Test Administration Workshop

Using the Practice Test
ELA/Mathematics Using the Practice Test Designed to allow test examiners and students to experience grade-level CAA test questions Provides a sample of question types and grade-level content that appears on the CAA operational tests Includes one ELA and one mathematics practice test per grade, used in conjunction with the CAA Practice Test DFA Is grade-specific Is not to be used to measure content knowledge Does not produce scores 2016–17 California Alternate Assessments Test Administration Workshop

CAA for Science Training Sample
Training Sample for CAA for Science Purpose Provides students, teachers, parents and stakeholders with an opportunity to become familiar with the embedded PTs aligned to the Connectors Grade Levels One sample for science Number and Types of Questions Approximately 3–5 questions for each embedded PT Universal Tools, Designated Supports, and Accommodations All non-embedded supports are available. Scoring Test scores are not collected and do not impact students for the pilot. 2016–17 California Alternate Assessments Test Administration Workshop

Using the Training Sample
Science Using the Training Sample Available only for the CAA for Science Provides students with an opportunity to become familiar with the embedded PTs aligned to the Connectors Available as a PDF on the CAASPP Web portal by late January/early February 2017 2016–17 California Alternate Assessments Test Administration Workshop

Test Preparation Tips Training tests for ELA and mathematics are the best way to gain familiarity with the testing system and interactions. The Training Sample for Science allows students and teachers to become familiar with this form of assessment. Practice tests for ELA and mathematics are available for students and test examiners to experience the grade-specific items and item types available. 2016–17 California Alternate Assessments Test Administration Workshop

Accessibility Resources

CAAs for ELA and Mathematics Accessibility Resources

Universal Tools, Designated Supports, and Accommodations
ELA/Mathematics Universal Tools, Designated Supports, and Accommodations CAAs for ELA and mathematics provide the same universal tools, designated supports, and accommodations (UDAs) as other online CAASPP assessments: Universal tools are available to all students by default. Designated supports are provided at the discretion of a teacher familiar with the student’s needs. Accommodations must be specified in a student’s IEP or Section 504 plan. All embedded and non-embedded designated supports and accommodations are assigned to individual students in TOMS. 2016–17 California Alternate Assessments Test Administration Workshop

CAAs for ELA and Mathematics Embedded Accessibility Resources
ELA/Mathematics CAAs for ELA and Mathematics Embedded Accessibility Resources Designated Supports Accommodation Color contrast Streamlined interface Masking Print size Permissive mode Turn off any universal tools* *Must be activated in the test delivery system; cannot be activated in TOMS Online tutorials for some designated supports may be found in this link: 2016–17 California Alternate Assessments Test Administration Workshop

CAAs for ELA and Mathematics Non-embedded Accessibility Resources
ELA/Mathematics CAAs for ELA and Mathematics Non-embedded Accessibility Resources Designated Supports Accommodations Color contrast Abacus Color overlay Alternate response options Magnification Multiplication table Noise buffers Print on demand* Read aloud Read aloud passages Scribe Separate setting Unlisted resources Instructional supports (CAAs only) *Print on demand cannot be activated in TOMS; contact the California Technical Assistance Center (CalTAC) to request access. 2016–17 California Alternate Assessments Test Administration Workshop

CAAs for ELA and Mathematics UDA Considerations
ELA/Mathematics CAAs for ELA and Mathematics UDA Considerations Non-embedded calculators are allowed on all mathematics tests except for specific items on the grade three mathematics test, which will be indicated explicitly in the DFAs. It is always permissible for the CAAs to be administered in the language of instruction. Response modes include: Mouse/Keyboard Verbal response Touch screen, gestures, or pointing Augmentative and/or alternate communication device Eye gaze Instructional supports include: Anything listed in the student’s IEP 2016–17 California Alternate Assessments Test Administration Workshop

CAA for Science Accessibility Resources

Universal Tools, Designated Supports, and Accommodations
Science Universal Tools, Designated Supports, and Accommodations Because the CAA for Science is an instructional embedded PT, the usual universal tools, designated supports, and accommodations do not apply. Any non-embedded support normally used in the classroom may be utilized. 2016–17 California Alternate Assessments Test Administration Workshop

Administering the California Alternate Assessments

Test Examiner Responsibilities
Test examiners: Are trained by the LEA and/or view the Test Examiner Tutorial for ELA/mathematics/science and/or the Test Examiner Tutorial for science, print the certificate, and submit it to the LEA. Read and submit the CAASPP Test Security Affidavit for Test Examiners to the CAASPP test site coordinator. Ensure the student’s accessibility resources in TOMS are consistent with his or her IEP. If inconsistent with the IEP, notify the LEA CAASPP coordinators or CAASPP test site coordinators to have accessibility resources entered into TOMS for the test examiner. Also check the student’s accessibility resources prior to approving a test within the test delivery system. 2016–17 California Alternate Assessments Test Administration Workshop

Test Examiner Responsibilities
Download operational DFAs from TOMS. Download embedded PTs from TOMS. Read the DFAs before testing. Administer the Student Response Check. Administer the test according to the results of the Student Response Check. Complete the Survey of Student Characteristics within the ELA/mathematics test and the student survey in the CAA for Science. Securely destroy all testing materials. 2016–17 California Alternate Assessments Test Administration Workshop

Test Examiner Reminders
Each test examiner must complete a training session before administering the CAAs. It is strongly recommended that trainings include completing both: A local training based on the content of today’s workshop, and The forthcoming Test Examiner Tutorial, a stand-alone online training module. The amount of training required will depend on the test examiner’s level of prior experience with the CAAs, including the CAA for Science. Test examiners must sign and return the CAASPP Test Security Affidavit to their CAASPP test site coordinator. 2016–17 California Alternate Assessments Test Administration Workshop

CAA Test Examiner Tutorial
The CAA Test Examiner Tutorial is an online stand-alone training module designed specifically for test examiners. This tutorial has a series of questions embedded throughout the presentation to test understanding. Test examiners who have completed the tutorial will receive a certificate. This online tutorial may be a useful tool to incorporate into LEA local trainings. 2016–17 California Alternate Assessments Test Administration Workshop

CAAs for ELA and Mathematics Administering the CAAs

About This Section ELA/Mathematics
This part of the training will prepare you to train your test examiners to administer the CAAs to students. These slides are available for you to use in your trainings. “Check for Understanding” slides can be used to reinforce key points. 2016–17 California Alternate Assessments Test Administration Workshop

Learning Goals ELA/Mathematics Participants will understand:
The flow of CAA testing The various components of preparation needed prior to administering the CAAs to a student The step-by-step procedures for administering the CAAs to students 2016–17 California Alternate Assessments Test Administration Workshop

Success Criteria ELA/Mathematics Participants can:
Identify the components of administering the CAAs to a student in sequential order Identify how to engage students for CAA testing through the Student Response Check Administer the CAAs to a student 2016–17 California Alternate Assessments Test Administration Workshop

CAAs for ELA and Mathematics An Introduction for Test Examiners
ELA/Mathematics CAAs for ELA and Mathematics An Introduction for Test Examiners Question Answer Who takes the CAAs for ELA and mathematics? All students enrolled in or assigned to grades three through eight and grade eleven whose IEP team designates the use of an alternate assessment will take the CAAs for ELA and mathematics. How many items are on a test? A student will see no more than 28 items per content area. How do the students take the tests? The CAAs are administered online only and one-on-one by a test examiner. 2016–17 California Alternate Assessments Test Administration Workshop

CAAs for ELA and Mathematics An Introduction for Test Examiners
ELA/Mathematics CAAs for ELA and Mathematics An Introduction for Test Examiners Question Answer Who can administer the CAAs? A certificated or licensed test examiner who is familiar with the student administers the CAAs. What do I need in order to administer the CAAs? A student testing device, test examiner device, and grade- and version-specific DFA are required to administer the CAAs. How are the CAAs scored? The CAAs are scored mostly by computer. Test examiners provide ratings for a small number of ELA items for which the student provides short written responses. 2016–17 California Alternate Assessments Test Administration Workshop

How Testing Works ELA/Mathematics
Use the same test delivery system as the Smarter Balanced tests Two Internet-connected devices are needed for testing: One device for the test examiner to manage testing One device (with a CAASPP secure browser installed) for administering the test to the student You will use specific logon information on each device: Test examiner device: TOMS credentials for Test Administrator Interface Student testing device: Student’s SSID, first name, and test session ID 2016–17 California Alternate Assessments Test Administration Workshop

STUDENT TESTING DEVICE
ELA/Mathematics How Testing Works INTERNET STUDENT TESTING DEVICE TEST EXAMINER DEVICE CAASPP secure browser (Student Testing Interface) Both the test examiner and student interact with this device Use a device the student is familiar with Log on with student’s information Administer ELA and mathematics tests Complete the Survey of Student Characteristics For CAA for Science, complete the student survey Ensure that the student’s augmentative or alternative communication is programmed Test Administrator Interface Any device (tablets recommended) Log on with TOMS username and password Start test sessions by generating a Session ID Can be used to read PDF version of the DFA for CAA for ELA and mathematics Verify student SSID 2016–17 California Alternate Assessments Test Administration Workshop

Check for Understanding
ELA/Mathematics Check for Understanding Q: Who should be administered the CAAs? A: Students whose IEP indicates the use of an alternate assessment should take the CAAs. Q: What do I need in order to administer the CAAs? A: A student testing device, a test examiner device, and a grade- and version-specific DFA are need to administer the CAAs for ELA and mathematics. Q: Can more than one student be tested at once by the same test examiner? A: No. The CAAs are administered one-on-one only. 2016–17 California Alternate Assessments Test Administration Workshop

Directions for Administration
ELA/Mathematics Testing Components Before Testing STAGE 1 STAGE 2 SSC Directions for Administration (13 items) Tier 1 (15 items) Student Response Check (4 items) OR Tier 2 (15 items) Survey of Student Characteristics (Questions completed by test examiner) OR Tier 3 (15 items) 2016–17 California Alternate Assessments Test Administration Workshop

Testing Components ELA/Mathematics Adaptive Route
Student Response Check Directions for Administration (printed or PDF) Adaptive Route Q1 Q2 Q3 Q4 Q5 Q6 Q7 … Q13 Stage One Logon Test examiner stop? Test examiner stop? T1 Q14 Q15 Q16 Q17 Q18 … Q28 Stage Two or T2 Q14 Q15 Q16 Q17 Q18 … Q28 or T3 Q14 Q15 Q16 Q17 Q18 … Q28 SSC S1 S2 … Sn 2016–17 California Alternate Assessments Test Administration Workshop

ELA/Mathematics Directions for Administration Student Response Check Directions for Administration (printed or PDF) Adaptive Route Q1 Q2 Q3 Q4 Q5 Q6 Q7 … Q13 Stage One Log-on Test examiner stop? Test examiner stop? T1 Q14 Q15 Q16 Q17 Q18 … Q28 Stage Two or T2 Q14 Q15 Q16 Q17 Q18 … Q28 or T3 Q14 Q15 Q16 Q17 Q18 … Q28 SSC S1 S2 … Sn 2016–17 California Alternate Assessments Test Administration Workshop

ELA/Mathematics Directions for Administration The CAA DFAs are grade- and version-specific: Guide test examiners step-by-step Include item-specific instructions, scripts, and scoring rubrics for some items Available as PDFs Version assignments for your school are posted at Download secure DFA(s) from TOMS: Use electronic or print format according to local preference Keep secure at all times Securely destroy after testing 2016–17 California Alternate Assessments Test Administration Workshop

ELA/Mathematics Directions for Administration Each school in California is assigned Version 1, 2, 3, 4, or 5. The version assignment applies to all grades within a school: Example: School A is assigned Version 1 and is testing a student in grade four and a student in grade five. The test examiner needs the Grade Four Version 1 DFA and the Grade Five Version 1 DFA. Ensure you are using the right version at the start of testing. DFAs include alternative text to describe images for students with visual impairments. Alternative text provides descriptions of the images, graphics, and/or animations used in test stimuli and is meant to make this visual information accessible for learners with visual disabilities or those who are not familiar with the type of graphic being used. 2016–17 California Alternate Assessments Test Administration Workshop

ELA/Mathematics Check for Understanding Q: What document do you need in hand before starting testing with a student? A: The appropriate grade- and version-specific DFA for the CAAs for ELA and mathematics is needed. Q: Where can the DFAs and DFA version assignments be found? A: The DFAs for the CAAs for ELA and mathematics are downloaded from TOMS after identifying the grades for testing and the school’s assigned version number. The DFA version assignments are found on the CAASPP Web portal. 2016–17 California Alternate Assessments Test Administration Workshop

ELA/Mathematics Check for Understanding Q: What is the alternative text contained within the DFA? A: Alternative text provides descriptions of the images, graphics, and/or animations used in test stimuli for students with visual impairments. Q: What do I do with the DFA after testing is complete? A: For printed copies of the DFA, shred or otherwise securely destroy them. For electronic versions, permanently delete the PDF files from all devices. 2016–17 California Alternate Assessments Test Administration Workshop

Student Response Check
ELA/Mathematics Student Response Check Student Response Check Directions for Administration (printed or PDF) Adaptive Route Q1 Q2 Q3 Q4 Q5 Q6 Q7 … Q13 Stage One Logon Test examiner stop? Test examiner stop? T1 Q14 Q15 Q16 Q17 Q18 … Q28 Stage Two or T2 Q14 Q15 Q16 Q17 Q18 … Q28 or T3 Q14 Q15 Q16 Q17 Q18 … Q28 SSC S1 S2 … Sn 2016–17 California Alternate Assessments Test Administration Workshop

ELA/Mathematics Student Response Check The purpose of the Student Response Check for the CAAs for ELA and mathematics is to confirm that the student has a consistent and observable way of indicating responses to test items and can orient to the task. Typical student response modes must be known before testing. 2016–17 California Alternate Assessments Test Administration Workshop

ELA/Mathematics Student Response Check The Student Response Check is identified by the student’s response(s) to the first four test questions in a content area: After Q1: If no orientation and no response select [End Test]; this will completely end and submit the test. All students who are logged on and presented with the first test question will count as having tested. After Q4: If the student orients to but does not respond to the first four test questions select [End Test]; this will completely end and submit the test. The Student Response Check process is outlined in the DFA with specific scripts and guidelines. 2016–17 California Alternate Assessments Test Administration Workshop

ELA/Mathematics Student Response Check For students who do not orient to the first (or first four) questions or provide observable, consistent responses to them, test examiners should end the assessment by selecting the [End Test] button. Test examiners are responsible for administering the Student Response Check according to the guidelines provided in the DFA. Students engaging in responding to items should continue testing until the system prompts them to end the test. 2016–17 California Alternate Assessments Test Administration Workshop

Cues and Wait Times ELA/Mathematics
Use the following guidelines for establishing whether a student responds to or orients to the task: Student should be allowed at least five seconds if a verbal response is expected or seven seconds if a physical or motor response is expected. Wait times are approximate; you know your students and the appropriate time for a response. Directions may be repeated if necessary. 2016–17 California Alternate Assessments Test Administration Workshop

Identifying Response Mode
ELA/Mathematics Identifying Response Mode If the student does not have the fine motor skills to consistently and independently use a mouse, keyboard, or touchscreen, identify alternate response options. The test examiner may input responses that the student indicates by verbalizing, gesturing, or pointing using assistive technology or an eye gaze chart. Use the practice and training tests to try out various response options. 2016–17 California Alternate Assessments Test Administration Workshop

Possible Response Modes
ELA/Mathematics Possible Response Modes Independent use of mouse, touchscreen, or a computer keyboard Verbal response Gestures Pointing independently to indicate a response Print-on-demand accommodation and indicating responses using paper AAC devices Eye gaze Other 2016–17 California Alternate Assessments Test Administration Workshop

Identifying Response Mode
ELA/Mathematics Identifying Response Mode Augmentative and/or alternative communication (AAC) devices may be used as response modes. AAC devices may require item-by-item configuration; test examiners may review the test by its stages prior to administering it to make the necessary configurations. Because the CAAs for ELA and mathematics are stage- adaptive, Stage 1 must be configured and administered before Stage 2 can be configured. 2016–17 California Alternate Assessments Test Administration Workshop

Inputting Student Responses
ELA/Mathematics Inputting Student Responses If indicated by the student’s IEP, a student may enter his or her responses by circling or marking the answers on locally printed test items for transcription by the test examiner later. This response mode requires the print-on-demand accommodation be activated. Contact your LEA CAASPP coordinator or CAASPP test site coordinator for assistance. 2016–17 California Alternate Assessments Test Administration Workshop

Inappropriate Test Administration Practices
ELA/Mathematics Inappropriate Test Administration Practices Providing responses to test questions that are not from the student Using hand-over-hand or other physical prompting by the test examiner 2016–17 California Alternate Assessments Test Administration Workshop

ELA/Mathematics Accessibility Resources Any instructional supports identified in the student’s IEP may be used during testing. There are embedded and non-embedded accessibility resources. Non-embedded calculators are allowed on all mathematics tests except for specific items on the grade three mathematics test, which will be indicated explicitly in the DFAs. Training tests will allow you and the student to preview what the supports look like and determine what the student needs. For more information regarding accessibility resources, refer to the Student Accessibility Resources and Test Settings Web page at 2016–17 California Alternate Assessments Test Administration Workshop

ELA/Mathematics Accessibility Resources Consult the Smarter Balanced Usability, Accessibility, and Accommodations Guidelines when identifying the appropriate supports for your student. Accessibility resources are configured in TOMS for each student. These can be modified in TOMS only. At least two business days before testing, check the [Test Settings] tab and the [Unlisted Resources] tab for each student profile in TOMS to ensure that this information is accurate. 2016–17 California Alternate Assessments Test Administration Workshop

ELA/Mathematics Check for Understanding Q: When administering Question 1 of the student response check, what must the student do in order to move on to Question 2? A: The student should respond to the item stem (the question) OR orient to the activity. Q: At what point(s) in the Student Response Check can the test examiner make the decision to stop testing a student? A: After Question 1, if the student does not respond to or orient to the activity OR after Question 4, if the student has not responded to Questions 2–4 and has only oriented to the activity. 2016–17 California Alternate Assessments Test Administration Workshop

Student Testing ELA/Mathematics Adaptive Route
Student Response Check Directions for Administration (printed or PDF) Adaptive Route Q1 Q2 Q3 Q4 Q5 Q6 Q7 … Q13 Stage One Logon Test examiner stop? Test examiner stop? T1 Q14 Q15 Q16 Q17 Q18 … Q28 Stage Two or T2 Q14 Q15 Q16 Q17 Q18 … Q28 or T3 Q14 Q15 Q16 Q17 Q18 … Q28 SSC S1 S2 … Sn 2016–17 California Alternate Assessments Test Administration Workshop

Student Response Check (4 items)
ELA/Mathematics Student Testing STAGE 1 STAGE 2 SSC (13 items) Tier 1 (15 items) Student Response Check (4 items) OR Tier 2 (15 items) Survey of Student Characteristics (Questions completed by test examiner) OR Tier 3 (15 items) (Some students will stop testing after Stage 1 based on their performance in Stage 1.) 84

CAAs for ELA and Mathematics Student Testing
ELA/Mathematics CAAs for ELA and Mathematics Student Testing Each student is administered a maximum of 28 items in two test stages for each content area. The system uses automatic routing rules to present the most appropriate Stage 2 for each student. Some students will stop testing after Stage 1 based on their performance in Stage 1. IMPORTANT: DFAs contain instructions for all items and possible routing outcomes. The system will prompt you to turn to the appropriate section of the DFA to administer the assigned stage. Ensure the on-screen item numbers match the item numbers in the DFA. 2016–17 California Alternate Assessments Test Administration Workshop

ELA/Mathematics Check for Understanding Q: How will you know you are on the right question for your student? A: The system will automatically route you to the next set of numbered questions; DFAs have matching question numbers that you should always check. Q: What is the maximum number of items that a student can take in a CAA? A: A student will take no more than 28 items per content area. 2016–17 California Alternate Assessments Test Administration Workshop

ELA/Mathematics Check for Understanding Q: At what point(s) does the system make a decision to route the student? A: Students are routed after Stage 1. Q: After Stage 1, what are the potential routing decisions the system may make based on the student’s performance in Stage 1? A: A student may be routed to Tier 1, 2, or 3 in Stage 2, or the student’s test may end. 2016–17 California Alternate Assessments Test Administration Workshop

Survey of Student Characteristics
ELA/Mathematics Survey of Student Characteristics Student Response Check Directions for Administration (printed or PDF) Adaptive Route Q1 Q2 Q3 Q4 Q5 Q6 Q7 … Q13 Stage One Logon Test examiner stop? Test examiner stop? T1 Q14 Q15 Q16 Q17 Q18 … Q28 Stage Two or T2 Q14 Q15 Q16 Q17 Q18 … Q28 or T3 Q14 Q15 Q16 Q17 Q18 … Q28 SSC S1 S2 … Sn 2016–17 California Alternate Assessments Test Administration Workshop

Survey of Student Characteristics
ELA/Mathematics Survey of Student Characteristics Completed by the test examiner at the end of each test On the student testing device through the secure browser Integrated with the ELA and mathematics tests as the last segment of the assessment No additional logons required Reduced number of questions per content area test from previous year New New 2016–17 California Alternate Assessments Test Administration Workshop

ELA/Mathematics Check for Understanding Q: Where is the Survey of Student Characteristics located? A: The Survey of Student Characteristics is the segment after an ELA or mathematics assessment. 2016–17 California Alternate Assessments Test Administration Workshop

Pause Rules ELA/Mathematics
The CAAs may be paused and resumed as many times as necessary to allow the student to show what he or she knows. The test examiner can make the decision to pause and resume the test administration if the student is no longer engaged, is not actively participating, or is showing signs of behavioral or functional concerns related to the test. When a test is paused, you must log the student back on to resume testing. You will be directed automatically to the first page that has an unanswered item. In the event of a technical issue (e.g., power outage or network failure), the student’s test will be paused and the student will be logged off. As a test security measure, student tests are automatically logged off after 30 minutes of test inactivity. 2016–17 California Alternate Assessments Test Administration Workshop

Stopping Rule ELA/Mathematics
Typically students take approximately 95 cumulative minutes or less to successfully complete a single content area of a CAA test. Test examiners may end a test if the student’s productivity and engagement have significantly declined, even after allowing the student breaks over multiple days. Remember that in all cases students should be given as many breaks as needed to perform well, including testing over multiple days. If the test examiner determines it is in the best interest of the student to end the test early, the test examiner will need to advance through the remaining test items until he or she reaches the end and then submit the test. 2016–17 California Alternate Assessments Test Administration Workshop

Testing System Tips ELA/Mathematics
The CAAs are designed to be administered in the language of instruction. This can include, but is not limited to, braille, American Sign Language, and other languages. It is permissible for a test examiner or scribe to preview test items to prepare translations or other materials. Refer to the CAA Web page for a short demonstration on how to set up a test session: Test examiners are required to log on for the student on the student testing device and to closely facilitate student interaction with the testing device. Some students will require test examiners to enter responses to test questions on their behalf. 2016–17 California Alternate Assessments Test Administration Workshop

Administering the CAA for Science

CAA for Science An Introduction for Test Examiners
Question Answer Who takes the CAA for Science? Students in grades five, eight, and the assigned high school grade (ten, eleven, or twelve) take the CAA for Science. How many items are on an embedded PT? One embedded PT has 3–5 items. How do the students take the test? The CAA for Science pilot is administered one-on-one by a test examiner. Test examiners may administer the exam using a PDF or printout of the embedded PT, which will be available online. The student survey will be administered online via the test delivery system. 2016–17 California Alternate Assessments Test Administration Workshop

CAA for Science An Introduction for Test Examiners
Question Answer How is the CAA for Science scored? Student responses are scored locally according to state-defined criteria and protocols. Only participation will be recorded through the student survey for the pilot test. 2016–17 California Alternate Assessments Test Administration Workshop

CAA for Science Components
CAA for Science Pilot Component Purpose Date Available Configuration Training Sample Provide students, teachers, parents and stakeholders with an opportunity to engage with items aligned to the Core Content Connectors that are bridges to the CA NGSS performance expectations January/ February 2017 Includes a sample embedded performance task (Embedded PT) Embedded Performance Task An embedded PT is a series of related test questions that are included into regular classroom instruction. The test examiner applies a rubric to score the student’s responses and then records the student’s scores. March 20, 2017 Similar to the CAA Directions for Administration Available for download in TOMS Student Survey Collect participation status for accountability purposes and information about students’ experiences with the assessment 2-3 questions Approximately 5 minutes to complete Available in the test delivery system Test Examiner Survey Collect feedback on the pilot administration and assessment 10–12 questions Approximately 15 minutes to complete Available via an online survey platform 2016–17 CAASPP Pretest Administration Workshop

CAA for Science How Testing Works
The CAA for Science pilot test consists of an embedded PT and a student survey. The embedded PT will be located outside of the test delivery system and will be available for download in TOMS. The embedded PT should be reviewed thoroughly before testing day. The student survey will be located inside the test delivery system. (A transcript of survey questions is included with the Embedded PT as well). Participation for accountability is based on the student survey. 2016–17 California Alternate Assessments Test Administration Workshop

CAA for Science Embedded PT
The embedded PT will be available for download from TOMS. The directions for administration will be a preface to this document. The embedded PT is administered to students either by displaying the PDF via a computer or by printing out a hard copy to use with hands-on materials. These tasks are administered by a test examiner who is familiar with the student. Student responses are scored by the test examiner according to state-defined criteria and protocols and should be retained either as an electronic or hard copy. Embedded PT responses will be kept at a district level for one year. 2016–17 California Alternate Assessments Test Administration Workshop

CAA for Science Student Survey
The CAA for Science student survey is located inside of the test delivery system. Unlike the CAAs for ELA and mathematics, the student survey is a stand-alone survey and is not embedded as a segment within an online test. Test examiners will read the survey to the students and record student responses within the test delivery system. Survey questions are also in the Embedded PT PDF Be sure to ask students the survey questions immediately after giving the Embedded PT, even if you enter in test delivery system at a later time. The questions within the survey will pertain to the student’s experience with the assessment. 2016–17 California Alternate Assessments Test Administration Workshop

CAA for Science Student Survey
Use the same test delivery system as the Smarter Balanced tests Two Internet-connected devices are needed to enter the student survey responses: One device for the test examiner to manage testing One device (with a CAASPP secure browser installed) for administering the test to the student You will use specific logon information on each device: Test examiner device: TOMS credentials for Test Administrator Interface Student testing device: Student’s SSID, first name, and test session ID 2016–17 California Alternate Assessments Test Administration Workshop

How the CAA for Science Student Survey Works
INTERNET STUDENT TESTING DEVICE TEST EXAMINER DEVICE CAASPP secure browser (Student Testing Interface) Both the test examiner and student interact with this device Use a device the student is familiar with Log on with student’s information For CAA for Science, complete the student survey Ensure that the student’s augmentative or alternative communication is programmed Test Administrator Interface Any device (tablets recommended) Log on with TOMS username and password Start test sessions by generating a Session ID Verify student SSID 2016–17 California Alternate Assessments Test Administration Workshop

Science Check for Understanding Q: What do I need in order to administer the CAA for science? A: An embedded performance task is needed to administer the CAA for science. This embedded PT is available as a PDF in TOMS. A student testing device and a test examiner device are needed to administer the CAA for science student survey. 2016–17 California Alternate Assessments Test Administration Workshop

Science Check for Understanding Q: What should test examiners do with the embedded PT after testing is complete? A: Test examiners must securely store student responses to the embedded PT as printed copies. The blank embedded PTs should not be stored. PDF files must be permanently deleted from all devices, and any printed copies must be shredded or otherwise securely destroyed. 2016–17 California Alternate Assessments Test Administration Workshop

Science Check for Understanding Q: How will participation for accountability be collected for the CAA for Science? A: Participation for accountability is collected through the student survey. Q: When should the student survey be administered? A: Immediately after administering the Embedded PT to the student. This can be done “offline” using the survey transcript in the Embedded PT document, or directly into the test delivery system. 2016–17 California Alternate Assessments Test Administration Workshop

Test Security

General Test Security Protocol
Follow the same security guidelines as for other CAASPP assessments. Information about items, including DFA and embedded PT content, should not be shared with anyone not directly responsible for test administration. DFAs, blank embedded PTs, and print-on-demand materials must be securely handled during the test administration and securely destroyed afterward. Embedded PT student responses must be securely stored at a district-level for one year 2016–17 California Alternate Assessments Test Administration Workshop

Security and Test Administration Incident Reporting System (STAIRS)
LEA CAASPP coordinators and CAASPP test site coordinators are responsible for reporting all test security incidents in the CAASPP STAIRS form available at An containing a case number and the next steps to be taken will be sent to the reporting party. In some cases, the will provide instructions to file a specific appeal in TOMS. Appeals cannot be filed in TOMS without first reporting the incident in STAIRS. Ensure that the address is whitelisted. 2016–17 California Alternate Assessments Test Administration Workshop

After Testing CAASPP test site coordinators must ensure that all DFAs and blank embedded PTs are collected and securely destroyed. Shred or otherwise destroy printed copies. Permanently delete electronic PDF copies from all devices. As necessary, LEA CAASPP coordinators and test site coordinators enter the NTE (Not tested due to medical emergency) condition code for students in TOMS. PGE (Parent/Guardian exemption) condition codes should have been entered in TOMS before student testing. Score results will still be reported for any tests completed before the PGE condition code was entered in TOMS. For more information regarding condition codes, please visit this Web page: 2016–17 California Alternate Assessments Test Administration Workshop

Resources Online Test Administration Manual for CAASPP Testing
Training Test DFA To be paired with training tests Practice Test DFA To be paired with practice tests, when available Version-specific, grade-level DFAs (SECURE) CAA Test Examiner Tutorial CAA for Science Training Sample CAA for Science Embedded PTs (SECURE) 2016–17 California Alternate Assessments Test Administration Workshop

Resources All CAA materials and resources (except the secure operational DFAs and embedded PTs) will be available on the CAASPP CAA Web page at html. Training tests are the best way to gain familiarity with the testing system and interactions. Practice tests are available for students and test examiners to experience the available grade-specific items and item types. 2016–17 California Alternate Assessments Test Administration Workshop

Timeline for CAA Resources
Description Availability This workshop presentation (or recorded Webcast) Use/Repurpose these slides for local training purposes Now Online Test Administration Manual Comprehensive test administration manual for all CAASPP assessments, including the CAAs December CAA Training Tests for ELA/Mathematics Use to familiarize test examiners and students with testing interface, item types, and accessibility resources Now and updated in January CAA Test Examiner Tutorial Online training module specifically for test examiners. Includes training on ELA, mathematics and science. January CAA Training Test DFA for ELA/Mathematics Accompanies the training test with scripts and guidelines; familiarizes test examiners with the format of the operational DFAs. CAA Practice Test Use to familiarize test examiners and students with grade-level CAA test questions CAA Practice Test DFA Accompanies the practice test with scripts and guidelines; familiarizes test examiners with the format of the operational DFAs CAA for Science Training Sample (includes DFA) Use to familiarize test examiners and students with testing interface, item types, and accessibility resources. The sample will include a DFA. Late January/ early February

Help Desk Support The California Technical Assistance Center (CalTAC) is here to support all LEA CAASPP coordinators! Monday–Friday from 7 a.m.–5 p.m. Pacific time Phone: Web site: 2016–17 California Alternate Assessments Test Administration Workshop

2016–17 California Alternate Assessments Test Administration Workshop

Similar presentations

Presentation on theme: "2016–17 California Alternate Assessments Test Administration Workshop"— Presentation transcript:

Similar presentations

About project

Feedback

Log in

Auth with social network:

2016–17 California Alternate Assessments Test Administration Workshop

Similar presentations

Presentation on theme: "2016–17 California Alternate Assessments Test Administration Workshop"— Presentation transcript:

Similar presentations

About project

Feedback