Presentation on theme: "NCSC Test Administration Training National Center and State Collaborative March, 2014 Test Window: March 30 – May 15, 2015."— Presentation transcript:
NCSC Test Administration Training National Center and State Collaborative March, 2014 Test Window: March 30 – May 15, 2015
Contents Overview of NCSC Overview of test structure Supports, Assessment Features, Accommodations Students who are Blind, Deaf, or Deaf/Blind Online demonstration Test Administrator and Test Coordinator Responsibilities Administering the test Taking the final quiz
NCSC Member States
NCSC Overview Test WindowMarch 30 – May 15, 2015 Test Type:Adaptive Grade Levels:3-8 and 11 Content Areas:ELA (incl. Writing), Math Timing:Month-long in Spring Standards:CCSS: discrete grade levels Eligibility:Remains the same Teacher time:Lighter: some preparation for accommodations and materials for each item. Scoring:Teacher scores some constructed response items for Math. Results:Standardized content with adaptations and accommodations (valid group comparisons will be easier) Format:Computer and Paper
Tested Grade Levels for Alternate Assessment Grade RIAA SCIYes NCSC ELA and Math Yes NOTES: Students only take the tests in their designated grade level. Students do not “make up” tests from previous grades that were missed. Students who qualify for alternate assessment late only take NCSC and do not have to take PARCC.
Change in Standards for All Tests NECAP in Reading and Mathematics RIAA in Reading, Writing, and Mathematics PARCC in ELA and Mathematics NCSC in ELA and Mathematics Grade Level Expectations: Reading, Writing, Mathematics Alternate Assessment Grade Span Expectations: Reading, Writing, Mathematics THEN NOW Common Core State Standards English Language Arts (includes Writing), and Mathematics Common Core State Standards English Language Arts (includes Writing), and Mathematics Common Core State Standards English Language Arts (includes Writing), and Mathematics Common Core State Standards English Language Arts (includes Writing), and Mathematics Core Content Connectors
Supports Embedded in the NCSC Alternate Assessment Item Supports Assessment Features Consider all three aspects when deciding how to support students. ACCOMMODATIONS
Items include supports and grade-level content Tier 4. Measures full CCC with fewest supports Tier 3. Measures more of the CCC with more supports than Tier 4 Tier 2. Measures Essential Understanding with fewer supports than Tier 1. Tier 1. Measures Essential Understanding of CCC with greatest amount of supports. Each standard assessed tests grade-level concepts and content regardless of item level. Tier Supports: scripted items modified/shortened texts graphics in text and items read-aloud graphic organizers partially completed Two or three item options (all with graphics) small integer values modeling Tier Supports: scripted items modified/shortened texts graphics in text and items read-aloud graphic organizers partially completed Two or three item options (all with graphics) small integer values modeling Tier Supports: scripted items simplified language passages slightly longer graphics in text and items read-aloud graphic organizers partially completed equations provided small integer values modeling Tier Supports: scripted items simplified language passages slightly longer graphics in text and items read-aloud graphic organizers partially completed equations provided small integer values modeling Tier Supports: scripted items simplified language but longer passage length, equations provided some graphics read-aloud graphic organizers not completed modeling Tier Supports: scripted items simplified language but longer passage length, equations provided some graphics read-aloud graphic organizers not completed modeling Tier Supports Scripted items graphic organizers not completed some graphics read-aloud modeling Tier Supports Scripted items graphic organizers not completed some graphics read-aloud modeling
Sessions 1 and 2 Design Tier 4 Tier 3 Tier 2 Example of session 1 Tier 3 Tier 2 Tier 1 Example of session 2 Tier 1
Item Types Selected Response (SR) All content areas aka: multiple choice Constructed Response (CR) Math only Open Response (OR) Writing only
Instructional Resources NCSC Wiki for Instructional Resources https://wiki.ncscpartners.org/index.php/Main_Page RIDE: Common Core Connectors: Click on “NCSC” tab CCSS: Click on “Educators” tab Academic Vocabulary Module Text Dependent Questions Module Close Reading Module for teachers of students with disabilities.
Assessment Features and Accommodations
Assessment Features (always available) COMPUTERPAPER (Teacher-provided) Answer MaskingTwo pieces of paper on either side of the line the student needs to focus on Alternate Color ThemesColor overlays Increase Size of Text and Graphics (Magnification) Adjust size before printing Increase VolumeSeparate testing space/auditory AT Line Reader ToolTwo pieces of paper on either side of the line the student needs to focus on Audio Player (Text-to-Speech)Read Aloud/Re-read
Finding the Assessment Features
Answer Masking The teacher or student can hide or unhide each item option.
Audio Player or Read Aloud (computer)
Read Aloud (teacher) The teacher can read the test either from the paper copy or on the computer. Can read the directions, answer options, or passage as often as is reasonable. All text must be read exactly as written (i.e. no paraphrasing or emphasis of words in ways that provide hints to correct or incorrect answers).
Alternate Color Themes
Alternate Color Themes (color contrast)
Line Reader Tool
Accommodations Accommodations are changes in the materials or procedures of the assessment that do not alter what is being measured. NOTE: Accommodations must be included in the students’ IEP. It’s highly encouraged that assessment features also be included in the student’s IEP but is not required.
Accommodations Assistive Technology* Scribe Sign Language Translation Braille (grades 3 & 4 only) Students who are deaf/blind: Special set of directions and test items that includes tactile graphics, and object replacement options. Students must meet the criteria of being deaf and/or blind in order to receive these test items. *TIP: Test with sample items to ensure proper functioning with the online test platform.
Which AT is compatible? Text-to-Speech Already supported by the system as an assessment feature. Alternate Keyboards BigKeys, IntelliKeys USB board Switch-based navigation and answer selection Switch Interface Pro 6 USB CrossScanner ScanBuddy (mouse won’t work) Eye Gaze Some eye gaze software has been test. See the User Guide for a list of software.
Paper Versions You may print a copy of an item or items by selecting “open test in PDF” from the Actions button. Large print forms are not available because magnification, projection systems, and increasing the size of the font are all available.
Scribing Protocol Qualifications: Familiar to the student Familiar with accommodations and test features Sign test security agreements Preparation: Practice with sample items Practice protocol during regular instruction
Scribing Protocol 1. Introduce and explain the process to the student if necessary. 2. Write either on paper or into the NCSC Assessment System exactly what the student communicates. 3. Correctly spell all words; spelling isn’t scored. 4. Allow student to review/edit, etc. (follow the DTA). 5. Do not capitalize words or punctuate text unless directed by the student. 6. Confirm meaning of homonyms and homophones, e.g., than and then; to, two, and too; there, their, and they're. 7. Make any student-requested changes, even if incorrect. 8. Follow transcribing protocol (step 5 in manual) 9. SHRED all materials after testing.
Blind, Deaf or Deaf/Blind Students Nonverbal Students
Special Test Form Additional directions include: guidelines for administering items (use along with the DTA) suggestions for developing tactile symbols, using object replacements, and sign language interpretation. Alternative text to be read aloud. Example: if an item includes a bar chart, a detailed verbal description of the chart is embedded into the item. Braille items foundational items in reading (word identification) grade 3 and 4 tests only shipped directly to the district office.
HTTPS://TEACHER-NCSCPARTNERS.CTB.COM Navigating the NCSC Administration System View sample test items View Test Features View Item Tool Bar
ONLINE MODULES 1 AND 5/ PART 2 OF THE TEST ADMINISTRATOR MANUAL Qualifications of Test Administrators
Test Coordinators must... Table 4 in Test Administration Manual sign test security form. complete training. ensure teachers receive training and pass final quiz. ensure technology requirements are met. help teachers create testing schedules. Ensure that teachers have access to a secure and consistent testing area that includes access to proper materials. report test irregularities to RIDE and conduct investigation. ensure ALL materials are shredded after testing.
Who can be a Test Administrator? (page 11) Rhode Island Policy: Aides, paraprofessionals may assist with administering the test IF 1) they are certified and employed by the district, 2) they receive training,and 3) the TA or TC is present as the test is administered.
Test Administrators must… sign test security form. complete training and pass final quiz. read all test-related documents prior to testing. determine test features and accommodations student will need. review sample items with student before the test. verify student information in the test portal complete accommodations tab. develop a schedule find a secure, consistent location for testing. administer the student response check if necessary. administer the test as presented in the DTA. keep the test secure complete all post-test surveys. shred all documents after testing.
Creating Optimal Testing Conditions and Maintaining Test Security
How is a secure testing environment prepared? Optimal Testing Conditions Remove distractions as much as possible. Use the same computer for each testing time. Restrict access to resources that are identified in the DTA. Only people who have received training on the NCSC test can administer it.
What is secure handling of testing materials? Keep all test materials in a secure and locked location. Log out of the NCSC Online Assessment System after each testing session and close the browser. Protect materials from view by other students, teachers, parents, school staff or other individuals. DO NOT duplicate, reproduce, or share materials. Test Coordinators must SHRED all materials after testing. DO NOT KEEP. Delete any materials that are on computers and AT devices.
Examples of Testing Irregularities? Changing the wording of test directions, items/questions, response options, or any text as it is written in the DTA. Using non-prescribed manipulatives or replacement objects, graphic organizers, or mnemonic aids. Using any physical prompting, including hand-over-hand. Providing students a preview of the test at any time. Providing answers to students in advance of or during test administration. Providing students clues or supports not indicated in the DTA. Manipulation of testing materials in a way that hints at a correct or incorrect answer. Changing a student’s answer. Reminding the student of previously used materials or experiences directly related to concepts in an item.
Examples of testing irregularities continued… Pre-teaching test content immediately before test administration. Sharing test items or test content, in any way, with colleagues, parents, other staff members, the general public, the media, or students. Leaving test materials unattended. Leaving the NCSC Assessment System unattended while logged in. Administration of the test by someone who has not completed the training or passed the final quiz.
How are testing irregularities reported? TCs and TAs must: monitor test administration and report test irregularities in accordance with state law and policy. Steps for Reporting: 1. Notify school principal/ test coordinator 2. School test coordinator notifies district test coordinator/superintendent 3. District contacts the state (Phyllis Lynch or Heather Heineke)
Security Agreement (page 28) Anyone who administers the test or who assists with administration must sign the test security agreement. Take a moment to read the Security Agreement in the back of your manual. All material from NCSC must be kept secure. All student work, DTAs, items, word boards, etc., must be shredded after testing and deleted from the computer. To not do this is a violation of test security and test administration procedures.
Teachers who do not have students who are testing CAN view the online modules with a teacher or administrator who will be involved in administration. CAN have someone download the sample items from the NCSC Assessment System (sample items are not secure) CANNOT have a NCSC Assessment System login. CANNOT be present during the administration of the NCSC in order to “see what it’s like” or to observe. CANNOT be in possession, at any time, in way, of any secure test materials. CANNOT attend in-person training.
Administering the Test
First Decision to Make: 1. How will your student take the test? Independently online Paper-and-pencil Hybrid – some online, some paper-pencil The answer to this question will determine accommodations, test features, and the online procedures you use to administer the test.
Second Decision To Make: 2. Which accommodations and test features will be used? Mirror, to the extent possible, instructional environment Familiarity What is engaging?
Basic Steps for Test Administration 1. Determine consistent, secure location 2. Determine schedule for practice and for testing 3. Determine test features and accommodations 4. Activate account (hopefully already done) 5. Download and print the following: User guide Sample test items Directions for Test Administration (DTA) 6. Practice test features, accommodations, and with any AT device. 7. Log on to test platform, answer LCI questions, select accommodations 8. Conduct Student Response Check (some students) 9. Begin Test… 10. After testing, complete the surveys 11. SHRED EVERYTHING
AAC Guidelines RI Manual, Appendix C DO:DO NOT: Ensure all AT works with the online system. Wait until the day of testing to try out AT Introduce vocabulary you find as you review the DTA Teach prompts or test items prior to testing at any time. Add vocabulary to AT device Change any pictures or graphics in items or passages Create word boards that represent groups (people, nouns, topics [flying, transportation, pets, etc.]) Create word boards that contain every word they need to create a sentence or answer Follow the DTA directions for the items Create word boards with selections where no answer is incorrect.
FOR STUDENTS WHO DO NOT HAVE A CONSISTENT MODE OF COMMUNICATION Student Response Check
The Purpose: Communication Can a student clearly identify which answer they want? If YES, (student responds verbally or by using assistive technology (AT), etc.), you do not need to do this. If NO, then conduct a Student Response Check. The MODE of communication is not important; only the intent of the student.
Ways students can communicate their answers Students can communicate answers by: Using the mouse to select an answer Verbalizing answers Gesturing or pointing to the answer Using assistive technology to indicate answers* Using eye gaze chart to select answers Circling or marking answers on a paper copy of the test Note: The use of hand-over-hand or any physical prompt that directs a student toward an answer is not considered a consistent and observable response because the student is not indicating his/her answer choice in an independent way.
What to do with the results of the SRC: If YES, proceed with test administration. If NO, administer the first four test items of either ELA or Math and based on those results, do one of the following: 1. If the student responds to at least one of the first four test items, continue to administer all test items to the student. 2. If the student DOES NOT respond, close the test, select “Early Stopping Rule”, and complete the End of Test Survey. 3. Closing a test is irreversible and cannot be undone. This isn’t about the right answer; only a response. DO NOT terminate the test if the student selects the incorrect answer. Demonstration: Student Response Check
Access Student Response Check Find Student and click on Student ID number
Conduct Student Response Check – Computer 1. Read text aloud to students 2. Click Next
Conduct Student Response Check – Computer 1. Point to specified option 3. Click Next 2. Ask student to point to specified option
Enter SRC Information 1. Complete form
Student Response Check Paper Versions Conduct the SRC paper version for students who communicate with: Pointing Gestures Eye-gaze Other modes that make using a computer difficult Steps: 1. Download and print both pages of the SRC 2. Follow the directions that can be downloaded from the NCSC Assessment System.
Enter SRC Information 1. Answer additional question 2. Click Save
1. TIME TO PREPARE 2. TIME TO ADMINISTER THE TEST Timing and Scheduling
ELA Test Sessions NCSC ELA Sessions Reading Session 1Reading Session 2Writing Literary and informational reading passages and associated Selected- Response Reading items Open-Response Foundational Reading items (Grades 3 and 4 only) Literary and informational reading passages and associated Selected- Response Reading items Open-Response Foundational Reading items (Grades 3 and 4 only) Selected-Response Writing items and one Constructed-Response Writing item
Preparing for the Test 1. Training (Test coordinators and teachers pick ONE): Online training modules In-person training 2. Reading materials: Test Administration Manual Directions for Test Administration Sample items 3. Preparing test: Manipulatives Practice scribing protocol, answering items Creating word boards, eye gaze boards, loading pictures into AT devices, etc. 4. Substitutes: Are they needed? Teachers who participated in the pilot tests found subs helpful for preparation; only some found it helpful for administering the test; dependent on the needs and requirements of the students.
Timing and Scheduling Suggestions Base test times (both sessions): Approximately 90 minutes for ELA Approximately 90 minutes for Math 1. Student uses computer or paper copy fairly independently: 2. Student requires support to use computer; frequent breaks; 3. Student requires eye gaze board, braille, help using AT, frequent breaks;
RI Teacher Data: Mathematics How long did it take the student to complete the entire mathematics test (do not include time for pausing, only engagement with the test)? FrequencyPercentValid Percent Cumulative Percent Time to Complete30 Minutes or Less Minutes Minutes Minutes More than 120 Minutes Total MissingSystem 11.8 Total
RI Teacher Data: Reading How long did it take the student to complete the entire reading test (do not include time for pausing, only engagement with the test)? FrequencyPercentValid Percent Cumulative Percent Time to Complete30 minutes or less minutes minutes minutes More than 120 minutes Total
Upload Evidence (Module 12) Writing Test Only
Submitting Student Work: Only for students who created a paper writing product. Two ways to capture student evidence 1. Computer Webcam 2. Scanner Must upload evidence while test is open and item is still on the screen. Webcam: Do not take pictures of people, only the writing product.
Upload Evidence STEP 1: Click the Upload Button
STEP 4: Write a short description that includes the page number and the total number of pages in the student’s response (page 2 of 3). You can include the name of the student, state, and school name if you choose. STEP 5: Click Retake OR Attach Image
Upload Evidence - Webcam Successful upload To upload another file, click here.
Upload Evidence Option B: Scanner Use a scanner to capture evidence Accepted file formats .png .jpg or.jpeg PDF files must be resaved in in a.png,.jpg, or.jpeg file formats or it will not upload correctly. If the student can enter a response on their own, or a scribe enters a response for the student, you do no need to upload anything for the student.
Upload Evidence Option B: Scanner 3. Click Attach File 1. Enter a description 2. Click Browse
Upload Evidence Option B: Scanner Find your file and click open If your file is in PDF, you must resave it in.png,.jpg, or a.jpeg format.
Upload Evidence – File Attachment Confirmation of successful upload
1. REASONS FOR CLOSING THE TEST 2. EARLY STOPPING RULE 3. SAVING AND ENDING THE TEST How to Safely End the Test
Closing the Test A test cannot be closed because: The student is upset. The student keeps selecting the wrong answers The student isn’t engaged. If you need to pause the test and come back at a later time, do so. If a student test is closed due to no response on the SRG, that test will not be scored. Reports of closing due to no response on the SRG will be given to states and there will be a note on score reports to parents regarding their student’s communication.
Closing the NCSC Test (module 13) Closing a test is irreversible; it CANNOT be undone. A test can be closed ONLY if one of these three criteria are met: 1. No observable response during the Student Response Check AND no observable response to any of the first four items in either reading or math session 1. “Early Stopping Rule” from drop down list 2. Student withdrew/is no longer enrolled 3. Student is no longer eligible (does not meet the participation criteria)
What is displayed when Save & Exit is selected from the End of Session landing page? Confirmation message Click OK Screens shots are for illustrative purposes and may not be an exact representation. Pause this test and resume later (or Save & Exit)
How are tests resumed? 1. Click Actions and Resume 2. Click Begin Test Now
What happens when the end of the test is reached? Click Complete this session and continue (or Next)
Submitting the Test Click Submit
What happens when you click on Next at the end of a test? Click OK
Complete the Accommodations tab Complete the End-of-Test Surveys Report any testing irregularities Shred ALL printed materials. If no test coordinator, give to your principal for shredding. Delete ALL downloaded materials on your computer.
Complete End-of-Test (EOT) Surveys The survey provides NCSC additional data about: How the test functions for students with unique and varying needs Student engagement Information for potential revisions/refinements
End-of-Test Survey Screen Shots From “Action” button, select Go to Survey (this will give you the student test ID)
End-of-Test Survey Screen Shots Go to ELA- writing Survey Surveys
End-of-Test Survey Steps STEP 1: Click on the name of the test to complete that survey. Mathematics ELA Writing STEP 2: Once the survey opens, enter the appropriate Student-Test ID number STEP 3: Complete the survey for each test and for each student.
Timeline Wednesday (3/18) Answer LCI questions Complete accommodations tab Conduct the student response check (if necessary) Practice sample test items with students Monday, March 23, test forms will be assigned to students. Download DTAs Download Test Begin preparations Monday, March 30, test window opens (don’t have to begin on this day).
Taking the Final Quiz All test administrators must get 80% or more on the final quiz before they can access the DTAs or the test for their students. Test Coordinators do not have to take the quiz