T EST A DMINISTRATOR T RAINING (R EQUIRED FOR DTC S, STC S, AND TA S )

 Understand the roles and responsibilities of test administrators  Understand how to use valid test administration practices  Be aware of what’s new this year in the statewide assessment system  Learn where to find test administration resources and tools Big Picture Objectives T EST A DMINISTRATORS

Training will cover the following topics :  Test Administrator Training  Accessibility Supports  Test Security  Smarter Balanced Administration*  OAKS Online Science and Social Sciences Administration*  ELPA Administration* *Only required for TAs administering this assessment Training Overview T EST A DMINISTRATORS

 Before testing:  Provide students with an opportunity to become familiar with the test format and procedures  Review student IEPs or education plans to identify appropriate test formats and accessibility supports  Make arrangements for students who are not testing  Review Test Administration Manual (TAM), Oregon Accessibility Manual (OAM), and training notes  During testing:  Ensure that students receive the appropriate test (includes settings such as language and print size)  Enforce test environment requirements TA Roles and Responsibilities T EST A DMINISTRATORS

 Supervision at all times by a trained TA  Quiet environment void of distractions  Only accessibility supports listed in OAM made available to students  Limited interaction with students  Read student directions  Administer accessibility supports appropriately  No coaching Test Environment Requirements T EST A DMINISTRATORS

OAKS System Components Test Information Distribution Engine (TIDE) Student demographic information collected Student test settings entered Test Delivery System (TDS): TA Interface Test sessions created Students approved to test _______________ Test Delivery System (TDS): Student Interface Students log into tests Students take tests Online Reporting System (ORS) Test results reported Item Tracking System (ITS) Test questions created reviewed, and edited Questions assembled into tests T EST A DMINISTRATORS

TA Interface  Administer online tests, track progress, and manage students testing in your session  Adjust test settings for individual students before they are approved to start the test  Approve and submit print requests from students Student Interface  Secure online test that must be accessed via a secure browser  General Education Student Interface  Braille Interface Overview of Test Delivery System T EST A DMINISTRATORS

New in the OAKS Portal  New OAKS Portal URL: oaksportal.org  New look and feel:  Organization remains the same  Register to receive alerts when announcements or resources are posted on the portal T EST A DMINISTRATORS

 New Organization of Resources & Resources Search Feature: New in the OAKS Portal (cont’d) T EST A DMINISTRATORS

New in the TA Interface  Session IDs: New three-part naming convention (not based on TA’s name)  Easier to get back into sessions that were unintentionally closed or paused. Buttons added to message TA sees if the TA tries to start a new session and already has an active session:  Rejoin session  Close session T EST A DMINISTRATORS

 Used to create and manage test sessions and approve students  All information is visible on one screen  Tests in session  Students needing approval to start testing  Students with tests in progress  Print requests TA Interface at A Glance T EST A DMINISTRATORS

Create and Manage Test Sessions  List of available tests automatically displays upon logging in and remains on screen while monitoring students  Select the tests for inclusion in the session and click [Start Session]  System generates a Session ID that students will use to log in  Test sessions automatically expire upon TA logout  Sessions cannot be resumed  Students may resume a paused test in any new test session that includes the applicable test subject and grade  Example: TA creates a test session for students on Tuesday. To resume testing on Wednesday, the TA will create another test session for students to resume testing TA Interface (cont’d) T EST A DMINISTRATORS

 Approvals Preview (right) allows TAs to see students that need to be approved while monitoring test progress  The complete list of students awaiting approval will display on a pop-up screen TA Interface (cont’d) Student Test Settings and Approvals T EST A DMINISTRATORS

TA Interface (cont’d) Student Test Settings and Approvals (cont’d) T EST A DMINISTRATORS

Student Login 1.Log in using First Name, SSID, Session ID 2.Confirm identity – “Is This You?” screen – First Name (same as in SSID upload), Enrolled Grade, DOB, School, SSID 3.Select Test – Student will see available tests by subject 4.TA Approval required to start test 5.Confirm test -- “Is this your test?” screen 1 Student Log-in T EST A DMINISTRATORS

 TAs must read the Test Administration Manual and the Oregon Accessibility Manual, receive annual test administration and security training, and sign an Assurance of Test Security form before administering state tests.  If you’re administering Smarter Balanced or OAKS Online Science and Social Sciences through the Braille Interface, you must also receive ODE- provided Braille Interface training  If you’re administering the Extended Assessment, you must also receive ODE-provided Qualified Trainer or Qualified Assessor training Do’s… T EST A DMINISTRATORS

Do’s (cont’d)…  Use the practice tests to familiarize students with the student interface, item types, and available accessibility supports.  Read verbatim the student directions provided in the Test Administration Manual.  Provide students with only those accessibility supports listed by content area in the Oregon Accessibility Manual that are appropriate for the individual student. T EST A DMINISTRATORS

 Do not allow untrained aides, interpreters, volunteers, or substitutes to assist with test administration.  Do not coach students (including requiring students to show their work).  Do not allow students to access resources such as textbooks, class notes, or cell phones during testing.  Do not allow students to talk to or help other students during testing. …and Don’ts T EST A DMINISTRATORS

 TA reviews the TAM and OAM before testing, focusing on test security and content-specific accessibility options.  TA seeks clarification from STC on any rules that are unclear before administering tests  TA spaces students appropriately or provides visual barriers to prevent students from seeing others’ tests.  TA reads student directions verbatim and circulates through test environment to ensure proper testing conditions. Promising Practices T EST A DMINISTRATORS

 Test Administration Manual  Oregon Accessibility Manual  Best Practices Guide  Promising Testing Practices Test Administration Resources T EST A DMINISTRATORS

 TAs must receive training each year  Special training requirements for Braille Interface, Extended, and Kindergarten Assessments  TAs enforce valid test environment for students  When in doubt about a particular testing practice, before testing begins:  Check the TAM and the OAM  Check your training notes  Ask your School Test Coordinator  If all else fails, assume the answer is “no” In a Nutshell T EST A DMINISTRATORS

S TATEWIDE A SSESSMENT A CCESSIBILITY S UPPORTS (R EQUIRED FOR DTC S, STC S, AND TA S )

 Identify and understand the purpose of the statewide assessment accessibility supports  Administer the statewide assessment accessibility supports appropriately A CCESSIBILITY O PTIONS Big Picture Objectives

Accessibility Supports…  Are intended to reduce or even eliminate the effects of a student’s learning challenges during instruction and on the results of assessments.  Do not compromise the learning expectations, construct, grade-level standard, and/or measured outcome of the assessment.  Are the only supports allowed during testing. A CCESSIBILITY O PTIONS Purpose

 Know the differences between the following statewide assessment accessibility supports:  Universal Tools  Designated Supports  Accommodations A CCESSIBILITY O PTIONS Know the Options

Universal Tool  Access features of the assessment that are either provided as digitally delivered components of the test administration system or separate from it. Universal tools are available to all students based on student preference and selection. Designated Support  Access features of the assessment available for use by any student for whom the need has been indicated by an educator (or team of educators working with the parent/guardian and student). They are either provided as digitally delivered components of the test administration system or separate from it.  Embedded designated supports must be assigned to the student in the Test Information Distribution Engine (TIDE) or from the TA Interface prior to test administration Accommodation*  Changes in procedures or materials that increase equitable access during the statewide assessments. Assessment accommodations generate valid assessment results for students who need them; they allow these students to show what they know and can do. *Note: Unlike the accommodations policy in place for prior Oregon Statewide Assessments, which made accommodations available for all students, beginning in statewide assessment accommodations are available only for students with documented Individualized Education Programs (IEPs) or Section 504 Plans. Many of the supports previously referred to as “accommodations” are now considered “designated supports” and so remain available to all students based on individual need. A CCESSIBILITY O PTIONS Definitions

 Contrary to statewide accessibility supports, any practice or procedure that compromises the intent of the assessment through a change in the learning expectations, construct, or content that is to be measured, grade-level standard, or measured outcome of the assessment and is not listed in Oregon’s Accessibility Manual (OAM) is considered a modification.  Assessments taken under any modified condition are counted as non-participants in all state and federal accountability measures and reports. A CCESSIBILITY O PTIONS Modification

 STEP 1 – Expect all students to achieve proficiency in the grade-level academic content standards  STEP 2 – Learn about statewide assessment accessibility supports (cf. Resources slide) A CCESSIBILITY O PTIONS Five-Step Process

 STEP 3* – Select statewide assessment accessibility supports for individual students (e.g. Individual Student Assessment Accessibility Profile (ISAAP) tool p-content/uploads/2014/08/ISAAP-Tool.xlsm) p-content/uploads/2014/08/ISAAP-Tool.xlsm A CCESSIBILITY O PTIONS Five-Step Process

 Students on IEPs or 504 Plans must have needed accommodations documented within their plans (cf. min/alt/ea/accommodations-statement-ieps.pdf ). IEP teams are encouraged to include any/all other statewide assessment accessibility supports in a student’s IEP or 504 plan. min/alt/ea/accommodations-statement-ieps.pdf  Students who are English Learners or General Education and not on an IEP or 504 Plan should have needed statewide assessment accessibility supports documented within their cumulative file. A CCESSIBILITY O PTIONS *Documentation

 STEP 4 – Administer statewide assessment accessibility supports during instruction and assessment  STEP 5 – Evaluate and improve use of statewide assessment accessibility supports A CCESSIBILITY O PTIONS Five Step Process

Oregon’s Statewide Assessment Accessibility Supports

OREGON ACCESSIBILITY MANUAL

Significant Shifts (per OAKS-Smarter Crosswalk) Working with Accessibility Supports A CCESSIBILITY O PTIONS SupportComment Alternate response optionSmarter AT device certification process ASLASL only Calculator, hand-heldAccommodation Calculator, onlineRestricted access Formula and conversion sheets (ODE-provided)Non-allowable List of common transitions/transitional phrasesNon-allowable ManipulativesNon-allowable Print on demandAccommodation Read-aloud Designated Support (items); Accommodation (passages) Text-to-Speech Designated Support (items); Accommodation (passages) Translations (stacked)Non-allowable (ELA-Writing)

TIDE Settings A CCESSIBILITY O PTIONS

TIDE Settings (cont’d) A CCESSIBILITY O PTIONS

TIDE Settings (cont’d) A CCESSIBILITY O PTIONS

TIDE Settings (cont’d) A CCESSIBILITY O PTIONS

ASL Video S MARTER B ALANCED

Calculators (Scientific, Graphing, & Regression) S MARTER B ALANCED

Color Overlay S MARTER B ALANCED

Dictionary S MARTER B ALANCED

Expanding Passages S MARTER B ALANCED

Expanding Passages (cont’d) S MARTER B ALANCED

Glossary S MARTER B ALANCED

Masking S MARTER B ALANCED

Streamlined Mode S MARTER B ALANCED

Stacked Spanish/English Translations S MARTER B ALANCED

Click to adjust the volume S MARTER B ALANCED Volume Control Click to adjust the volume Click to adjust the volume.

Zoom Levels A CCESSIBILITY O PTIONS

OREGON ACCESSIBILITY SUPPORTS UPDATES  The Interim Oregon Accessibility Manual (OAM) is posted (cf Online Resources slide for link).  The final draft of OAM will be released following review by Oregon’s Accessibility Panel in October.  Accessibility supports may change in the future if additional tools, supports, or accommodations are identified for the assessment based on state experience and research findings. A CCESSIBILITY O PTIONS

 Refer to the Oregon Accessibility Manual for implementation guidance.  Refer to student’s IEP, 504 Plan or cumulative file to determine which accessibility supports must be provided. A CCESSIBILITY O PTIONS Do’s…

 Indicate “as needed” or “as appropriate” when documenting accessibility supports  Choose every accessibility support available for an assessment “just to be safe”  Assume the same accessibility supports remain appropriate year-after-year  Provide an accessibility support for the first time on the day of testing  Provide the same accessibility supports for every student in the class, grade, or program A CCESSIBILITY O PTIONS … and Don’ts

 TAs may not provide instruction or give suggestions regarding process.  TAs may not choose to administer an accessibility supports for all students in a class or a grade.  If you can’t find it in the TAM or OAM, don’t do it. A CCESSIBILITY O PTIONS …Don’ts ( cont’d)

 Develop a process to determine appropriate statewide assessment accessibility supports for students not on IEPs or 504 Plans  Develop a system to inform students of available accessibility supports and allow them to request consideration for use during testing  Encourage students to “do their best”  Ask a student if he/she “needs a break” if they appear to lose focus A CCESSIBILITY O PTIONS Promising Practices

 Oregon Test Administration Manual and Webpage:  Oregon’s Statewide Assessment Accessibility Webpage & Manual:  Smarter-OAKS Accessibility Crosswalk:  Smarter Practice/Training Test  Promising Practices: A CCESSIBILITY O PTIONS Online Resources

 Accessibility supports are selected and administered for individual students  Accessibility supports used during state testing must be selected from the Oregon Accessibility Manual  Providing accessibility supports for the first time during state testing is not allowed  Administration of accessibility supports for one student must not interfere with the testing conditions of another student A CCESSIBILITY O PTIONS In a Nutshell

T EST S ECURITY (R EQUIRED FOR DTC S, STC S, AND TA S )

Objectives  Understand principles of secure test administration  Understand how to maintain security of printed test materials  Learn how to avoid and respond to test improprieties T EST S ECURITY

 Purpose: To protect the integrity and confidentiality of secure test items, prompts, and passages. The security of these materials is necessary so that they can be used in later years to measure trends in performance. In addition, test security helps to ensure test results can be used in accountability reporting.  Definition: A test impropriety is any instance where a test is not administered in a manner consistent with the Test Administration Manual or OAR Administration of State Tests. Definition and Purpose T EST S ECURITY

Some numbers from the school year:  133 districts reported at least one test impropriety  730 total improprieties were reported  1,000 student tests were impacted Test Impropriety Trends:  Non-allowable resources (including cell phones)  Student coaching  Student given the wrong test  Student cheating and talking  Unsecure test environment  Mishandling of secure test materials  Breach of student confidentiality  Missing the shipping / data entry deadline  Student tested under wrong SSID Test Impropriety Statistics T EST S ECURITY

 A quiet environment, void of distractions and supervised by a trained test administrator  Visual barriers or adequate spacing between students  Student access to only those supports listed in the Oregon Accessibility Manual  All paper test materials collected and accounted for after each testing event – including printed reading passages (or test items)  Student data is treated as confidential – no ing names and SSIDs together Secure Testing Environment T EST S ECURITY

Definition : Providing students with any type of assistance that may affect how a student responds; includes both verbal cues and nonverbal cues to the correct answer Examples:  Leading students through instructional strategies such as Think Aloud  Asking students to point to the correct answer or otherwise identify the source of their answer  Requiring or rewarding students for showing their work  Requiring students to raise their hands and receive permission before moving on to the next item  Reading aloud test content for which the read- aloud or text-to-speech are not approved designated supports or accommodation Student Coaching T EST S ECURITY

 Test opportunities may be invalidated in cases where test validity was compromised. Students will not receive additional test opportunities.  If the district determines that the testing impropriety qualifies as gross neglect of duty, then the district must report it to TSPC within 30 days. Personnel may then be subject to disciplinary action as determined by TSPC.  Districts may also evaluate cases according to their own Human Resource policies.  Private schools and programs may have their access to state tests revoked. Potential Consequences T EST S ECURITY

 TAs must ensure that students use the correct SSID and take the correct test.  TAs must securely shred test materials such as printed test items or reading passages, draft responses, scratch paper, or other paper hand-outs written on by students after each testing event.  Test materials must be securely stored at all times.  Test improprieties must be reported within 1 day of learning of them to and the district investigation must be completed within 30 days.  If a DTC cannot investigate an impropriety, the district must assign someone else to the task. Do’s… T EST S ECURITY

 TAs must not review or analyze secure test items  Students must not access non-allowable resources such as notes, text books, cell phones, iPods, or  Students must not remove test materials from the test environment  TAs must not copy or retain any test materials, including secure test booklets, writing prompts, or reading passages  DTCs, STCs, and TAs must not share their OAKS log-in information with anyone (even other authorized users) …and Don’ts T EST S ECURITY

Non-allowable resources  TAs closely review the Oregon Accessibility Manual prior to testing and examine the test environment to ensure that all non- allowable resources are removed. This includes covering up posters that contain non-allowable content.  TAs remind students of the rules and post reminders outside the lab. For cell phones, TAs create procedures for collecting all cell phones before students enter the test environment. Student cheating  TAs provide space or visual barriers between students.  TAs circulate through the test environment to monitor students. Student coaching  TAs limit interactions with students to the verbatim student directions in the Test Administration Manual and appropriately administer accommodations.  TAs do not require students to show their work or otherwise provide students with feedback during testing. Promising Practices T EST S ECURITY

Mishandling of Secure Test Materials  U sing colorful materials to identify which students have printed test materials remaining at their stations.  When setting up the test environment, the TA should ensure that the TA’s computer is set to print in the computer lab where the students are testing.  The TA uses the class roster to mark which students received printed test materials (e.g., reading passages or test items) and how many each student received. The TA then matches the class roster to the printed test materials collected at the end of the testing event to account for all printed test materials. Promising Practices ( cont’d) T EST S ECURITY

Student given wrong test  TA works with STC and other appropriate staff to identify students designated to take the Extended Test or to test in Braille or English-Spanish. For students on an IEP, TA reviews IEP to identify needed accommodations  STC and DTC ensure that student settings are updated in TIDE to restrict access to online tests for students taking the Extended Test and to update other test settings (e.g., language, print size) for students  Before approving students to start a test, the TA reviews student settings Student tested under wrong SSID  For young students or newcomer ELs, the school includes student picture on student SSID card  TA carefully reviews student names before approving students to test Promising Practices ( cont’d) T EST S ECURITY

Unsecure test environment  TA does not leave the test environment unsupervised or allow untrained staff to enter the test environment (this includes substitute teachers). Missing data entry deadline  DTC communicates with staff ahead of time about upcoming deadlines.  In case of unplanned staff absences, staff cross-train.  Several days before the deadline, the DTC ensures that all necessary materials are collected. TA review/analysis of test items  If students have a concern about a test item, the TA reads the script from the Test Administration Manual directing the student to the Student Comment Feature.  To identify content covered on the test, the TA refers to the Test Specifications and Blueprints Promising Practices ( cont’d) T EST S ECURITY

 Only authorized staff who have signed an Assurance of Test Security Form may have access to the test environment or secure test materials.  TAs must limit interactions with students during testing to what is permitted by the Test Administration Manual and Oregon Accessibility Manual.  Scratch paper and all other printed materials written on by students during testing must be collected and securely shredded at the end of each testing event.  DTCs must report all test improprieties to ODE within 1 day. Report form is available online In a Nutshell T EST S ECURITY

 Test Administration Manual and Best Practices Guide:  Oregon Accessibility Manual  Promising Practices:  Test Security Forms: Online Resources T EST S ECURITY

OAKS O NLINE S CIENCE, S OCIAL S CIENCES, AND GRADE 12 RETEST (R EQUIRED FOR DTC S, STC S, AND OAKS O NLINE S CIENCE, S OCIAL S CIENCES AND G RADE 12 RETEST TA S )

OAKS O NLINE S CIENCE S OCIAL S CIENCES G RADE 12 R ETESTS  Understand how to navigate the OAKS Online Test Delivery System and the processes related to online testing  Administer OAKS Online Science, Social Sciences and 12 th Grade Retests (Reading, Writing, and Math) appropriately Objectives

 OAKS Online Test Window: January 6 – June 12  Each test opportunity is subject to a 45- day expiration period Schedule OAKS O NLINE S CIENCE S OCIAL S CIENCES G RADE 12 R ETESTS

Grade 12 students who did not meet or exceed the standard for reading, writing, and/or mathematics may opt to retest for Essential Skills purposes.  One opportunity in writing which must be completed on-line (no paper/pencil version of the test). Window: January 6-March 13.  Up to three opportunities in reading and mathematics. Window: January 6-June 12. Retest Opportunities OAKS O NLINE G RADE 12 R ETESTS

 For students in grades 5 and 8, there are two OAKS Science and Social Sciences test opportunities per subject  Retesting students in grades 5 and 8 who have already met requires explicit parental consent  Three test opportunities for students in High School; no restriction on retesting Test Opportunities OAKS O NLINE S CIENCE S OCIAL S CIENCES

 Review Section 7.0 Administering the OAKS Online Assessments and Section 11.0 Administering the Grade 12 Writing Retest of the Test Administration Manual, as well as Appendix E and your training notes  Identify students taking the Extended Assessment  Identify students to be tested and their test settings  Make sure you have the correct SSID for each student  Identify students who need stacked Spanish/English or Braille format  Identify students who need accessibility supports  Provide students with opportunities to become familiar with the test format and technology Before Testing OAKS O NLINE S CIENCE S OCIAL S CIENCES G RADE 12 R ETESTS

 Monitor to ensure that students only have access to the allowable resources listed in the Oregon Accessibility Manual (OAM). NEW  If breaking up the test into multiple sessions, allow students to finish all presented items on the screen before pausing the test.  If students pause the test for more than 20 minutes, they will no longer be able to return to previously answered or marked items when they log back in. Test Administration OAKS O NLINE S CIENCE S OCIAL S CIENCES G RADE 12 R ETESTS

Click to view student help Zoom in/out buttons (to adjust text size). Click to view list of item pages. Pages with marked items will be indicated. Select item/item page to navigate. Pause test button. Toggle between test pages. Click for item type tutorial. Click to select a comment about the item. Click to mark item for review. Click to adjust the volume. End test button. Click to open periodic table Click to open calculator Save button appears on technology enhanced items OAKS O NLINE S CIENCE & S OCIAL S CIENCES S TUDENT I NTERFACE OAKS O NLINE S CIENCE S OCIAL S CIENCES G RADE 12 R ETESTS

Calculators (Scientific, Graphing, & Regression) OAKS O NLINE S CIENCE S OCIAL S CIENCES G RADE 12 R ETESTS

Color Overlay OAKS O NLINE S CIENCE S OCIAL S CIENCES G RADE 12 R ETESTS

Expanding Passages OAKS O NLINE S CIENCE S OCIAL S CIENCES G RADE 12 R ETESTS

Expanding Passages (cont’d) OAKS O NLINE S CIENCE S OCIAL S CIENCES G RADE 12 R ETESTS

Masking OAKS O NLINE S CIENCE S OCIAL S CIENCES G RADE 12 R ETESTS

Stacked Spanish/English Translations OAKS O NLINE S CIENCE S OCIAL S CIENCES G RADE 12 R ETESTS

Zoom Levels OAKS O NLINE S CIENCE S OCIAL S CIENCES G RADE 12 R ETESTS

 Do use the TA Training Site and Practice Tests to become familiar with both the TA and Student Interfaces before testing begins  Do review the OAKS Online TA User Guide for descriptions of all features of the TA and Student Interfaces before testing begins  Do review Sections 7.0, 11.0 and Appendix Eof the TAM before testing begins  Do carefully review student settings for each student before approving them to test Do’s… OAKS O NLINE S CIENCE S OCIAL S CIENCES G RADE 12 R ETESTS

 OAKS Online users must not share their login information and passwords, even with other authorized users.  Do not use last year’s OAKS Secure Browser. Old secure browsers should be uninstalled before installing the new secure browsers.  Do not approve students to test until you are sure the students are taking the correct test at the right time.  Do not let tests linger; they will expire after 45 calendar days. …and Don’ts OAKS O NLINE S CIENCE S OCIAL S CIENCES G RADE 12 R ETESTS

 Before the start of the testing window, the district exposes students to the online test environment using the practice test site.  The district uses the practice test to identify students who may need accessibility supports to fully access the online test.  The district restricts students who should not use the system from accessing the online test. Promising Practices OAKS O NLINE S CIENCE S OCIAL S CIENCES G RADE 12 R ETESTS

 Test Administration Manual  Oregon Accessibility Manual:  OAKS Online User Guides  OAKS Portal (Practice Tests) Online Resources OAKS O NLINE S CIENCE S OCIAL S CIENCES G RADE 12 R ETESTS