OAKS Online Test Delivery System

Familiarize users with new enhancements to the OAKS Online Test Delivery System and processes related to online testing. Identify resources to help users familiarize themselves with use of the Test Delivery System Objectives Test Delivery System

Dedicated to OAKS Online, ELPA, and the Writing Assessment Provides ODE, ESD, district, and school staff with access to the following applications: – Test Information Distribution Engine (TIDE) – OAKS Online Reporting System – Test Delivery System (TDS) - TA Interface (Test Administration) – Test Delivery System (TDS) - Student Interface – TA Training Site – Student Practice Test – News and important updates relating to OAKS Online, the ELPA, and the Writing Assessment – Download of Secure Browsers 5.0 (installation instructions and FAQs) OAKS Portal Test Delivery System

Centralized login to access multiple OAKS systems – Via OAKS portal – User has access to all systems (depending on security) – Easily navigate between OAKS systems – Administer OAKS Online, ELPA, and Online Writing tests TA InterfaceTIDE Online Reporting SystemTA Training Site Common Login System (CLS) Test Delivery System

TA Interface – Used to administer online tests, track progress, and manage students testing in their session – Ability to adjust test settings (including accommodations/modifications) for individual students before they are approved to start the test – TAs use this interface to approve and submit print requests from students Student Interface – Secure online test that must be accessed via a secure browser. The OAKS Portal ( contains details on installing the necessary software. Note: Some images in this presentation are preliminary; actual cosmetic look is not final. Overview of Test Delivery System Test Delivery System

TA Interface Enhancements – Mobile device support for TA Interface – Session Handoff feature allows TAs to switch machines while administering tests without interruption to their test session – Now displays the duration that a student’s test has been paused (in a test session) Student Interface –Only one opportunity available between 11/8/2011 and 1/10/2012 – New Braille Interface for students who use Braille for Reading, Math, Science, and Social Sciences – New computer-based read-aloud feature for Math, Science, and Social Sciences – Additional levels of enlarged print – More calculator features for Math, Science, and Social Sciences tests Note: Some images in this presentation are preliminary; actual cosmetic look is not final. New Features for Test Delivery System

TA Interface at A Glance Simplified workflow reduces the need to navigate multiple pages to create/edit sessions and approve students. All information is visible on one screen Tests in session Students needing approval to start testing Students with tests in progress Print requests Test Delivery System

TA Interface (cont’d) Create / Edit Sessions –The list of available tests automatically displays upon logging in and can remain on screen while monitoring students –Simply select the tests for the session and click [Start Session] What does this mean for test administration? –Test sessions automatically expire upon TA logout Create one test session for students testing during a specific time Sessions cannot be resumed (A new Session ID is generated for each session) Students may resume a paused test in any new test session that includes the applicable test subject and grade. Example: TA creates a test session for students on Tuesday. To resume testing on Wednesday, the TA will create another test session for students to resume testing. Test Delivery System

TA Interface (cont’d) Student Test Settings and Approvals –Approvals Preview (right) allows TAs to see students that need to be approved while monitoring test progress –The complete list of students awaiting approval will display on a pop-up screen Oaks Online

TA Interface (cont’d) Student Test Settings and Approvals –Adjust test settings for an individual student Oaks Online

Student Test Settings  Language A student’s test language is configurable by test subject via TIDE (but can also be adjusted in TA Interface for that specific test opportunity) Mathematics, Science, Social Sciences, and Writing (all grades) can be administered in English-Spanish side-by-side For Grade 3, Reading can be administered in Spanish only as a native-language assessment (this is not an English-Spanish side-by-side test) New for : a new Braille interface is accessible for students who use Braille by selecting “Braille” from the language menu Print Size – now available in 4 levels of zoom Test Delivery System

Student Test Settings (Cont’d)  Color Choice The Student Interface can be set to present the test background with different options Text and background color combinations are pre-defined for a colored overlay over test content Test Delivery System

Student Test Settings (Cont’d)  Print on Request Printed reading passages remains an allowable resource for all students. For reading, “stimuli” is the default setting for all students Printed items in all subjects and stimuli in Science and Social Sciences are available as a restricted resource for individual students only Only DTSA or DSA-level users can pre-set this restricted resource (via TIDE) All print requests (for items or reading passages) must still be approved by the TA in the TA Interface Test Delivery System

Student Test Settings (Cont’d)  Text-to-Speech Computer-based read-aloud accommodation available for OAKS Math, Science, and Social Sciences Recommended for use with Windows 7 or Mac 10.6 for optimal results Spanish read-aloud supported for Spanish-English side- by-side tests—to use, districts must purchase and install Spanish voice pack (for optimal results, ODE and AIR recommend the Marta voice pack from Cepstral for Windows users and the Rosa voice pack from Infovox for Mac users) Headsets USB headsets Ensure sound works with headsets on each computer prior to testing. The student login screen contains a diagnostic tool to verify that audio is working within the secure browser. The student will also be prompted with a sound-check as part of the approval process. Test Delivery System

Student Test Settings (Cont’d)  Braille If “Braille” is selected for a student’s test (via Language drop-down), settings for Emboss Request Type and Braille Type are automatically displayed. Test Delivery System

Student Interface at A Glance Test Delivery System

Dos Do use the TA Training Site and Practice Tests to become familiar with both the TA and Student Interfaces before testing begins Do review the OAKS Online TA User Guide for descriptions of all features of the TA and Student Interfaces Do carefully review student settings for students before approving them to test Dos and Don’ts Test Delivery System

Don’ts OAKS Online users must not share their login information and passwords, even with other authorized users. Do not use last year’s OAKS Secure Browser. Old secure browsers should be uninstalled before installing the new secure browsers. Do not approve students to test until you are sure the students are taking the correct test at the right time. Do not approve a student to take the ELPA unless his or her LEP flag is set to “yes.” Do not let tests linger, they will expire after 45 calendar days. Dos and Don’ts (cont’d) Test Delivery System

Test Information Distribution Engine (TIDE)

Definition: Test Information Distribution Engine Available through the OAKS Portal ( Purpose: To provide ODE, ESD, district, and school staff with access to: – User Information Add new users or modify existing accounts – Student Information View student information in read-only mode Search for students – Student Settings View/Edit student test settings for a student – Student Restrictions View/Edit or Add restrictions for a student Upload restrictions for a batch of students TIDE Overview

User Roles and Access – OAKS users (DSA and lower) are associated with a district and/or institution(s). Current roles are (in order of hierarchy): State, DSA, DTSA, STC, TA, and TT. System Requirements around Browsers and Operating Systems Add/Modify Users – TIDE allows the following: view/edit users, upload users, add users. TIDE What’s the Same?

Accommodation Codes are now separated by Subject More efficient search tool (for Users and Students) Student Details now have a “Braille” option for students taking OAKS Online using the Braille Interface Suppress Score Feature: Allows user to change a student’s settings so they do not see their score when they finish an OAKS Online test TIDE New for

TIDE: Student Information – Student search is combined with the Student Information tab – Users can now choose to search for a group of students (such as by grade and/or school) or for an individual student (such as by first name, last name, or SSID). Once the search is complete a student table is generated. TIDE

TIDE: Student Settings Users can view but not edit the student’s personal information. Users can update all test settings and select other accommodations on this page. TIDE

TIDE: Student Restrictions Here users can view and edit test restrictions for students within a district and/or institution. Test restrictions prevent students from testing in a specified subject. Please note that if a student transfers schools or district, his or her test restriction settings will not change or be reset. TIDE

TIDE: View/Edit Restrictions Select the district and/or institution from the list(s) and click [Search]. To narrow the search, one can select an enrolled grade, or enter a student's SSID, first or last name. Each row displays information for students, including test settings and accommodations. Each row also contains an [Edit] button. TIDE

TIDE: Upload Restrictions TIDE accepts uploads of student test restriction information in CSV (ASCII) format. CSV files can be opened/edited using spreadsheet applications such as Microsoft Excel or a notepad application. TIDE

Do’s Use student restrictions function to manage student access to specific assessments in OAKS Online. Use student test settings to assign system features and restricted resources to students by test subject (e.g., language, zoom, print- on-request). TIDE Do’s and Don’ts

TIDE Promising Practices The district uses the Student Restriction function to restrict students who are designated to take OAKS Extended from accessing the Online test. The district applies student test settings for students by test subject to ensure that students have appropriate access to OAKS Online. For students with IEPs or 504 Plans, the district consults the student’s plan before applying test settings to ensure compliance with the student’s plan.

Online Reporting System

Definition: Performance Reports Available through the OAKS Portal ( Purpose: To allow districts and school staff and teachers to identify strengths and weaknesses and improve teaching and learning by providing: – Aggregate performance data for their district or school – Aggregate performance data for teachers or classes – Scores for individual students in their district or school – The ability to print student reports to distribute to families – The ability to view performance trends – The ability to create and view reports for custom rosters – Aggregate and student level performance data on strands – Aggregate level performance data on content standards Overview

New Features for Test Management Center (Replaces the old Participation Reports): view summary statistics, manage student participation and identify school testing windows Download Roster/Data Dump: extract student information from any page in the reporting system Student Listing Report: Now includes a “Breakdown by” feature that allows users to view a list of individual students by subgroup (e.g. males). Student Search: Search for students by SSID, Name, and other information Directly access students’ score reports

New Features for ( con’t) High School tests: New aggregation rule Now calculates aggregated data like average and percent proficient by using all of the scores that 11 th graders have earned over the past three years. This means that the reports will show more accurate proficiency rates, even if the 11 th grade students demonstrated proficiency in their 9 th or 10 th grade year. The student listing page for the high school reports will also include a Test Date column so that users can sort out scores from different administrations.

Other Changes to Reports Student transfers: New rule for access to student data after student transfers to new district. Beginning this year, data access will transfer with a student. New Science Content Standards and Reporting Categories New Science Achievement Standards (pending Board adoption in October 2011) New Reading Achievement Standards New ELPA Reporting Categories “Breakdown By” filter now separates “Asian” and “Pacific Islander” students

Performance Reports: Subject Performance District users can see performance data for the district and its schools; school users see data for a school and each teacher; etc. The distribution of students across performance levels is displayed graphically to allow easier comparison between groups Users can view the data for subgroups by choosing an option from the “Breakdown By” dropdown

Performance Reports: Navigation Users can explore the data in various ways to answer questions they have of the performance reports and identify strengths and weaknesses The icon indicates that data can be further explored When users click the icon, they see a control panel that will let them select whether they want to see more or less group detail, more or less content detail, or if they want to see a trend for a particular piece of data

Performance Reports: Navigation (cont’d) By choosing more or less group detail, users can see data for schools, individual personnel, classes, or individual students. The buttons on the control panel will update to identify the data the user is accessing. This will help users answer “who” questions. For example: Who is struggling in algebra?

Performance Reports: Navigation (cont’d) By choosing “Trend” or “Current” users can choose whether they want information on the current year performance of a student, group of students, school, or district or if they want a historical trend of that performance. This will help users answer “When” questions. For example, Has this group of students struggled in mathematics in the past?

Performance Reports: Data and Tools Users can access these data and tools: Longitudinal Reports Rosters of students with scores Ability to create custom rosters Ability to view all aggregated data for custom rosters Printable family-friendly student reports Ability to print and export pages Ability to print and export student responses to Writing Performance Assessment (for individual students or groups of students)

Performance Reports: Student Report The Performance Reports provides the family- friendly student report and other data and tools.

Test Management Center Features Replacing old Participation Reports Participation Reports are now in the “Plan and Manage Testing” section of the Test Management Center, and is very similar to the filters used in the old Participation Reports

Test Management Center Features Summary Statistics View statistics on how many students have tested at each opportunity 00

Test Management Center Features (cont’d) Set a Schedule of Testing Windows (via Summary Statistics) Set a schedule of testing windows to organize when students will test Available to TT, TA, STC, and DTSA Users through the Summary Statistics page

Retrieving Student Results / Download Roster New feature allows users to download student results for a selected group (by School, District, Teacher, or Roster) The system creates a data file of all students’ scores from the reported administration (based on your request) This file appears in your Online Reporting “Inbox” Data file is designed to be read in spreadsheet programs (Excel) and statistical software packages

Student Listing Report Two new features that allow users to view subcategories for individual students and choose which columns you would like to view. “Breakdown By” filter: Breakdown student listing into chosen category (gender, ethnicity, special education, etc…) Show/Hide columns: Select what columns you would like to show and hide (available on every table in Online Reporting)

Student Search Allows users to look up information for any student that exists in the Online Reporting System (based on your user role access) Enter either the student’s SSID OR the first or last name of a student The student results will show a list of students that matched your search (for name based searches)

High School Banked Scores Reporting OAKS High School Scores High school students can have scores from grades 9, 10, or 11 Aggregated scores for High School students now based on all of the grade 11 students’ scores from the past three years. Ex: If a grade 11 student demonstrated proficiency while in 9 th grade, that is reflected in the current aggregated reports Aggregated data corresponds to that administration’s grade 11 students only Grade 9 and 10 students who take the High School tests will appear in individual student rosters. However, comparison scores for data purposes incorporate only grade 11 students.

New Rules for Transfer Students Data for students no longer enrolled in your school: Scores travel with students transferring between Oregon schools If a student transfers to a school, his or her scores are now associated with the new school in the Online Reporting System If a student leaves a school, his or her scores are no longer associated with the originating/previous school in the Online Reporting System Scores do not travel with students who transfer or move to a non-Oregon school If a student transfers from an Oregon public or charter school to a private or parochial school that does not conduct OAKS testing, the student’s scores remain with your school. If the student moves to another state, his or her scores remain with your school. Scores do not travel with students who drop out or otherwise leave Oregon public/charter schools entirely This does not change how AYP is calculated for schools

Do’s Use the enhanced help features to learn about the new online reporting system and how to make best use of it Use data from the Performance Reports along with other information on student ability to identify areas of need and provided targeted instruction Create custom rosters to track the progress of particular groups of students – Students in an intervention program Use the data after checking your assumptions Do’s and Don’ts

Don’ts Online Reporting users must not share their log-in information and passwords, even with other authorized Performance users – Student Score Data is Confidential Do’s and Don’ts (cont’d)

Promising Practices Creating custom rosters to track the progress of a group of students in a particular program Using trend reports to examine student data over time