California Assessment of Student Performance and Progress (CAASPP) Online Reporting System Guidelines for the 2014 California Smarter Balanced Field Test April 10, – 2:30 p.m.

2014 Online Reporting System Guidelines 2 Introductions Overview Navigating the System Test Management Center Resources Agenda

2014 Online Reporting System Guidelines 3 By the end of this Webcast, Local Education Agency (LEA) CAASPP coordinators will be able to train authorized users to utilize the Online Reporting System (ORS) to view test progress information for students taking the Field Test. Purpose

Overview of the Online Reporting System

2014 Online Reporting System Guidelines 5 What is the Online Reporting System? –Web-based system  –Gateway to view student test data –Participation reports  Note: ORS does not provide score reports –Allows users to determine which students have completed or need to complete testing Overview ORS User Guide Pg. 5

2014 Online Reporting System Guidelines 6 User Roles and Access ORS is a secure, role-based system Access to reports and data depends on the user role Note: Do NOT share login information with anyone. The ORS provides access to student information, which must be protected in accordance with federal and state privacy laws. State User District Test Coordinator School Test Coordinator Test Administrator Test Management Center Plan and Manage Testing  Test Completion Rates  ORS User Guide Pg. 5

Navigating the Online Reporting System

2014 Online Reporting System Guidelines 8 Logging into the ORS 1.Go to the California Smarter Balanced portal: – 2.Select the [Field Tests] card. 3.Click the [Online Reporting] button. ORS User Guide Pg. 6

2014 Online Reporting System Guidelines 9 Logging into the ORS 4.Enter your username ( address) and password in the login page. 5.Click the [Log In] button. ORS User Guide Pg. 6

2014 Online Reporting System Guidelines 10 User Acknowledgement When logging in for the first time, you will be asked to review and accept a user acknowledgement.

2014 Online Reporting System Guidelines 11 Header –Located above the banner –Lists which user is logged into the system –Includes [Logout] button Understanding the ORS ORS User Guide Pg. 9

2014 Online Reporting System Guidelines 12 Menu –[Home] link takes you to the Home Screen –[Test Management Center] link provides a drop-down list of:  Plan and Manage Testing  Test Completion Rates Understanding the ORS ORS User Guide Pg. 9

2014 Online Reporting System Guidelines 13 Several tools are available on the top of every screen: –Help  Opens the ORS user guide in a new window –Definitions  Provides definitions for terms specific to the report you are viewing  This button may not appear on every screen General Tools ORS User Guide Pg. 10

Test Management Center

2014 Online Reporting System Guidelines 15 Allows users to generate customized participation reports Check test completion rates by school, grade, subject, and opportunity Access by clicking the [Test Management Center] link from the Menu, at the top of any page Test Management Center ORS User Guide Pg. 11

2014 Online Reporting System Guidelines 16 Monitor students’ test progress Generate customized reports to determine: –students that have completed testing –students that have yet to begin or complete testing Plan and Manage Testing ORS User Guide Pg. 11

2014 Online Reporting System Guidelines 17 Click on [Plan and Manage Testing] from the [Test Management Center] drop-down menu Generating a Participation Report ORS User Guide Pg. 11

2014 Online Reporting System Guidelines 18 Step 1: Choose What –Test  Default variable is “Smarter Balanced” –Administration  Default variable is “Smarter Balanced Field Test” –Test Name –Enrolled Grade Selecting the Parameters for Your Report ORS User Guide Pg. 12

2014 Online Reporting System Guidelines 19 Step 2: Choose Who –Client  Default set to California –District –School –Personnel  Optional field that enables you to select the teacher or personnel for whom you wish to generate the report  Default set to “All.” Selecting the Parameters for Your Report ORS User Guide Pg. 12

2014 Online Reporting System Guidelines 20 Step 3: Get Specific –Students who [have/have not] [completed/started] the [1 st ] opportunity in the selected administration –Students whose current opportunity will expire in [##] days –Students on their [1 st ] opportunity in the selected administration, and have a status of [student test status] –Students whose most recent [Session ID/TA Name] was ____ between [start date] and [end date] Selecting the Parameters for Your Report

2014 Online Reporting System Guidelines 21 After selecting your parameters, click on [Generate Report] or [Export Report] to open the report in Microsoft Excel Two types of participation reports: –Online Testing Progress Report –Test Administrator (TA) Report Generating Your Participation Report ORS User Guide Pg. 14

2014 Online Reporting System Guidelines 22 Generated if any of the first three radio buttons in “Step 3: Get Specific” section is selected Online Testing Progress Report ORS User Guide Pg. 14

2014 Online Reporting System Guidelines 23 Features –Navigation tools  By default, 100 student records can be displayed one page at a time  Displays 15 columns by default (can be sorted) –Hide/show columns –Sort results by attribute  Sort participation report data in any column –General tools Online Testing Progress Report ORS User Guide Pg. 15

2014 Online Reporting System Guidelines 24 Columns in Online Testing Progress Report: Online Testing Progress Report Student NameStatus SSIDResults ID Confirmation CodeRestarts Enrolled GradeDate Started TestDate Completed OpportunityLast Activity TA NameExpiration Date Session ID ORS User Guide Pg. 16

2014 Online Reporting System Guidelines 25 Test status types: Online Testing Progress Report CompletedReported ExpiredScored InvalidatedStarted PausedSubmitted PendingSuspended ORS User Guide Pg. 17

2014 Online Reporting System Guidelines 26 Generated if the radio button titled “students whose most recent…” in “Step 3: Get Specific” section is selected Provides information about: –Test sessions that match the specified parameters –Name of TA(s) for the sessions –Number of students associated with each of the sessions TA Report

2014 Online Reporting System Guidelines 27 Features –Hide/show columns –Sort results by attribute  Sort report data in any column –General tools –Generate or export the Online Testing Progress Report for the selected TA and session TA Report ORS User Guide Pg. 18

2014 Online Reporting System Guidelines 28 TA Report Columns –Test Administrator Name –Session ID –Session Start Date – Session End Date –# of Students in Session –Test IDs in Session TA Report Tools − Enables you to generate the Online Testing Progress Report − Enables you to export the Online Testing Progress Report TA Report ORS User Guide Pg

2014 Online Reporting System Guidelines 29 Users can create an exported Excel spreadsheet file that shows the total number of students who have started and completed each test. Exported file can be viewed in most data analysis programs Test Completion Rates Reports ORS User Guide Pg. 20

2014 Online Reporting System Guidelines 30 Available Test Completion Rate report types: –State Test Completion Rates –District Test Completion Rates –School Test Completion Rates Test Completion Rates Reports ORS User Guide Pg. 20

2014 Online Reporting System Guidelines 31 Click on [Test Complete Rates] from the [Test Management Center] drop-down menu Generating Test Completion Rates Reports ORS User Guide Pg. 20

2014 Online Reporting System Guidelines 32 Step 1: Select a Report –Reports that are available to a user depends on the user role Step 2: Select an Entity –Select the required district or school Step 3: Select a Test –Default value is set to select “All” tests Parameters for Test Completion Rates Reports ORS User Guide Pg. 21

2014 Online Reporting System Guidelines 33 Columns in Test Completion Rates Reports: Test Completion Rates Reports DateSchool Number Test NameTotal Student OpportunityTotal Student Started District NameTotal Student Completed District IDPercent Started School NamePercent Completed ORS User Guide Pg. 22

2014 Online Reporting System Guidelines 34 It is critical that all users log out of the ORS after use for security purposes Logging out of the ORS will result in logging out of all Smarter Balanced systems –Test Information Distribution Engine (TIDE) –TA Interface –TA Training Site –ORS Use caution using ORS during a test session. Logging out of ORS will also log out of testing session. Logging out of the ORS ORS User Guide Pg. 8

Live Demonstration

Questions

Resources

2014 Online Reporting System Guidelines 38 Resources The Online Reporting System User Guide is available on the California Smarter Balanced portal – content/uploads/2014/03/Smarter_ORS_UserGu ide_FieldTest2014.pdfhttp://sbac.portal.airast.org/wp- content/uploads/2014/03/Smarter_ORS_UserGu ide_FieldTest2014.pdf

2014 Online Reporting System Guidelines 39 Help Desk Support The California Technical Assistance Center (CalTAC) is there to support all LEA CAASPP coordinators! Available Monday – Friday from 7 a.m.– 5 p.m. PT Phone: Web site: