Office of Accountability Research, Evaluation & Assessment School Assessment Coordinator Meeting October 13 and 14, 2014 Local Purpose Assessment (OLPA) November 3 – December 19, 2014

Office of Accountability Research, Evaluation & Assessment Pearson Online Assessment System Questions about OLPA Landing Pages Resources Before Testing During Testing TestNav Function Test Results Test Monitor Certification Training Sections: 3

Office of Accountability Research, Evaluation & Assessment Questions aboutOLPA What is it? Accommodations Scheduling Test Administrations Times SAC Responsibilities 3 1

Office of Accountability Research, Evaluation & Assessment 4 What’s The OLPA? An on-line reading and mathematics test MCA format Given prior to spring MCA Who Takes The OLPA? All Grade 3-7 students What’s the testing window for The OLPA? November 3 through December 19, 2014 What’s the purpose of The OLPA? Allows students to familiarize themselves with on-line MCA testing Provides teachers with information to target instruction prior to spring MCA How many times can students take The OLPA? One testing opportunity per student ˗ Math and Reading What student information do I need for The OLPA? Student login information ˗ MARSS number ˗ Who requires the Accommodated Text-to-Speech (ATTS) accommodation

Office of Accountability Research, Evaluation & Assessment 5 What Materials are Allowed when taking The OLPA? Scratch paper A pen or pencil to use with scratch paper Head phones for Text-to-Speech Hard-copy mathematics formula sheets for grades 5-7 What Materials are Not Allowed when taking The OLPA? Handheld calculators (Unless specified in IEP) Test Monitors must actively monitor the student(s) so their handheld calculators are not used on non-calculator test items. Are there Accommodations with The OLPA? Accommodations for some grades 3-7 students ˗ ONLY Accommodated Text-to-Speech (ATTS) for ELs and Special Ed students with ATTS listed in their IEPs or 504 Plan ˗ No paper scripts No paper accommodated test materials, large print or Braille tests

Office of Accountability Research, Evaluation & Assessment 6 Scheduling OLPA Test Administrations Elements of OLPA by Subject − Allows students to exit their test at different points and to return to complete it later − Students responses are saved in the system − Student is brought back to the item last viewed before exiting Mathematics OLPA ‒ Review screens divide four sections ‒ Before exiting ›students must complete a section ›review items ›select Next to go to the next section ›students must exit the test on the first item in the next section Reading OLPA ‒ Divided into sections by passage and test items ‒ Number and placement of passages will vary by form ‒ Each section begins with a title page ‒ Students will know they have completed all items for the passage when they reach the review screen for the section ‒ Before exiting › students must complete a section › review items › select Next Section to go to the next section › students must select Close to move to the next section › students must exit the test on the title page for the next passage  A dialog box will ask students if they want to close the section. Once the section is closed it cannot be reopened.

Office of Accountability Research, Evaluation & Assessment 7 Test Administration Times Grade and Test Number of Items in Section 1 Number of Items in Section 2 Number of Items in Section 3 Number of Items in Section 4 Total Test Administration 3-8 Reading OLPA Varies 3–4 hours 3-8 Mathematics OLPA –2 hours 10 Reading OLPA Varies 3.5–4.5 hours Total Test Administration includes: 1.Time needed to review the Test Monitor and Student Directions. 2.Answer student questions. 3.Students logging in to the test. 4.Student work time.  The estimated times do not include time for completion of item samplers or viewing of the online student tutorial.

Office of Accountability Research, Evaluation & Assessment 8 SAC Responsibilities Online Test Sessions Manage online test sessions – Know which students have the Math Accommodated Text-to-Speech (ATTS) – Have head-phones for Text-to-Speech – Create and start test sessions – Approve students into test sessions – Monitor student progress Proctor cache test sessions

Office of Accountability Research, Evaluation & Assessment 9 Pearson Landing Pages Overview Home Student & Family Teacher & Test Monitor Signing In to Pearson Access 2

Office of Accountability Research, Evaluation & Assessment 10 Overview Home Landing Pages The PearsonAccess website ( is the portal to all Pearson services used by the Minnesota school districts. Use this site to access test administration activities, training, and other resources.

Office of Accountability Research, Evaluation & Assessment 11 Student & Family Landing Pages Learning Resources Item Samplers Student Resources

Office of Accountability Research, Evaluation & Assessment 12 Teacher & Test Monitor Landing Page Training Center ˗ Practice test sessions ˗ Administering Item Samplers Resources ˗ Training Materials ˗ Manuals and Directions ˗ Student Resources ˗ User Guides

Office of Accountability Research, Evaluation & Assessment 13 SIGN IN to PearsonAccess Log-in to PearsonAccess ˗ Any Secure Web Browser ˗ Enter ˗ Select our state Helpful links for User IDs and passwords

Office of Accountability Research, Evaluation & Assessment 14 3 Resources Item Samplers Training Center

Office of Accountability Research, Evaluation & Assessment 15 Resource Page Select the Go to Resources link on any of the landing pages. Items that are or will be available include:  Student Resources o Student Tutorials o Formula Sheets o Calculators  Manuals o Procedures Manual o All assessment manuals  Directions o Student Login Information Instructions and Template o Test Monitor and Student Directions o Student Directions Presentations  User Guides & Technology o PearsonAccess o TestNav o SystemCheck o Proctor Caching  MDE Trainings o Training Module I o Test Security Training o MTAS Trainings  Pearson Trainings o Online Test Monitor Certification Course o All recorded trainings and PowerPoints

Office of Accountability Research, Evaluation & Assessment 16 Access Item Samplers from ANY of the tabs on Use item samplers to familiarize students with the format of the test. Item samplers are not practice tests and cannot be used to predict how well students will perform on the assessments. Two ways to access item samplers:  Select the Go to Item Samplers link on any of the landing pages. o ePATs (Electronic Practice Assessment Tools) will be available for all applicable test administrations. o Use this as a quick way for students to get familiar with the online testing format. o PDFs will also be available for download for any applicable paper accommodations.  Sign in to the Training Center. o After creating sample students and a test session, students can log in to TestNav to take an online item sampler. o Use this to provide both Test Monitors and students familiarity with PearsonAccess functionality and the online testing format. Item Samplers

Office of Accountability Research, Evaluation & Assessment 17 When Are Item Samplers Available? Grades 3–8 Math MCA Online Item Samplers: Available now Grades 3–8, 10 Reading MCA Online Item Samplers: Available now Grades 5, 8, HS Online Science Item Samplers: December 2014 MTAS Reading, Math, Science Paper Item Samplers: December 2014 *Paper item samplers will be available via PDF for students requiring accommodations.

Office of Accountability Research, Evaluation & Assessment 18 Training Center Practice setting up mock test sessions and administering Item Samplers. Become familiar with PearsonAccess administration functions.  KEY DIFFERENCES between PearsonAccess operational vs. Training Center:  PearsonAccess operational: o All student data comes from MDE’s precode file o Shipment Tracking and Additional Orders available  PearsonAccess Training Center: o Create sample students o No real data is affected o Item samplers are available through practice test sessions * Remember you will receive two separate s from Pearson. −One for Training Site −One for Live Site −Usernames are Different −Passwords the Same

Office of Accountability Research, Evaluation & Assessment 19 Training Center: SIGN IN User IDs are different for the Training Center TIP: When creating user accounts, assign different User IDs for PearsonAccess and Training Center. * Passwords can be the same for both accounts.

Office of Accountability Research, Evaluation & Assessment 20 Demonstration Navigation  Resources  Item Samplers  Training Center

Office of Accountability Research, Evaluation & Assessment 21 Before Testing Create a Test Session Proctor Cache Tests Dates for PearsonAccess Tasks 4

Office of Accountability Research, Evaluation & Assessment 22 Create a Test Session Steps to create an online test session: 1.Log-in to PearsonAccess using secure browser 2.Enter 3.Select Minnesota 4.Select Online Test Sessions 5.Verify the test administration OLPA Complete fields (fields with a red arrow are required): Session Name: School: Test to be Administered: Read Aloud by Test Examiner will automatically default to NO Form Group Type: Main, Accommodated, or Data Entry Scheduled Start Date: select the calendar button; used for planning only–does not start the test Scheduled Start Time and Location/Room: optional fields, for planning purposes only 7.Select Save.

Office of Accountability Research, Evaluation & Assessment 23 Proctor Cache Tests Steps to Proctor Cache: 1. Pre-caching (download) the test content Online Test Sessions must be created prior to Proctor Caching. 2. Running Proctor Caching during testing In order for Proctor caching to be successful, the proctor caching machine must be on AND the software must be running during testing. Additional information coming. Watch from Robin and Michael.

Office of Accountability Research, Evaluation & Assessment 24 What is Proctor Caching?

Office of Accountability Research, Evaluation & Assessment 25 Dates for PearsonAccess Tasks OLPA 2014–2015 ˗ Testing Dates: Nov. 3–Dec. 19 ˗ Create Test Sessions: Oct. 20–Dec. 19 ˗ Proctor cache Tests: Oct. 31–Dec. 19

Office of Accountability Research, Evaluation & Assessment 26 During Testing Start a Test Session Provide Student Login Information Approving Students to Test (Self-Registration) Monitor Test Session Resume a Test Enter Test/Accountability Codes or Invalidate a Test DAC only (Robin L. or Michael W., REA) Student Logs Into TestNav to Take Test 5

Office of Accountability Research, Evaluation & Assessment 27 Start a Test Session Steps to start a test session: 1.Select Online Test Sessions on the Home page. 2.Find and select your test session under the Session Name column. 3.Select the Start button on the top left. 4.It will ask you “Are you sure you wish to do this?” Select Yes-Start Session. 5.Select Return to Session detail. 6.You have now started the test session and will see a Stop button instead of the Start button.

Office of Accountability Research, Evaluation & Assessment 28 Student Login To TestNav 1.To log in to TestNav, student’s need the following information:  First Name and Last Name  MARSS/SSID  Test Code o The test code is automatically generated after a test session is created. Test codes are specific to each test session. 2.Write the test code (from the test session) on the board for all students that should be in that specific test session.  Note: Test sessions are specific to the test grade, subject, and form group type (Main, Accommodated, or Data Entry).

Office of Accountability Research, Evaluation & Assessment 29 Provide Student Login Information It’s up to you and your building principal to determine how to provide student login information to students. Two recommended options for providing student login information: 1.Use the Student Login Information Template “Test Ticket” (Word document and Excel spreadsheet) to create a one-page student login information document for each student using Mail Merge. Templates are located on the Directions tab on the Resources page. 2.Write the test code (from the test session) on the board for all students that should be in that specific test session. o Note: Test sessions are specific to the test grade, subject, and form group type (Main, Accommodated, or Data Entry).

Office of Accountability Research, Evaluation & Assessment 30 Student Login to TestNav Specific to each test session created in PearsonAccess Test Ticket

Office of Accountability Research, Evaluation & Assessment 31 Student Login TestNav Student’s Computer 1.Log-in to the student’s computer. a.In the “Log On to Windows” box enter: a. Username: pearson b. Password: pearson b.Locate and double click on the TestNav secure browser, on the desktop. The system should launch directly to the student’s log-in page. The student will see the page loading (gray screen).

Office of Accountability Research, Evaluation & Assessment 32 Recap of completed steps: 1.Created a test session 2.Proctor cached tests (technology configurations set up prior) 3.Started the test session 4.Provided student login information 5.Student entered information and logged into TestNav NOW WHAT? The Test Monitor needs to approve the student into the test in PearsonAccess. NOTE: Logging out of PearsonAccess will NOT effect students effect students testing in Test Nav. RECAP……..NOW WHAT?

Office of Accountability Research, Evaluation & Assessment 33 Approve Students to Test (a.k.a Self-Registration) Steps for approving students to test: 1.Select Online Test Sessions on the Home page. 2.Find and select your test session under the Session Name column. 3.Select the Student Requesting Session Admission radio button. 4.Verify the correct students who are in your class are requesting to test. 5.Select the checkbox next to the student(s) you want to approve to test. To select all students, select the checkbox in the blue bar. 6.Select Approve Request. 7.Select the Students in the Session radio button. 8.After approving, the student will now be taken to the first item in the test and display on the Student in the Session screen. Sample student data

Office of Accountability Research, Evaluation & Assessment 34 Approve Students to Test cont. If for whatever reason, the student should NOT be in the test session, select DENY. There are a few different reasons PearsonAccess will NOT let you approve a student to test: 1.If the student is already in a test session (for the same grade and subject) 2.If the student is not registered for the test  The student is not eligible to take the test since Pearson did not receive eligibility data from MDE. 3.If the MARSS/SSID was entered incorrectly or does not match a student provided by MDE. Sample student data

Office of Accountability Research, Evaluation & Assessment 35 Monitor a Test Session In addition to monitoring the students testing in the classroom, you can monitor in PearsonAccess by viewing the Status column. Students in Active status are actively testing. If a student exits the test for whatever reason, the student will display in Exited status. Students in Exited status need to be resumed before continuing to test. Sample student data

Office of Accountability Research, Evaluation & Assessment 36 Resume a Test Steps to resume a test (if a student exits the test and needs to resume testing): 1.Select the checkbox next to the student(s) that need(s) to be resumed. 2.Select Resume Test. 3.Student’s can now log back into TestNav with the same student information that they used initially. 4.When the student(s) have submitted the test in TestNav, the student will be in Completed status. Sample student data

Office of Accountability Research, Evaluation & Assessment 37 TestNav Tools and Functionality 6

Office of Accountability Research, Evaluation & Assessment 38 What is TestNav? Browser-Based Test Engine Student desktops are secured and locked down, no other applications are accessible during testing. Test content is encrypted before transferred across the Internet.

Office of Accountability Research, Evaluation & Assessment 39 Features and Functionality Wide array of tools and accommodations. Text-to-speech, magnifying and zoom capabilities, color-contrast, etc. make online testing accessible to more students. Industry standard calculators. Embedded TI calculators provide consistency with what students use in the classroom. Embedded text-to-speech feature. High-quality voice feature (Julie voicepack) included within the test engine, eliminates the need for schools to download special software.

Office of Accountability Research, Evaluation & Assessment 40 TestNav URLs PearsonAccess Operational:  Self-Registration (Main and Accommodated forms):   Manual Registration (Data Entry forms):  Training Center:  Self-Registration (Main and Accommodated forms): 

Office of Accountability Research, Evaluation & Assessment 41 TestNav Demonstration

Office of Accountability Research, Evaluation & Assessment 42 Test Results 7

Office of Accountability Research, Evaluation & Assessment Viewing Test Results in Pearson Access 43 Three components: On-Demand Reports – Preliminary results available during the testing window Published Reports – PDF versions of final paper reports delivered to districts, available following the Posttest Edit Window Longitudinal Reporting System – Results following the Posttest Edit Window loaded to the system for districts to analyze trends and patterns over time

Office of Accountability Research, Evaluation & Assessment 44 On-Demand and Longitudinal Reports On-Demand Reports – access to preliminary online rosters and ISRs – Users can drill down to an individual student to see preliminary student-level results. Longitudinal Reports - analyze results from a specific administration, multiple administrations within a year, or assessment results from year to year – Drill-down, filtering, and sorting capabilities – Aggregate and disaggregate data all the way down to individual student-level results – District, school, and teacher access to student results

Office of Accountability Research, Evaluation & Assessment 45 Which Reports are Available for Which Tests? Test AdministrationOn-Demand Reports Published Reports Longitudinal Report MCA Math, Reading, Science MTAS Math, Reading, Science OLPA Math and Reading GRAD Math and Reading GRAD Written Composition

Office of Accountability Research, Evaluation & Assessment 46 When will Results Be Available? Test AdministrationOn-Demand Reports Published ReportsLongitudinal Report Historical Data --10/14/2014 OLPA Math and Reading Within 1 hour- Loaded weekly beginning 10/24/14 GRAD Math and Reading Within 1 hour 4 weeks after test window - GRAD Written Composition - 12/15/14 5/22/15 - MCA Math, Reading, Science Within 1 hour7/29/2015 MTAS Math, Reading, Science -7/29/2015

Office of Accountability Research, Evaluation & Assessment 47 Test Monitor Certification Training Course Required for SACs and Test Monitors! 8

Office of Accountability Research, Evaluation & Assessment 48 Test Monitor Certification Training Course Required for Test Monitors and SACs Learn to create, start and monitor test sessions

Office of Accountability Research, Evaluation & Assessment 49 Go to Pearson Access ‘Resources’, ‘Pearson Training’ Test Monitor Certification Training Course

Office of Accountability Research, Evaluation & Assessment 50 Test Security Nondisclosure Agreement Test items New Security Measures for

Office of Accountability Research, Evaluation & Assessment 51 Test Security Policies Nondisclosure Agreement – Everyone with secure access to Pearson must complete the Nondisclosure Agreement. – Test Monitors & data entry personnel must accept the agreement in PearsonAccess or they will not be able to monitor tests or enter student responses. – Everyone with access to the test items must sign the Nondisclosure Agreement. – Anyone who may come in contact with or see test items, can be asked by a student about an item or handle test materials must sign a Nondisclosure Agreement. – Paper Nondisclosure Agreement available here on REA website:

Office of Accountability Research, Evaluation & Assessment 52 Test Security Policies cont. All Test Items are secure – Discussions of items are not allowed with students and co-workers. – Test items and student tests are not allowed to be reviewed by teachers or building staff. – Test items may not be reproduced in any form or by anyone. – Cell phone cameras are not allowed. – s or discussions in on-line social media are not allowed.

Office of Accountability Research, Evaluation & Assessment 53 Security Measures for Tip Line MDE has launched a Test Security Tip Line. Educators, parents, students and others can report suspected incidents of cheating, improper or unethical behavior on any Statewide assessments. Links to the Test Security Tip Line are available in two places on the MDE web site. ˗ View the Test Administration page (MDE>School Support>Test Administration) ˗ View the Testing Information page (MDE>Just for Parents> Testing Information)

Office of Accountability Research, Evaluation & Assessment 54 Site Visit Checklist

Office of Accountability Research, Evaluation & Assessment 55 PEARSON ickLink/PearsonAccess SAC’s site for all assessment tasks Help Desk Phone: Monday – Friday 7:00 am – 6:00 pm (CST) MDE REA Test Coordinator Site Contact Information Robin Lane Office; Cell: Michael Wirtz Office: Cell: