Classroom Diagnostic Tools Test Coordinator Training 2012-2013 Pennsylvania Department of Education Data Recognition Corporation https://pa.drcedirect.com Fall 2012

Agenda Overview Review Key Dates Roles and Responsibilities Online Administration Interactive Reports Fall 2012

CDT Overview Available to students in grades 6 through high school The Pennsylvania Classroom Diagnostic Tools (CDT) is a set of online tools designed to provide diagnostic information in order to guide instruction and provide support to students and teachers. Available to students in grades 6 through high school Online assessments delivered in a Computer Adaptive Test (CAT) format Multiple-choice items Multiple assessments per year Real-time reporting Reports dynamically linked to curriculum resources in SAS Fall 2012

CDT Overview cont. Assesses content in Math, Science, and Literacy (Reading and Writing) Multiple-Choice (MC) items Single assessment consists of 50-60 items and can be completed in 45-90 minutes. Test ticket can be Reset next day to allow students to finish next day Student should be assigned to an assessment based on course/grade enrollment in the 2012-2013 school year Fall 2012

Fall 2012 Key Dates Key Dates Description Date Available 8/20/2012 PA Online Assessment Software (LCS update included) 8/20/2012 CDT User Guide (electronically) PA eDIRECT Test Setup System (Science, Mathematics, Reading, and Writing) 8/27/2012 1/28/2013 Fall 2012

Available Assessments CDT Assessment Dates Available Assessments Available Mathematics Algebra I Geometry Algebra II August 27, 2012 Literacy Reading/Literature Writing/English Composition Science Biology Chemistry CDT Reports Interactive Reports – All Assessments Fall 2012

Roles and Responsibilities District Test Coordinator (DTC) Responsibilities 1. Attend DRC WebEx Test Coordinator training. 2. Review CDT User Guide. 3. Create and distribute communication plan to all STCs prior to testing. 4. Assist in the coordination of software installation; review tutorials and Online Tools Training. 5. Verify/set up eDIRECT accounts for STCs. 6. Provide training and support to STCs. 7. Coordinate the management of Student, Teacher, and Student Group data in the Test Setup system. 8. Review Technology Readiness Checklist and coordinate with technology personnel. Fall 2012

Roles and Responsibilities School Test Coordinator (STC) Responsibilities 1. Attend DRC WebEx Test Coordinator training. 2. Review User Guide. 3. Assist in the coordination of software installation, review tutorials and Online Tools Training. 4. Verify/set up eDIRECT accounts for Test Administrators/Teachers. 5. Provide training and support to Test Administrators/Teachers. 6. Assist DTC in the management of student data in eDIRECT Test Setup system. 7. Manage Teacher and Student Group data in eDIRECT Test Setup system. Fall 2012

Roles and Responsibilities Teacher Responsibilities 1. Have school or district test coordinator set-up eDIRECT account for you (if don’t already have one). 2. Contact school or district test coordinator if you have issues with eDIRECT (before contacting PA customer service). 3. Attend DRC WebEx Teacher training. 4. Review CDT User Guide. 5. Review tutorials and Online Tools Training (OTT). 7. Print Student Login Ticket (Test Tickets). a. Distribute tickets to students. 8. Oversee and monitor Test Sessions. Fall 2012

Roles and Responsibilities Test Administrator Responsibilities Become familiar with the CDT User Guide, the PA Online Assessment application and Test Setup system Print, or obtain Student Login Tickets (Test Tickets) from the teacher, on the day the test session is scheduled . Review, and verify, that student information is correct on the Student Login Rosters. Alert the STC if any student information is incorrect and needs to be changed. Distribute the Test Tickets to the students at the time of the test. Monitor the testing environment during the scheduled testing time. Notify the teacher if any of the students testing were unable to complete the assessment in the scheduled time. Coordinate with the teacher to reset Student Login Tickets if a student has to access an incomplete assessment more than one (1) day after the student started the assessment (the teacher approves the student to continue testing). Collect, account for, and return all Test Tickets, as well as scratch/grid paper, to the teacher. Fall 2012

Online Administration System Overview Before Testing – Preparation During Testing – Monitoring After Testing – Closeout Fall 2012

System Overview Web Browser Student Machine PA Online Assessments PA eDIRECT PA Online Assessments Student Interface Test Setup System PA Online Tutorials = Used by DTC, STC, Teacher/Test Administrator = Used by Student Fall 2012

Before Testing – Preparation Step 1: Prepare for Testing Step 2: Administer Test Tutorials Step 3: Administer Online Tools Training Step 4: Access Test Setup Step 5: Complete Test Setup Tasks Add or edit Teacher and Student Data Create Student Groups and Test Sessions Print Student Login Tickets (Test Tickets) Step 6: Distribute Student Login Tickets Fall 2012

Step 1: Prepare for Testing Coordinate the installation of the PA Online Assessment software on all computers to be used for testing* Review User Guide, Tutorials, and Online Tools Training Confirm that all those participating in the CDT administration have either attended training or reviewed the training materials and User Guide *Automatic updates are done on computers previously used for testing Fall 2012

Step 2: Administer Tutorials Students will become familiar with the PA Online Assessment software Ensure students view the tutorials specific to the subject in which they are participating prior to testing Allow a minimum of 20 minutes to view Tutorials can be reviewed as often as needed DTCs, STCs, and Teachers should view Tutorials prior to administering assessments Fall 2012

PA Online Assessment Tutorials Access by double-clicking PA Online Tutorials icon on computer desktop or from the eDIRECT website Fall 2012

Step 3: Administer Online Tools Training Students can practice using the online tools and become familiar with functionality of the software Schedule time for students to take the Online Tools Training (OTT) prior to testing One OTT for each program and subject DTCs, STCs, and Teachers should use OTT prior to administering an assessment Allow 15 minutes to take a single OTT Fall 2012

Online Tools Training Access by double-clicking PA Online Assessments icon on computer desktop Fall 2012

Step 4: Access Test Setup System Test Setup System is accessed via PA eDIRECT Web-based system Requires PA eDIRECT account and Test Setup permissions https://pa.drcedirect.com Fall 2012

PA eDIRECT New User Log on to PA eDIRECT Select User Administration under Manage Users menu Click on Add Single User tab Enter all the required information DTCs = District User Role District Technology Coordinator = District Technology Coordinator User Role STCs = School User Role Teacher = Teacher User Role Test Proctor = Test Administrator Assign the permissions Note: Reference eDIRECT User Administration Guide Click Save Fall 2012

PA eDIRECT New User System-generated email will be sent with temporary password. Temporary password is valid for ten (10) days. Test Setup will be available August 20, 2012 for All Assessments. DRC Customer Service will update all District eDIRECT accounts to grant access to the new CDT administration. District users are responsible for updating all STC accounts to include the new CDT administration. School users are responsible for updating all Teacher accounts to include the new CDT administration. Fall 2012

PA eDIRECT User Permissions User guide Page 12 Permission User Role District Technology Coordinator DTC STC Teacher TA User Administration X Documents View Online Testing –Secured Resources Test Setup (see User Guide Permissions table for detailed information) Fall 2012

PA eDIRECT Update Permissions Log on to PA eDIRECT Select User Administration under Manage Users menu Click on Edit User tab Click Find User button Click Profiles tab Fall 2012

PA eDIRECT Update Permissions cont. Select all users to be updated Click Assign Permissions button Assign the required permissions Click Save Fall 2012

PA eDIRECT Test Setup Access Log on to PA eDIRECT Select Test Setup Fall 2012

Step 5: Complete Test Setup Tasks Verify Student data is in the system prior to testing Verify Teachers are in the system Teacher are required to have both an eDIRECT account and exist in the Test Setup Teacher list with matching emails to access Test Setup and the Interactive Reports Create Student Groups Create Test Sessions for all the students testing Review and print Student Login Tickets (Test Tickets) Note: System is pre-loaded with student and teacher data previously provided to PIMS. If student and teacher data is missing please utilize the Student and Teacher file upload functionality. Fall 2012

Step 5A: Verify Student Data Select Administration Select School Enter any other search options Click Find Students *search results can be exported to Excel or a complete file can be exported that includes all students in either the school or district Fall 2012

Step 5A: Add Students – Manual Entry Select Administration Click Add Student (bottom of page) Enter all required fields Click Save or Save & Add Another Fall 2012

Step 5A: Add Student – Error Messages PAsecureID invalid PAsecureID already exists Student is in the system, but might be registered at a different school Error message in eDIRECT will indicate what site the PAsecureID already exists for System does not allow duplicate IDs Student can be moved by using the upload, updating PIMS and waiting for the next PIMS CDT Test Setup update. Fall 2012

Step 5A: Add Students – Upload File Select Upload Multiple Students tab Select Administration View File Layout and Sample File Create Student file Click Browse Select Student file Click Upload Fall 2012

Step 5A: Edit Students Find student Select View/Edit icon Update information Student details or Accommodations Click Save Fall 2012

Step 5A: Manage Students – Accommodations Edit student information to include Audio or Color Chooser Accommodation prior to testing Fall 2012

Step 5B: Verify and Update Teachers Select Administration Select School Click Find Teachers Fall 2012

Step 5B: Add Teacher Select Administration Select School Click Add Teacher Enter all required fields Click on Save or Save & Add Another Fall 2012

Step 5B: Edit Teacher Find Teacher Select View/Edit icon Update information Click Save Fall 2012

Step 5B: Edit Teacher – Content Area Can edit content area for Teacher from Edit Teacher screen. This can be accessed from Edit Teacher screen. Fall 2012

Step 5C: Add (create) Student Group Click Student Groups under Test Setup Select Administration and click on Find Student Groups Click on Add Student Group (bottom of screen) Fill in required information Click on Save, Save & Add Another or Save & Add to Session Fall 2012

Step 5C: Student Groups – View/Edit To add or remove students from the Student Group, click View/Edit icon Click on arrows to add or remove students as needed Click Save Fall 2012

Step 5D: Create Test Sessions Select Test Sessions Select Administration Click Show Sessions Click Add Sessions Enter required information Click Find Students to search Move students from Available Students box to Students in Session box Click Save or Save & Add Another Fall 2012

Step 5D: Edit/Delete Test Sessions Select Test Sessions Select Administration Click Show Sessions To edit, select View/Edit icon To delete, select Delete icon Note: Only Test Sessions with all students “Not Started” can be deleted Fall 2012

Step 5E: Print Student Login Tickets Find Test Session Select Edit/Print icon Click Print All Tickets to print all the test tickets in the session Click Print Selected Students to print only selected test tickets in the session Fall 2012

Step 6: Distribute Student Test Login Tickets Day of Testing – provide ticket to TAs/Teachers Student Login Summary, Student Login Roster, and Student Login Tickets Update student data and reprint test tickets as needed upon request by TAs Fall 2012

During Testing – Monitoring Monitor student testing Reset tickets Test Inactivity Pausing and exiting the test Loss of Internet connectivity Fall 2012

Monitor Student Testing Status Summary Status of all Test Sessions Total number of students: Not Started In Progress Submitted Completed Fall 2012

Monitor Student Testing Testing Status Edit/Print page Detailed summary of individual student status Status = Not started, Locked, Submitted, Completed, and In progress. Time Started, Time Completed, Action (Invalidate or Reset) Fall 2012

Reset Test Select Test Sessions under Test Setup Select Administration, District, and School Click Show Sessions and click Edit/Print Select tickets to reset and click on Reset Selected or Reset All CDT available assessment CANNOT be reset once status is Completed Fall 2012

Unlock Test Sessions Unlocking Test Sessions allows a user to reset any student with a ‘Locked’ status without opening each test session. Fall 2012

During Testing – Test Inactivity If no computer mouse movement or keyboard use is detected for more than 20 minutes the student will be exited from the test and they will need to sign back into the test All answers will be saved Fall 2012

During Testing – Pausing and Exiting the Test If a student must leave their computer for a brief break (e.g., restroom) the student should Pause the test When the student returns he/she will select “Resume the Test” If the test is paused for more than 20 minutes the student will be exited from the test and they will need to sign back into the test All answers will be saved Fall 2012

Loss of Internet Connectivity Connectivity required for Login Student responses are regularly saved to DRC servers throughout testing CDT requires internet connectivity to test Once connectivity regained, the student can resume testing Fall 2012

After Testing – Closeout Step 1: Collect Materials Step 2: Mark Invalidations Fall 2012

Step 1: Collect Materials TA/Teacher must return all Student Login tickets and scratch paper to the STC STC or Teacher will destroy the documents to ensure that secure data is not compromised Fall 2012

Step 2: Mark Invalidations A DTC or STC can mark a test as invalid if a TA reports the following: Student cheating Test security violation Improper test administration Student illness or Teacher suspicion that the student did not give their best effort during testing and the score is not representative of the student’s true ability Fall 2012

Step 2: Mark Invalidations Find Test Session Click Edit/Print icon Click Invalidate icon next to the student Fall 2012

Accessing and Viewing Reports Select Interactive Reports under Reporting Tools Select all required information (red asterisk) Students MUST be part of a Student Group for results to appear Click Continue Fall 2012

Select Map Configuration Select the appropriate Content Area and Map Configuration Scroll down to view the results Fall 2012

Step 7: Access Reports cont. In Student Diagnostic Maps screen have access to: Group Map Individual Map Individual Learning Progression Map Group Learning Progression Map Fall 2012

DRC Pennsylvania Customer Service Team Contact Information DRC Pennsylvania Customer Service Team Phone: 1-888-551-6935 Fax: 763-268-2567 Email: PAcustomerservice@datarecognitioncorp.com Fall 2012

Questions? Fall 2012