Presentation on theme: "Badger Exam Test Administration Overview Spring 2015."— Presentation transcript:
Badger Exam Test Administration Overview Spring 2015
P URPOSE This training is designed to Help Test Administrators/Proctors (TAs) administer the Badger Exam in a uniform manner Ensure similar testing conditions in all classrooms Ensure that the test will work validly and equitably for all students
T OPICS Badger Exam Timing and Scheduling Badger Exam Resources o Manuals o Trainings/Modules o Practice/Sample Items Proctor - Basic Requirement Responsibilities Accessibility Test Tickets Classroom Activity Responsibilities in TOMS Test Administration Monitoring Appeals Test Security Questions
B ADGER E XAM T EST T IMES AND S AMPLE S CHEDULES http://oea.dpi.wi.gov/sites/default/files/imce/oea/pdf/Badger%20Exam%20Sampl e%20Test%20Schedules.pdf Content Areas GradesSection 1 - ( multiple choice, short response & TE items) Classroom Activity Section 2 – (Performance Task items) Total Time ELA3-81:30N/A 1:30 Math3-51:30:301:003:00 Math6-82:00:301:003:30
B ADGER E XAM R ESOURCES Badger Exam Frequently Asked Questions: http://oea.dpi.wi.gov/assessment/Smarter/FAQ http://oea.dpi.wi.gov/assessment/Smarter/FAQ Badger Exam Web page: http://oea.dpi.wi.gov/assessment/Smarter http://oea.dpi.wi.gov/assessment/Smarter Badger Exam Assessment & Accountability web page: http://oea.dpi.wi.gov/assessment/Smarter/accommodations http://oea.dpi.wi.gov/assessment/Smarter/accommodations Badger Exam Guides & Manuals: DAC/SAC Guide, Test Administration Manual, Informational Brochure for Educators and Families, Classroom Activity Guidelines, and Proctor Guidelines http://oea.dpi.wi.gov/assessment/Smarter/resourceshttp://oea.dpi.wi.gov/assessment/Smarter/resources
B ADGER E XAM T RAINING M ODULES Accessibility and Accommodations Universal Tools Student Tutorial Students (This module should be shown to students in a classroom/group setting.) Student Interface Test Operations Management System (TOMS) Student and User Management Test Operations Management System (TOMS) Test Delivery Test Security Training http://oea.dpi.wi.gov/assessment/Smarter/trainings Proctors may also view the “What is a Performance Task” module for information on Performance Tasks
P RACTICE T ESTS Smarter Balanced Practice TestBadger Exam Practice Test Purpose A range of grade specific items Exposure to a range of item formats Exposure to a range of item difficulties Note: Interface differs from the Badger Exam Exposure to the software and interface features that mimics the testing engine for the Badger Exam Included universal tools, designated supports, and accommodations * Grade level Individual assessments in ELA and mathematics at each grade level, 3 – 8 2 assessments at the following grade spans o 3-5 o 6-8 Type of Items Approximately 30 items in ELA and 30 items in Mathematics per grade level 1 ELA PT and 1 mathematics PT per grade level Approximately 14 items per grade band (7 in ELA and 7 in Mathematics) Includes 1 ELA PT and 1 mathematics PT per grade band * Text-to-speech and Braille are available only when accessing the Badger Practice Test through the secure browser
B ADGER E XAM P RACTICE T EST Practice Test, Practice Test Quick Start Guide, Sample Classroom Activities, Performance Task Scoring guides are available at http://oea.dpi.wi.gov/assessment/Smarter/sampleitems
W HO CAN P ROCTOR THE B ADGER E XAM ? Test Administrators/Proctors (TAs) are trained staff (including administrators, teachers, and paraprofessionals) who are employed by the school or district. They may also include student teachers who normally have responsibility for supervising students. Parent volunteers should not be allowed to proctor the examination. School personnel who are parents or guardians should not be allowed to proctor their own children.
C ONFIDENTIALITY A GREEMENT F ORMS TA forms are available online in the TOMS system as electronic sign offs. The district and school staff forms are available as hard copy forms. Any district/school staff who have access to the test or reports (providing accommodations, setting up tests etc.) without access to TOMS do not sign the electronic confidentiality forms in TOMS. These individuals must sign hard copy confidentiality forms and submit the form to their DAC /SAC. http://oea.dpi.wi.gov/assessment/Smarter/security
P ROCTORS – G ETTING READY TO A DMINISTER THE BADGER E XAM Proctors should: read and become familiar with all appropriate Badger Exam publications view appropriate Badger Exam training modules become familiar with appropriate universal tools, designated supports, and accommodations read the Test Security Manual and view the Badger Exam Test Security Training
TA/P ROCTOR R ESPONSIBILITIES : participate in district/school trainings on policy and administration view student information in TOMS prior to testing to ensure accuracy of student settings including necessary designated supports and/or accommodations follow procedures included in the Test Administration Manual (TAM) to administer the Badger Exam monitor students during testing adhere to all test security administration policies
P ROCTOR C HECKLISTS Refer to the proctor checklists available in the Test Administration Manuals such as: Prior to Testing During Testing After Testing
O RGANIZE Y OUR C LASSROOM Remove or cover all instructional materials that might assist students in answering questions displayed on bulletin boards, chalkboards, dry- erase boards, or on charts (e.g., wall charts that contain literary definitions, maps, mathematics formulas, etc.) Ensure adequate spacing between students’ seating and/or visual barriers Place a “TESTING—DO NOT DISTURB” sign on the door of the testing room Provide a quiet environment void of distractions Establish procedures for students that finish testing ahead of others by either having the students exit the room quietly and report to another area, or work silently on designated activities at their workstation
P REPARE Y OUR S TUDENTS Inform students and have a sign in the testing room specifying that unauthorized electronic devices and cell phones are not allowed in the testing environment (this includes: cell phones, cameras, laptops, wireless communication devices, etc.)
C HECK Y OUR M ATERIALS Test Administration Manual (hard copy or online) “Testing – Do not Disturb” Sign “Unauthorized electronic devices and cell phones are not allowed in the testing environment” Sign Any assistive technology devices required by students to take the Badger Exam
A DDITIONAL M ATERIALS N EEDED FOR T ESTING Do I need headphones for all students? Yes. The ELA portion of the test has listening items that require headphones.
C REATE A P OSITIVE A TMOSPHERE Help students approach testing in a relaxed, positive way Reassure students they will have ample time to do their best Emphasize that scores will not affect their grades, it is only to find out which skills they have mastered and which need further development. Encourage students to attempt all items
A CCESSIBILITY AND A CCOMMODATIONS Positive and productive assessment experience Results that are fair and accurate
T ESTING A CCOMMODATIONS Assessment accommodations for students with disabilities should be documented and consistent with day-to-day instruction Designated supports for students should be documented and consistent with day-to-day instruction Check the TOMS Student Setting reports to ensure that all supports and accommodations are accurately coded prior to testing Ensure that the assistive technology works appropriately with the practice tests prior to testing Make sure that the non-embedded supports and accommodations are lined up for use during testing
B ADGER E XAM R EAD A LOUD F ORM The Smarter Consortium requires all staff providing read aloud accommodation to students for The Badger Exam to sign the Badger Exam Read Aloud Protocol - Agreement to Maintain Security & Confidentiality form. Signed forms shall be stored at the appropriate schools or districts Read Aloud Guidelines and Read Aloud forms are available in the Badger Exam Accommodations and Supports webpage http://oea.dpi.wi.gov/assessment/Smarter/accommodations http://oea.dpi.wi.gov/assessment/Smarter/accommodations Do I need to complete this form if I signed the confidentiality form? Yes, this form needs to be completed even if the Badger confidentiality form has been completed.
http://oea.dpi.wi.gov/assessment/Smarter/accommodations A CCESSIBILITY & A CCOMMODATIONS
T EST T ICKETS Test tickets are created in TOMS and provide each student with their login information (username, password, and session ID) To create test tickets o log in to TOMS and select the “Online Testing” tab o Using the grade level filters, select all students included in the test session o Select the appropriate test (Section 1 ELA, Section 2 ELA PT, Section 1 Mathematics, or Section 2 Mathematics PT) o Select the button to print tickets Test tickets include confidential information. Test tickets must be printed in a secure location and must be securely stored until the test administration. Similarly at the end of testing, test tickets must be shredded. Test Tickets will become available a week prior to the test window for printing.
T EST T ICKETS Important Reminder Ensure each student has their own Badger Exam Test Ticket Proctors should be diligently checking Tickets as they are passed out to students. Ask students to be sure they have the correct test ticket in front of them by checking the name on the ticket before they begin testing.
T EST T ICKETS Each student will need three test tickets, one ticket corresponding to each test (Section 1 ELA, Section 1 Mathematics, or Section 2 Mathematics PT.) For additional information on generating test sessions and printing test tickets, reference the TOMS Test Delivery Manual at http://oea.dpi.wi.gov/assessment/Smarter/resources. http://oea.dpi.wi.gov/assessment/Smarter/resources Who can print Test Tickets? DACs, DTCs, SACs, STCs, and TAs all have rights to print test tickets.
T EST T ICKETS Students will use the same test ticket every time they log into each test. For test security purposes, however, test tickets will become inactive 120 minutes after students log out of the test If the student attempts to log into the test more than 120 minutes after logging out, the test ticket will be inactive and the student will receive a login error To reactivate the test tickets, the TA must log into TOMS, select the student or group of students needing to continue testing, and select “continue testing” For additional information on test tickets, reference the TOMS Test Delivery Manual at http://oea.dpi.wi.gov/assessment/Smarter/resourceshttp://oea.dpi.wi.gov/assessment/Smarter/resources May students use test tickets as scratch paper? No, as scratch paper needs to be collected daily and disposed of tickets should not be used as scratch paper.
C LASSROOM A CTIVITY Classroom activities by schools and grades will be made available on the Badger Exam webpage during the second week of March. SACs will distribute Classroom Activity materials to TAs approximately 1 to 2 weeks prior to administration. The purpose of the Classroom Activity is to introduce students to the context of a performance task so all students enter the performance task with the same background information and are able to demonstrate the skills the task intends to assess. The Classroom Activity is designed to be an introduction and not an assessment. TAs should review the Classroom Activity and the Classroom Activity guidelines available in TAMs prior to administration. Classroom activities include directions associated with that specific classroom activity. The Classroom activity is not administered online.
C LASSROOM A CTIVITY When the PT is administered, content from the Classroom Activity should not be available (i.e., do not put any content from the Classroom Activity on the board, in handouts, etc.). Students may take notes during the Classroom Activity, but the notes may not be used during Section 2 PT. Notes must be collected before proceeding to the PT and stored in a secure location until securely shredded. Doing so will be considered a test security violation.
C LASSROOM A CTIVITY The Classroom Activity must be administered prior to the performance task. There should be no more than a three-day lapse between the Classroom Activity and Section 2 PT. The Classroom Activity is non secure; however, it should not be supplemented with any other content that the administrator may think is helpful. Consider the appropriate accommodations that should be provided to students in the class that would normally be provided during instruction. Reference the Accessibility Guidelines for Classroom Activities that contains information on what student resources can be provided during the Classroom Activity.
C LASSROOM A CTIVITY – M AKE - UP S ESSION In the event a student is absent during the Classroom Activity (CA), a make-up session must be scheduled. The TA may administer the classroom to the students who missed the CA in an one on one session or with a group of students who may have also missed the same CA. The Classroom Activity may be recorded and used for make ups.
S PECIFIC R ESPONSIBILITIES WITH TOMS confirm the accuracy of students test settings prior to testing generate testing sessions print test tickets that students will need during the login process monitor students’ testing progress
TOMS L OGIN All TAs will receive an automated e-mail from firstname.lastname@example.org with a username and temporary password to access TOMS email@example.com Temporary passwords will expire within 30 days. At a user’s first logon, they will be prompted to sign a test confidentiality agreement and change their password. TOMS login credentials will always be sent from firstname.lastname@example.org@ets.org. This e-mail address should be whitelisted to ensure that users receive login information.
C HECKING A CCESSIBILITY S ETTING IN TOMS Prior to testing TAs must confirm the accuracy of students’ test settings. If a TA identifies any errors in a student’s test settings, TAs must contact the School Assessment Coordinator (SAC) for remedy. Failure to provide the correct student settings may result in a test irregularity. To view test settings, TAs must log into TOMS. Under the “Students” tab, select “view & edit” and then the “accessibility resources” tab. For additional information about viewing students test settings reference the TOMS: User/ Student Management Manual at http://oea.dpi.wi.gov/assessment/Smarter.http://oea.dpi.wi.gov/assessment/Smarter
B EGIN THE T EST Students must use the secure browser to log on to take the Badger Exam TAs should verify that: External user applications are closed If student requires the use of an assistive technology device, student must access the assessment using the Assistive Technology Secure Browser.
L OG I N Log in process * 1.Launch Secure Browser 2.System check 3.Select test 4.Enter log in information 5.Sound check 6.Directions page 7.Presentation of first test item
S YSTEM C HECK Ensures that the device will function properly during the assessment. In the event that there is an issue, an error message will appear o Complete list of errors is available in the TAM Examples: Connectivity error, device specifications error TAs should contact district or school technology staff to help remedy errors.
S OUND C HECK Confirms functionality of sound Troubleshooting sound check Headphones plugged in Volume up on device Try other audio sources on the device such as CDs, audio files, etc.
D IRECTIONS P AGE Review of test rules o Pause feature o Reminder to review all questions prior to ending a test session Review of navigation features o Back & Next o Review/ End Review of universal tools Review of answering tools
P ROCTOR R OLE D URING T EST A DMINISTRATION Remain in the room throughout the entire test administration and periodically walk around the room to: Ensure that students are not using any prohibited electronic devices Monitor student progress Make sure that the students are on task Answer questions about technology only (how do I access the calculator), not content. Remind students to check their test for any items marked for review or not attempted prior to taking a long break or logging out for the day. (Proctors should not check student answers. To do so would be considered a security violation.)
M ONITORING S TUDENT P ROGRESS During testing TAs/Proctors may login to TOMS to view student progress. Information will be available about how many students are: Complete In Progress Inactive More information will be available in the TOMS Test Delivery Manual.
M AKE -U PS TOMS allows for tracking of students who are tested and not tested. Any student who misses should be given every opportunity to complete the exam. If the district completes testing of their students and a new student moves in, that student must be given the opportunity to take or complete the Badger Exam. All testing must be completed by the close of the testing window.
A PPEALS Some situations may result in the need to reopen or invalidate individual student assessments. When this happens the DAC must submit an appeal through TOMs. Submitted in TOMS by DACs Reviewed by DPI Resolutions emailed via TOMS Scenarios that may warrant an appeal Test security breach Student was ill and unable to complete Section 2 PT within 10 days. Section 2 expired. Student began Section 1 with incorrect test settings.
I NVALIDATION Requested as a result of Test security breaches Student deliberately does not attempt to respond to questions If approved Test will not be scored Student will not count as a test participant Entire content area will be invalidated Invalidated test can not be restored A Test Security Incident Report Form must also be completed and submitted to DPI.
R EOPEN Requested as a result of Expiration of a test resulting from one of the following situations o technology difficulty o unanticipated excused absence o accidentally submitting test If approved PT will remain open for 10 calendar days from the date the appeal was approved If test is expired – Test opens where student left off If test was submitted – Test opens at the last page of the test; student can review items in the current segment, but cannot return to previous segments
W HO IS R ESPONSIBLE FOR T EST S ECURITY ? Everyone who works with the assessments, communicates test results, and/or receives testing information. This includes: DPI staff District Administrators (Das) DACs SACs DTCs STCs TA/Proctors Students, parents, and the community Certified and non-certified public school staff CESA staff
T EST S ECURITY The security of the assessment and the confidentiality of student information are vital to maintain the validity, reliability, and fairness of the results. All Badger Exam items are secure and must be appropriately handled. Secure handling protects the integrity, validity, and confidentiality of assessment items, prompts, and student information. Any irregularity, impropriety, or breach in test administration must be reported to DPI as a test security incident. If the reliability or validity of a test is compromised, the test scores of individual students or entire classes may be invalidated, and other disciplinary actions may be taken. For more information on test security, please refer to the Test Security Manual at http://oea.dpi.wi.gov/assessment/Smarter/securityhttp://oea.dpi.wi.gov/assessment/Smarter/security
T EST S ECURITY Consequences of violations may include invalidation of student test results and could result in civil legal liability for copyright violations. At either the school or school district level, a test violation could result in the loss of a year’s test results for the grade(s) and subject(s) affected by the test irregularity. There will be no opportunity to retest. When test results are invalidated, the student(s) do not receive test results for those content areas.
T EST S ECURITY Students must not take any notes, scratch papers or any information from their classroom activity to the performance task testing event. TAs must not take any charts or posters used during the classroom activity for PT administration. Doing so will be considered a test security violation.
R ETENTION OF P RINTED M ATERIALS OR S CRATCH P APER All scratch paper, graph paper, or printed test items/passages (for students receiving the print on demand accommodation) must be collected and inventoried at the end of each test session and then immediately shredded. The only exception to shredding printed materials and scratch paper is when notes are used during Section 2 Mathematics PT. For specific information regarding this refer to the TAMs (page 16.)
T EST S ECURITY M ANUAL Test Security Manual is available on the Badger Exam test security webpage http://oea.dpi.wi.gov/assessment/Smarter/security http://oea.dpi.wi.gov/assessment/Smarter/security General principles and operational standards for administration of assessments Pre and post-test activities and procedures to follow during testing
T EST S ECURITY T RAINING The Office of Student Assessment (OSA) has developed a Badger Exam test security training which is available at http://oea.dpi.wi.gov/assessment/Smarter/securityhttp://oea.dpi.wi.gov/assessment/Smarter/security