Wisconsin Knowledge & Concepts Examination (WKCE) Test Security Wisconsin Department of Public Instruction Office of Educational Accountability 06/26/2013

Purpose of this Training To emphasize the importance of test security To emphasize the importance of test security To ensure the standardized administration of the tests To ensure the standardized administration of the tests To make sure that there is not an unfair advantage to some students To make sure that there is not an unfair advantage to some students To improve the overall understanding of test security procedures To improve the overall understanding of test security procedures

Test Security The primary goal of WKCE test security is to protect the integrity of the examinations by Securing the test materials at all times Securing the test materials at all times Ensuring appropriate administration of the test Ensuring appropriate administration of the test

Consequences of Test Security Violations When the security of an item is breached, this may result in making the item unusable in future tests. The state then incurs additional costs associated with item development, which is already a very expensive process. When the security of an item is breached, this may result in making the item unusable in future tests. The state then incurs additional costs associated with item development, which is already a very expensive process. An unfair advantage may be provided to some students, making it difficult to draw meaningful conclusions about their performance. An unfair advantage may be provided to some students, making it difficult to draw meaningful conclusions about their performance.

Consequences of Test Security Violations Invalidation of test results for individual students or groups of students. Invalidation of test results for individual students or groups of students. This will result in  Parents receive no scores on their child’s report if a test is invalidated  Public reporting will reflect all invalidated tests as “not tested”. This may reduce the percentage of students meeting proficiency.  Schools may have a more difficult time meeting the accountability requirements as a result.

Stages of Test Administration During Which Test Security Must be Ensured Prior to testing Prior to testing During testing During testing After testing After testing During Item Analysis /data retreats During Item Analysis /data retreats

Prior to Testing District Assessment Coordinators (DACs) District Assessment Coordinators (DACs) – –Read the Test Security Manual, District/School Assessment Coordinators Guide (DAC Guide), Test Administration Manual (TAM), and the Accommodations Guidelines – –Sign the confidentiality agreement form and send it to DPI – –Collect signed & completed confidentiality agreement forms from School Assessment Coordinators (SACs) and other appropriate district staff who will be working with the assessment – –Make sure that SACs and other district staff are aware of the importance of the test security – –Train SACs and appropriate district staff on test administration and test security procedures

Prior to Testing District Assessment Coordinators (DACs) District Assessment Coordinators (DACs) – –Inventory & secure all test materials immediately after receipt – –Send the test materials to the SACs in a secure manner – –Ensure SACs inventory test materials immediately after receipt – –Ensure test materials are locked and securely stored in a single location at the central district office or at a school – –Ensure proctors are trained on standardized test administration to help monitor testing – –Ensure SACs arrange for proctors to monitor students

List of Responsibilities at DAC Level – –Monitor each school’s testing schedule. Make sure that the SAC takes appropriate measures to ensure that the each session is administered in one sitting. – –Ensure that students are supervised during testing sessions. – –Make sure that you have a local school board policy in place for handling the personnel issues relating to test security breaches and report to DPI/OSA. – –Report all testing irregularities to the Office of Student Assessment (OSA) via the Test Security Incident Report Form

Prior to Testing School Assessment Coordinators (SACs) School Assessment Coordinators (SACs) – –Read the Test Security Manual, District/School Assessment Coordinators Guide (DAC Guide), Test Administration Manual (TAM), and the Accommodations Guidelines – –Sign the confidentiality agreement form and send it to DAC which will be retained at the district level. – –Collect confidentiality agreement forms from appropriate school staff and test administrators/proctors who will be working with the assessments – –Inventory all test materials immediately after receipt from DAC – –Provide training to appropriate school staff and proctors – –Arrange for more proctors to help monitor testing

List of Responsibilities at SAC Level Ensure test materials are locked and securely stored in a single location Monitor security of test booklet before, during and after assessment Monitor security of test booklet before, during and after assessment Ensure the teacher or test administrators have been informed of test security breaches Ensure the teacher or test administrators have been informed of test security breaches Follow district procedures for reporting test security Follow district procedures for reporting test security Monitor the standardization of test administration Monitor the standardization of test administration Report all testing irregularities to the district test coordinator Report all testing irregularities to the district test coordinator via the Test Security Incident Report form

During Testing DACs DACs – –Ensure test materials are locked and securely stored in a single location at the central district office or at a school –Supervise and, if necessary, help coordinate the schools’ daily handling and security of test materials.

During Testing DACs & SACs DACs & SACs –Ensure that students are supervised by trained proctors during testing sessions. (proctors are employed district staff including administrators, teachers, and paraprofessionals employed by the school or district, and may also include the student teachers who have responsibility for supervising students. Parent volunteers should not be allowed to proctor examinations) –Make sure that standardized test administration practices are followed –Each session in a content area should be administered in one sitting –Follow testing policies for electronic devices including calculators and cell phones. –Secure all tests daily

Calculator Policy The use of calculators varies by grade. There are clear directions for the use of calculators in the Test Administration Manual and the Policy Manual both of which can be accessed at The use of calculators varies by grade. There are clear directions for the use of calculators in the Test Administration Manual and the Policy Manual both of which can be accessed at It is important to review these policies carefully as inappropriate use of calculators during test administration may result in invalidation of test results. It is important to review these policies carefully as inappropriate use of calculators during test administration may result in invalidation of test results.

Appropriate Use of Test Accommodations For use of allowable accommodations, please refer to the assessment matrix available at For use of allowable accommodations, please refer to the assessment matrix available at In the event that an accommodation is not on the matrix but necessary for a student to demonstrate their knowledge & skills in a content area, a non-standard accommodations request form should be submitted to DPI for consideration. This form is available at In the event that an accommodation is not on the matrix but necessary for a student to demonstrate their knowledge & skills in a content area, a non-standard accommodations request form should be submitted to DPI for consideration. This form is available at  If DPI agrees that the requested accommodation does not affect the validity of the test, it will be approved.  If it does impact test validity, the school may use the accommodation but the student will be counted as “not tested”.

After Testing After testing, all test books—those to be scored and those not to be scored—are to be returned to CTB After testing, all test books—those to be scored and those not to be scored—are to be returned to CTB Missing test materials should be reported to DPI immediately Missing test materials should be reported to DPI immediately

Test Book Retention All test books must be returned to the testing vendor after testing All test books must be returned to the testing vendor after testing Test books are no longer allowed to be retained in schools / districts Test books are no longer allowed to be retained in schools / districts A copy of the test book at each grade level will be kept at each CESA to meet the Public Access statutory requirement only A copy of the test book at each grade level will be kept at each CESA to meet the Public Access statutory requirement only

Data Retreats WKCE Item Analysis Reports are available in the secure Online Reporting Site (ORS) WKCE Item Analysis Reports are available in the secure Online Reporting Site (ORS) All DACs have passwords for this secure website All DACs have passwords for this secure website Data retreats should be conducted using these reports Data retreats should be conducted using these reports Test books / Items must not be used during data retreats Test books / Items must not be used during data retreats

Handling Confidentiality Agreement Forms DAC - Send DAC signed form to DPI SAC - Send SAC signed form to DAC (Forms retained at the district level) Proctors, Teachers, and any school staff handling the test materials - Send signed forms to the SAC (Copies retained at the school level) DPI

List of Responsibilities at Proctor Level Read the Test Security Manual, and the Accommodations Guidelines Read the Test Security Manual, and the Accommodations Guidelines Read and follow the directions as stated in the Test Administrator’s Manual Read and follow the directions as stated in the Test Administrator’s Manual View the Test Security PowerPoint Training for Proctors View the Test Security PowerPoint Training for Proctors Attend WKCE test administration training session prior to each test administration year Attend WKCE test administration training session prior to each test administration year Review the Accommodation Guidelines Review the Accommodation Guidelines Remain in the room throughout the entire test administration Remain in the room throughout the entire test administration

List of Responsibilities at Proctor Level Follow the procedures established by the school assessment coordinator for returning all used and unused testing materials, blank paper, and supplemental materials Follow the procedures established by the school assessment coordinator for returning all used and unused testing materials, blank paper, and supplemental materials Report all testing irregularities to the school test coordinator such as Report all testing irregularities to the school test coordinator such as –Student going back to the previous session –Student cheating –Unallowable accommodations

Test Security Violations to Avoid Use of a non-allowed accommodation e.g. Reading the reading test. Use of a non-allowed accommodation e.g. Reading the reading test. Use of live test items for test preparation activities Use of live test items for test preparation activities Allowing the use of calculator for computation sections in Mathematics Allowing the use of calculator for computation sections in Mathematics

Reporting Test Security Violations Test Security violations / irregularities should be reported to DPI at Test Security violations / irregularities should be reported to DPI at Submit a completed Incident report Form to the office of Student Assessment Submit a completed Incident report Form to the office of Student Assessment Districts may be contacted to conduct further investigation Districts may be contacted to conduct further investigation Districts might choose additional consequences as related to personnel contracts / issues Districts might choose additional consequences as related to personnel contracts / issues

Process for Handling Test Security Violations Initial Report Alleging Specific Violation A test security violation is reported and received by the Department of Public Instruction from any individual, school, or district alleging that a specific breach in test security has occurred in an individual district or testing site via telephone, , or submission of the test security violation form. Initial Internal Review of Alleged Test Security Violation The Office of Student Assessment (OSA) reviews all reports brought to the team to determine how best to resolve the allegation by analyzing the severity of the alleged breach of test security and the scope of potential harm the breach may bring to the integrity of the assessment results. Telephone Assistance from OSA to the District Assessment Coordinator (DAC) Invalidation of Test ScoresLetter from Director of OSA No Violation Determined/No Consequences Districts may choose additional consequences regarding personnel issues.

For additional information, please contact