2. Wisconsin Knowledge & Concepts Examination (WKCE) Test Security Training for Proctors Wisconsin Department of Public Instruction Office of Educational Accountability 10/07/2011

3. Purpose of this Training To emphasize the importance of test security To emphasize the importance of test security To ensure the standardized administration of the tests To ensure the standardized administration of the tests To make sure that there is not an unfair advantage to some students To make sure that there is not an unfair advantage to some students To improve the overall understanding of test security procedures To improve the overall understanding of test security procedures

4. Test Security The primary goal of WKCE test security is to protect the integrity of the examinations through: Securing the test materials at all times Securing the test materials at all times Ensuring appropriate administration of the test Ensuring appropriate administration of the test

5. Consequences of Test Security Violations When the security of an item is breached, this may result in making the item unusable in future tests. The state then incurs additional costs associated with item development, which is already a very expensive process. When the security of an item is breached, this may result in making the item unusable in future tests. The state then incurs additional costs associated with item development, which is already a very expensive process. An unfair advantage may be provided to some students, making it difficult to draw meaningful conclusions about their performance. An unfair advantage may be provided to some students, making it difficult to draw meaningful conclusions about their performance.

6. Consequences of Test Security Violations Invalidation of test results for individual students or groups of students. Invalidation of test results for individual students or groups of students. This will result in Parents receive no scores on their childs report if a test is invalidated Parents receive no scores on their childs report if a test is invalidated Public reporting on WINSS will reflect all invalidated tests as not tested. This may reduce the percentage of students meeting proficiency. Public reporting on WINSS will reflect all invalidated tests as not tested. This may reduce the percentage of students meeting proficiency. Schools may have a more difficult time meeting Adequate yearly progress (AYP) indicators as a result. Schools may have a more difficult time meeting Adequate yearly progress (AYP) indicators as a result.

7. Stages of Test Administration During Which Test Security Must be Ensured Prior to testing Prior to testing During testing During testing After testing After testing During Item Analysis /data retreats During Item Analysis /data retreats

8. List of Responsibilities at Proctor Level Attend WKCE test administration training session prior to each test administration Attend WKCE test administration training session prior to each test administration Sign confidentiality form and return to school assessment coordinator Sign confidentiality form and return to school assessment coordinator Ensure that test materials are in locked and secure location before and after each testing session Ensure that test materials are in locked and secure location before and after each testing session Remain in the room throughout the entire test administration Remain in the room throughout the entire test administration Read and follow the directions as stated in the Test Administrators Manual Read and follow the directions as stated in the Test Administrators Manual

9. List of Responsibilities at Proctor Level Report all testing irregularities to the school assessment coordinator such as Report all testing irregularities to the school assessment coordinator such as –Student going back to the previous session –Student cheating –Unallowable accommodations Do not copy, alter/modify items (i.e photocopying student writing samples) Do not copy, alter/modify items (i.e photocopying student writing samples) Follow testing policies for electronic devices including calculators and cell phones Follow testing policies for electronic devices including calculators and cell phones

10. Calculator Policy The use of calculators varies by grade. There are clear directions for the use of calculators in the Test Administration Manual and the Policy Manual both of which can be accessed at http://dpi.wi.gov/oea/publications.html. The use of calculators varies by grade. There are clear directions for the use of calculators in the Test Administration Manual and the Policy Manual both of which can be accessed at http://dpi.wi.gov/oea/publications.html. http://dpi.wi.gov/oea/publications.html It is important to review these policies carefully as inappropriate use of calculators during test administration may result in invalidation of test results. It is important to review these policies carefully as inappropriate use of calculators during test administration may result in invalidation of test results.

11. Appropriate Use of Test Accommodations For use of allowable accommodations, please refer to the assessment matrix available at For use of allowable accommodations, please refer to the assessment matrix available at http://dpi.wi.gov/oea/accommtrx.html In the event that an accommodation is not on the matrix but necessary for a student to demonstrate their knowledge & skills in a content area, a non-standard accommodations request form should be submitted to DPI for consideration. This form is available at http://www.dpi.wi.gov/oea/dacforms.html In the event that an accommodation is not on the matrix but necessary for a student to demonstrate their knowledge & skills in a content area, a non-standard accommodations request form should be submitted to DPI for consideration. This form is available at http://www.dpi.wi.gov/oea/dacforms.html http://www.dpi.wi.gov/oea/dacforms.html –If DPI agrees that the requested accommodation does not affect the validity of the test, it will be approved. –If it does impact test validity, the school may use the accommodation but the student will be counted as not tested.

12. After Testing After testing, all test booksthose to be scored and those not to be scored are to be returned to the school assessment coordinator After testing, all test booksthose to be scored and those not to be scored are to be returned to the school assessment coordinator –Follow the procedures established by the school assessment coordinator for returning all used and unused testing materials, blank paper, and supplemental materials

13. List of Common Errors – Test Security Violations to Avoid Use of a non-allowed accommodation e.g. Reading the reading test. Use of a non-allowed accommodation e.g. Reading the reading test. Use of live test items for test preparation activities Use of live test items for test preparation activities Allowing the use of calculator for computation sections in Mathematics Allowing the use of calculator for computation sections in Mathematics

14. Reporting Test Security Violations Test Security violations / irregularities should be reported to DPI at 608-267-1072 Test Security violations / irregularities should be reported to DPI at 608-267-1072 Districts may be contacted to conduct further investigation Districts may be contacted to conduct further investigation Districts might choose additional consequences as related to personnel contracts / issues Districts might choose additional consequences as related to personnel contracts / issues

15. Process for Handling Test Security Violations INITIAL REPORT ALLEGING A SPECIFIC VIOLATION A test security violation is reported and received by the Department from any individual or school or district alleging that a specific breach in test security has occurred in an individual district or testing site. INITIAL INTERNAL REVIEW OF POTENTIAL TEST SECURITY IRREGULARITY The DPI Internal Test Security Review Team reviews all reports brought to the team to determine how best to resolve the allegation by analyzing the severity of the alleged breach of test security and the scope of potential harm the breach may bring to the integrity of assessment results. Telephone assistance from OEA to the DAC. Invalidation of test scores Letter from the director of OEA Approval / no consequences Districts may choose additional consequences related to personnel contracts / issues.

16. For additional information, please contact oeamail@dpi.wi.govoeamail@dpi.wi.gov