Test Security Ryan Kuykendall April 19, 2011 February 1-3, 2011 © MDE - Test Security 1

February 1-3, 2011 © MDE - Test Security 2 Test Audits At least one school from every school district will be audited each year. Some districts may be audited several times in a school year. Test audits are conducted to observe the following: storage and distribution of secure materials, distribution and preparation for test, adequacy of the testing environment, process and procedures for the test administration, inventory and return of materials, and any other relevant occurrences.

February ©MDE - Test Security 3 Test Audits Training All auditors receive training before they are sent on site visits. Mississippi Public School Accountability Standards 2010, Appendix F is available on the web at:

February 1-3, 2011 © MDE - Test Security 4 Problems During Testing 1.Unsigned or out-of-date School Test Security Plan 2.Two people not present at all times (before, during, or after testing with secure materials); MDE auditor is not considered as one of the two people 3.Test administrator and proctor sitting and not actively monitoring entire room during test 4.Proctor leaving room during test, leaving only one person in the room 5.Staff members breaking the seal on test booklets

February 1-3, 2011 © MDE - Test Security 5 Problems During Testing 6.Testing with no hall monitors 7.Not testing according to the published test schedule 8.Subject-relevant charts on the wall 9.Using non-allowable accommodations 10.Not providing allowable accommodations 11.Coaching students (including strategic throat clearing) 12.Attempting to make a list of questions from the test

February 1-3, 2011 © MDE - Test Security 6 Problems During Testing 13.Reading ahead or reading the test and answering the questions on the test (This is a violation of Appendix F!) 14.Students not issued the correct test form (For example, Johnny Smith is issued a pre- ID answer document for Joseph Jones.) 15.Changing or altering answers after the test

February 1-3, 2011 © MDE - Test Security 7 Problems During Testing 16.Duplicate answers by two or more students 17.Students seated too close to each other (This situation also leads to issues when districts are responding to an OSA-mandated investigation!) 18.Improper storage of test materials 19.Too many students under one test administrator and proctor (recommended ratio is 25 to 2)

Problems During Testing Teacher student ratio: 27 students=1 test administrator 1 proctor students=1 test administrator 2 proctors students=1 test administrator 3 proctor You must add an additional proctor for every 10 for students over 27 February 1-3, 2011 © MDE - Test Security 8

February 1-3, 2011 © MDE - Test Security 9 Problems During Testing 20.Staff not adhering to test security procedures 21.School staff handing out scratch paper with answers, formulas, or anything else written on them 22.School staff not verifying the correct number of test booklets needed for test administration prior to the day of testing 23.Secure test materials reproduced and distributed to school staff (At least one person surrendered a teaching license for violations that took place in )

February 1-3, 2011 © MDE - Test Security 10 Security Breech Consequences The district attorney may investigate allegations of violations of test security on his own initiative following receipt of allegations, at the request of a school district, or at the request of the Mississippi Department of Education. The Commission on Educator Licensure has the authority to revoke license pursuant to the authority granted in Section , Mississippi Code of 1972, as amended.

February 1-3, 2011 © MDE - Test Security 11 When districts are asked to investigate---- Our request for an investigation of the statistical inconsistencies does not ask you to prove that a testing violation did occur; rather, we ask for evidence that provides certainty that an irregularity did not occur. Generally, the DTC will always lead any investigation regarding testing irregularities. Superintendents should notify OSA if they intend to appoint someone else to investigate a possible testing irregularity.

February 1-3, 2011 © MDE - Test Security 12 Caveon The MDE currently uses a VERY conservative approach to Caveon analysis and investigates only when results exceeded a 1 in 10,000,000,000,000,000,000 (10 to the 19 th power or a threshold/collusion index of 20 or 10 Quintillion) the statistical probability. Please understand that such a staggering statistic cannot be explained by statements from the test administrator and /or proctor that one or both did not see/notice anything unusual.

February 1-3, 2011 © MDE - Test Security 13 VERY IMPORTANT REMINDER Process Standard from the Mississippi Public School Accountability Standards, 2010 states that the school district employ an appropriately licensed full-time principal at each school. {MS Code , , and (c)} {Full time means no other assigned school districts duties such as Coaching, Head Coach, Director of Athletics, Curriculum Coordinator, District Test Coordinator, 21st Century Grant, etc.} *Clarification from the Office of Accreditation: building principals may NOT serve as the School Test Coordinator.

Appendix F Revisions 5.a. Any person involved in any phase of the testing program has been trained in appropriate assessment administration and test security procedures. Test administrators shall be licensed school personnel. February 1-3, 2011 © MDE - Test Security 14

Appendix F Revisions 6. Both a test administrator and a proctor are present and actively monitoring students during the entire test administration. a. At least two people are present from the time that testing materials are distributed to the test administrator until all test materials have been returned to the secure area. February 1-3,2011 ©,MDE - Test Security 15

Appendix F Revisions b. A seating chart is required for each room/site used for any statewide assessment; the seating chart must be signed and dated by the test administrator, proctor, and schooltest coordinator. February 1-3, 2011 © MDE - Test Security 16