Test Security and Ethics Kansas Assessment Program

Purpose Test security is essential to obtain reliable and valid scores for accountability purposes. Accordingly, the Department of Education must take every step to assure the security and confidentiality of the state test materials.

Purpose It is the responsibility of individuals who develop the tests, who administer the tests, and/or those who use the results to follow test security protocols, regulations, and procedures.

Purpose All Kansas assessment programs must abide by test security and ethical testing practices. Kansas assessment summative and interim assessments KELPA2 cPass DLM (additional training modules provided for staff administering this assessment)

Security/Ethics Yearly Training All staff who administer a state assessment must be trained yearly! Must be an employee of the school system. No volunteers, parents, etc.

Training Options KSDE Conference Requires follow-up review of Test Security and Ethics Fact Sheet and the KAEM Online training – available November 1, 2017: Veteran DTCs – short version New DTC – complete training Educator – option – can be used by DTC to adapt for training in their district

Resources Download: Test Security and Ethics Fact Sheet - KSDE website Monitor Checklist – KSDE website Kansas Assessment Examiner’s Manual – KAP website

Test Security and Ethics Fact Sheet Posted on KSDE website Content changes/tweaks: Still divided into Sections for Roles and Responsibilities – DTC, BTC and Teachers/Test Proctors Acceptable and Unacceptable Practices Ethical Practices Updated Information on Test Security and Item Issues

Kansas Assessment Examiner’s Manual KAEM will be available the first week of January on the www.ksassessments.org Any staff member who administers or supports the administration of the state assessment must read the KAEM and the Test Security and Ethics Fact Sheet before administering a state assessment.

Agreement to Abide by District and building-level personnel must sign “The Agreement to Abide by Guidelines” found in the KAEM, or a district may customize a form to meet their own needs. Building-level personnel includes any staff member who administers a state assessment, including administrators, educators, para-educators, etc. Parent volunteers may not administer a state assessment.

Documentation of Agreement Written verification is needed for the protection of each teacher/proctor and the district (and not all proctors have access to Educator Portal). DTCs/BTCs must keep written documentation that could be produced during a monitor visit

Roles and Responsibilities: District Test Coordinators List of responsibilities included with fact sheet, posted on the KSDE website, and in the Examiner’s Manual Review carefully to be certain all expectations have been met

District Test Coordinators Oversee test security for the entire district. Establish and implement test security and ethics procedures for the district. Train district and building-level personnel before testing begins, which includes training regarding test security procedures, ethics of testing, and reporting/documentation of accommodations. Document which individuals have received training, when the training was provided, and the way in which the training was provided; documentation must be kept at both the district and building level.

District Test Coordinators Establish procedures that determine who has access to information in Educator Portal. Determine role assignments within the district. Remove/inactivate users in Educator Portal for staff who have left the district and/or changed roles with the district; this task should be completed by the end of September.

Personally Identifiable Information (PII) Inform staff that personally identifiable information (PII) must not be conveyed when testing issues are reported. The documentation for Kansas regarding allowable identifiers in an email specify that only the Student State ID number and no other identifying details should be provided in an email.

Reporting Issues to KITE Service Desk Please do not report any PII (personally identifiable information) The documentation for Kansas regarding allowable identifiers in an email specify that only the Student State ID number and no other identifying detail is to be used in email.

Teachers/Test Proctor Reminders Actively monitor the testing environment by moving around the room. Moving around the room encourages students to focus on their own work. All chalkboards and white boards in rooms used for testing should be clean and have no information on them. Teacher/test proctor may not say nor do anything that would let a student know whether an answer is correct.

Monitoring Handheld Calculator Use An on-screen calculator is available from the KITE Client toolbox for certain items. Students in grades 6, 7, and 8 have access to a basic four-function calculator and a scientific calculator (TI-30XS Multiview). Students in grade 10 have access to a basic four-function calculator and a graphing calculator (TI-84).

Monitoring Handheld Calculator Use Students are also permitted to use their own calculators on parts of the test where the calculator tool is available. Students do not have access to the calculator on test items that require students to demonstrate direct knowledge of computational skills. These items are contained in a different part of the test, and the calculator tool is unavailable.

Monitoring Handheld Calculator Use If students choose to use a handheld calculator, the memory must be cleared both before AND after each testing session. Schools must keep a record of each student using a handheld calculator.

Soft Break At the break between calculator-active and calculator-inactive parts, collect handheld calculators from students. Calculator-active parts are at the beginning of each test session.

Soft Break You may want to have students raise their hand when they complete the calculator-active part so that you know when to collect the calculators. The calculator-inactive parts have 10 or fewer items, so you will be able to tell which part the student is working on by looking at the progress bar across the top of the screen.

Monitoring Calculator Use Monitoring calculator use and having procedures in place will be critical to ensure that calculators are used on the correct part of the test session.

Teachers/Test Proctor Reminders All chalkboards and white boards in rooms used for testing should be clean and have no information on them. Teacher/test proctor may not say nor do anything that would let a student know whether an answer is correct.

Monitor Visit Monitor team visits – representative sample of districts across Kansas, across all state BOE regions including both large and small districts Monitor team members – Kansas Assessment Advisory Council members and KSDE staff Monitor team visits in 2018 – goal is to continue visiting new districts

Monitor Checklist Review with staff prior to testing and include in your training! Posted on the KSDE website – assessment page Carefully review information related to documentation of accommodations.

Monitor Checklist Kansas Assessment Advisory Council (KAAC) updated checklist during the 2016-2017 school year; checklist was easier to follow and understand expectations 2017-2018 checklist – added information about monitoring calculator use

Additional Security Measures New measures added this year to enhance security on a larger scale: Click History Monitoring of Reactivations

DTC Validation of Training DTC Test Security and Ethics 2018 https://kansasedu.qualtrics.com/jfe/form/SV_eyCSoxYoW4mr3ZX Once the PowerPoint is posted you can click on the link and enter your information to indicate you have participated in the training for 2018.

Kansas Interim Assessment System Predictive Mini-tests

Interim Launch 2016-2017 Interim system pilot Over 200,000 mini-tests were administered Over 200 districts participated Thank you to all of the educators, schools and districts who participated in the interim pilot! 319 mini-tests administered since Sept. 15, 2017

Field Input Over 3,500 educators in KS provided input on our state assessment program including the interim system Changes were made based on the input and now the interim system has: Fewer clicks, easier management of assigning tests to students, better student reports and more!

Interim Predictive Mini-tests The mini-tests are designed to be used frequently during the course of instruction to: provide feedback to help students to evaluate students’ learning to aid teachers in adjusting instruction

Mini-tests Are available throughout the school year Interim Predictive Mini-tests Are available throughout the school year For a list of available mini-tests visit www.ksassessments.org (interim page) Additional mini-tests are continuing to be added throughout the remainder of the school year

Mini-tests ELA and Math aligned to state curriculum standards, claims, and targets allow educators to administer tests that match the instruction that is happening in the classroom allow educators to build tests or “copy” tests provide immediate results Mini-tests (6 to 12 items)

Mini-tests Mini-tests are designed to: be used frequently during the course of instruction provide feedback to help students evaluate students’ learning aid teachers in adjusting instruction

Mini-tests Mini-tests are not: intended to be technology practice for the state assessment intended to be “get ready prep” for the state assessment Interactive-Demos (technology practice tests)

Interim Predictive Mini-tests Interim predictive assessments provide an estimate of future performance on Kansas summative assessments. These assessments allow educators to evaluate students’ knowledge and skills relative to the Kansas College and Career Ready Standards.

Interim Predictive Mini-tests Three predictive interim assessments each in ELA and in Mathematics Grade level specific Each interim predictive test has 25 test questions; about one class period To receive a predictive score students must answer all 25 test questions Three predictive tests in ELA and three predictive tests in math The predictive score is a range.

Predictive Testing Windows Interim predictive assessments are available during each of the three two-week testing windows. www.ksassessments.org ELA and Math Predictive Interims Fall October 16 - 27 Winter December 4 – 15 Spring February 5 – 16

“Required” You may give one, two, or all three predictive tests!

Predictive Provide Student, Building, and District reports Interim Predictive Mini-tests Provide Student, Building, and District reports Student reports available upon completion of testing Building & District at the end of the window

Getting Ready Before administering an interim predictive test, districts must submit a TASC record through KIDS to roster students and teachers. The KITE system will automatically assign students with a TASC record to each predictive assessment. Educators will assign students with a TASC record to mini-tests TASC records – should be uploaded as new students enroll TASC records can be uploaded as often as needed; enrollment changes are factored in with TASC records just like with the summative TEST sends Submit TASC records for students in the test grades for ELA and Math DO NOT SUBMIT TASC records for other subjects, other grades or for students who will be taking the DLM assessments.

Getting Ready Educators must have an active account in Educator Portal.

Getting Ready Download Educator Resources www.ksassessments.org Interim User Guide Understanding the Predictive Interim Score Report Important resources to become familiar with the Interim system

Interim User Guide www.ksassessments.org Includes directions on how to: Administer tests Assign tests Manage tests Take tests Obtain results Updated user guide

Getting Ready…Taking the Test You will want to make sure you are using this year’s version of KITE Client as well as whitelist the following domains to prevent testing interruptions. *.cete.us *.s3.amazonaws.com Attend ATS session later today to learn more.

Taking a Test The interim assessments are administered online via the KITE® Client (Student Portal). Each student has a username and password. The username and passwords are the same for all assessments administered in the KITE Student Portal.

Taking a Test Interim tests do not use a Daily Access Code. TTS is available for students who need this as an accommodation – must be marked in the PNP. Additional tools – such as a highlighter, calculator, guideline bar, etc. are available

Taking a Test Students will be able to select “Save” for interim tests if they haven’t completed the test and want to continue taking it later. (no need to reactivate) Predictive tests should be completed on the same day

Results

Understanding the Predictive Interim Score Report Provides a comprehensive walk-through to understand the results www.ksassessments.org

Understanding the Predictive Interim Score Report Page 2 shows the student’s performance on each question www.ksassessments.org

Questions KITE Service Desk Mary Matthew, KAP Director mmatthew@ku.edu