Administration Code for Kentucky’s Educational Assessment Program Spring 2012

Recent loss of certification for Kentucky educators emphasizes the seriousness of this topic.

Analysis by Vendor Large score changes for a student Large mean score increases Probability of matched response analysis Pattern analysis Comparison of individual student scores by item type

Allegations

Sources of Allegations Inappropriate Assistance/Intervention by Staff Test Security-Staff or Student (e.g. materials left unattended) Out-of-Order-Staff or Student (e.g. looking ahead in test booklet) Special Education (e.g. accommodation not in IEP) Student Action (e.g. cheating) Missing Materials (e.g. test missing from inventory) Other (e.g. good faith feedback during test, not providing necessary materials)

Steps in Filing Allegations Notarized statements Supporting documentation (e.g. administration code signature sheet(s), test schedule, etc.) Potential KDE site visit

Resolution of Allegations After significant time, the Testing Board of Review makes a recommendation to the Commissioner of Education who makes a final decision of… – Case closed OR – Scores lowered AND/OR – Training assigned for staff AND/OR – Names of staff sent to EPSB

Reward Programs Shall be consistent with those applied within the larger school program Individual results from checklists (e.g. for “Good Faith”) shall not be made available to students until the entire assessment has been administered. Local school board and activity funds cannot be used to fund reward programs. Donations may be used.

Organizers/Pre-Writing A specific organizer or pre-write method for “Good Faith” is not acceptable. Complete first drafts shall not be required.

Test Preparation Practice shall not increase students’ test scores on the statewide assessment without simultaneously increasing students’ ability to apply content to real-life situations.

Classroom Materials Remove content and processes No matter how small No matter where it is located No matter if it’s not tested in your room *Stretch the definition of “content” and “processes” to the limit in order to be extra careful. *Get a friend to double check your room.

Allowable Materials Only as prescribed by the T. A. M. See the sections… – Inventory of Test Materials – Additional Materials Provided by Schools No sharing of calculators unless you are positive that answers have been cleared. No leaving the testing areas to obtain materials KDE's states that a 4-function calculator is sufficient. However, when a mix of 4-function and scientific calculators is what you have available, be cautious about the perception given about who gets the scientific version. We don't want students (or their parents) thinking that they got the 4-function version because they are not expected to do as well. Distribute them randomly and be sure that any student can get the scientific version if they ask for one. If this involves moving a calculator from one student to another or a few shared scientific ones, be sure that answers are cleared from memory before a calculator is given to a student.

There should not be a cessation of all normal instruction during the testing window. There shall be no reviewing for the test during the testing window.

The use of any accommodations shall not inappropriately interfere with or influence the administration of the assessment to other students.

Test Security Test books should either be… – attended – double locked

Timing the Tests Students may not be given more time on a specific test part than specified in the T. A. M./T.A.S. Students shall not be allowed to work ahead to future test session parts or to return to past parts. Students shall not take more than a single school day to complete a testing session.

Texting If this is observed, it is an indication that students might be cheating. This is challenging to monitor since kids are so sneaky about doing it. "Hands are to remain in plain sight" is a good policy to prevent it.

Student Movement During Test Sessions Students may not move about the testing room. Students may not be left alone in a testing room.

Proctors shall not engage in any behavior that would assist the students in responding to any test item. For example, – “You can do better.”—NO – “Good job.”—NO – “Do your best.”—YES

Knowledge of Specific Test Content Do not obtain deliberately. Do not reveal to anyone. Do not use to prepare students for the assessment.

Student Responses Cannot be scored (including rough drafts) Cannot be read in their entirety (even to determine “Good Faith Effort” Cannot be copied

Staff shall not alter student answers at any time. DO NOT erase anything, except for a stray mark DO NOT add anything

Disciplinary Problems Found During Visually Scanning Answers For example, inappropriate language or drawings. Students shall not be allowed to modify their initial response. Students may be instructed to answer the questions again on separate sheets of paper. The original responses, along with the rewritten ones clearly marked NOT TO BE SCORED—ITEMS RETAKEN FOR DISCIPLINARY PURPOSES, shall be submitted for scoring to the testing contractor.

Errors in testing materials should be reported to the B. A. C. DO NOT take any individual action.

Live by the Code! This presentation highlights the most important points. No presentation takes the place of reading the code, which you should do! When in doubt, ask your B. A. C.

KDE conducts random site visits to analyze… Training Testing Schedule Extended Time Materials Management Test Security Testing Environment Accommodations Exemptions Return of Materials Student Motivation

Questions…