1. Assessment Coordinator Training Tom Corbett, Governor ▪ Ronald J. Tomalis, Secretary of Educationwww.education.state.pa.us Winter Keystone Exams Administration Training 1 2012/2013 Winter Keystone Exams Assessment Coordinator Training Pennsylvania Department of Education Data Recognition Corporation

2. Assessment Coordinator Training Tom Corbett, Governor ▪ Ronald J. Tomalis, Secretary of Educationwww.education.state.pa.us Winter Keystone Exams Administration Training 2 2012-13 Keystone Exams will be used for two purposes: –Proposed state requirement that the class of 2017 and beyond demonstrate proficiency for the purpose of graduation –Accountability as per No Child Left Behind (NCLB) Adequate Yearly Progress (AYP) PDE plans to apply for new Annual Measurable Objectives (AMO) – Currently 89% for math and 91% for reading KEEXYASMTSONEKEEXYASMTSONE

3. Assessment Coordinator Training Tom Corbett, Governor ▪ Ronald J. Tomalis, Secretary of Educationwww.education.state.pa.us Winter Keystone Exams Administration Training 3 Keystone Exams Overview 3 Available to students either online or paper/pencil Comprised of two (2) modules Multiple-Choice (MC) and Constructed-Response (CR) items Students who attempt a Keystone Exam but do not score proficient or above are permitted to retake the Keystone Exam

4. Assessment Coordinator Training Tom Corbett, Governor ▪ Ronald J. Tomalis, Secretary of Educationwww.education.state.pa.us Winter Keystone Exams Administration Training 4 Keystone Exams Overview Students in grades 9-11 will be required to take the Keystone Exams at least one time prior to (or during) the spring administration of their grade 11 year. In 2012-13, Grade 11 Keystone results will be used for Adequate Yearly Progress (AYP). Grade 9 and 10 results will be banked. Students who attempt the Winter Keystone Exams but do not score proficient or above are permitted to retake the Keystone Exams during the spring 2013 window.

5. Assessment Coordinator Training Tom Corbett, Governor ▪ Ronald J. Tomalis, Secretary of Educationwww.education.state.pa.us Winter Keystone Exams Administration Training 5 For AYP Purposes: If an 11 th grade student took a Keystone Exam in 2011 as a 9 th grade student and scored Advanced or Proficient, the results of that Keystone Exam will be used for purposes of accountability. A student who did not score Advanced or Proficient in Algebra or Literature as a 9 th grade student in 2011 should retest as an 11 th grade student in 2012-13. A student who participated in the Biology exam in 2011 does not have to retest in 2012-13. Keystone Exams Overview

6. Assessment Coordinator Training Tom Corbett, Governor ▪ Ronald J. Tomalis, Secretary of Educationwww.education.state.pa.us Winter Keystone Exams Administration Training 6 PDE Policy – Test Security  The assessments rely on the measurement of individual achievement. Any deviation from assessment procedures is strictly prohibited and will be considered a violation of test security.  School administrators, teachers, and any other education personnel who are involved in the assessment program must maintain the security of all assessment materials at all times.  Because the assessment must remain secure, teachers/Test Administrators should not have assessment materials in their possession at any time other than during the actual assessment administration.

7. Assessment Coordinator Training Tom Corbett, Governor ▪ Ronald J. Tomalis, Secretary of Educationwww.education.state.pa.us Winter Keystone Exams Administration Training 7 PDE Policy – Test Security Test Security Certifications The Test Security Certifications must be signed after the assessments are administered – Principal, District Assessment Coordinator, School Assessment Coordinator, Test Administrator and Proctor (if applicable) Provided in Appendix D of Handbook for Assessment Coordinators All other individuals handling secure materials MUST have a signed School Assessment Coordinator Test Security Certification on file The Chief School Administrator must retain all Certifications for three years DO NOT return these forms to DRC

8. Assessment Coordinator Training Tom Corbett, Governor ▪ Ronald J. Tomalis, Secretary of Educationwww.education.state.pa.us Winter Keystone Exams Administration Training 8 PDE Policy – Test Security Test Security Certifications If an individual does not sign the appropriate Test Security Certification, the Chief School Administrator must provide the Department of Education’s Bureau of Assessment and Accountability with a written explanation of the reason or reasons why the Certification was not executed. The explanation must provide a description of the action taken by the Chief School Administrator in response to the failure to execute the Test Security Certification.

9. Assessment Coordinator Training Tom Corbett, Governor ▪ Ronald J. Tomalis, Secretary of Educationwww.education.state.pa.us Winter Keystone Exams Administration Training 9 PDE Policy – Test Security PAsecureID List Distribution School assessment coordinators must generate a list(s) of students by PAsecureID to show all students taking the Keystone Exams. The list should include for each student the test administrator, school name, year, and subject being administered. All lists must be retained at the district/school for three years; and be available when requested by PDE.

10. Assessment Coordinator Training Tom Corbett, Governor ▪ Ronald J. Tomalis, Secretary of Educationwww.education.state.pa.us Winter Keystone Exams Administration Training 10 PDE Policy – Test Security  Maintain test security: Refer to PDE security guidelines located at www.education.state.pa.us Search for “Accommodations and Security”

11. Assessment Coordinator Training Tom Corbett, Governor ▪ Ronald J. Tomalis, Secretary of Educationwww.education.state.pa.us Winter Keystone Exams Administration Training 11 Roles and Responsibilities Test Administrators –Be familiar with all testing protocols, including the “Ethical Standards of Test Administration (formerly the “DO’s and DON’Ts”) –Follow all testing protocols –Sign the Test Security Certification Statement –Make students familiar with testing procedures –Make students feel comfortable

12. Assessment Coordinator Training Tom Corbett, Governor ▪ Ronald J. Tomalis, Secretary of Educationwww.education.state.pa.us Winter Keystone Exams Administration Training 12 Roles and Responsibilities Test Administrators –Answer any questions students may have about test directions –Walk around the room during testing –Maintain a calm, quiet environment during testing –Collect and return test books to the SAC when testing is complete –Report any suspected testing violations to the SAC and to PDE

13. Assessment Coordinator Training Tom Corbett, Governor ▪ Ronald J. Tomalis, Secretary of Educationwww.education.state.pa.us Winter Keystone Exams Administration Training 13 Common Violations The following are examples of testing violations. This is NOT an exhaustive list. Misuse of accommodations (e.g., reading the Math test to the entire class; reading aloud the Reading test) “Under” proctoring (e.g., inadequately monitoring the testing session) “Over” proctoring (e.g., reminding a student without the appropriate accommodation to answer a specific question)

14. Assessment Coordinator Training Tom Corbett, Governor ▪ Ronald J. Tomalis, Secretary of Educationwww.education.state.pa.us Winter Keystone Exams Administration Training 14 Common Violations Changing answers or encouraging students to change their answers. Discussing the test or test questions with individual students. Reading aloud a math question or answer choice when doing so cues the correct answer.

15. Assessment Coordinator Training Tom Corbett, Governor ▪ Ronald J. Tomalis, Secretary of Educationwww.education.state.pa.us Winter Keystone Exams Administration Training 15 Common Violations Not removing or covering instructional materials in the testing room or the hallways. Giving reminders to individual students or to the entire class (e.g., “Remember, we covered this last week.”) Allowing students to possess cell phones during testing. Allowing devices in the testing room that take pictures.

16. Assessment Coordinator Training Tom Corbett, Governor ▪ Ronald J. Tomalis, Secretary of Educationwww.education.state.pa.us Winter Keystone Exams Administration Training 16 Common Violations Copying or recording any part of the secure test materials Viewing secure test material by teachers, proctors, administrators, etc. Returning test materials to students to complete or enhance answers

17. Assessment Coordinator Training Tom Corbett, Governor ▪ Ronald J. Tomalis, Secretary of Educationwww.education.state.pa.us Winter Keystone Exams Administration Training 17 Potential Consequences of Testing Violations For Educators: Verbal reprimand Written reprimand Suspension with or without pay Termination Revocation of certification Criminal charges

18. Assessment Coordinator Training Tom Corbett, Governor ▪ Ronald J. Tomalis, Secretary of Educationwww.education.state.pa.us Winter Keystone Exams Administration Training 18 Potential Consequences of Testing Violations For Students: Consequences for students violating test security (e.g., cheating, taking pictures of test questions) are up to the individual LEA. Students should be made aware of these consequences prior to testing.

19. Assessment Coordinator Training Tom Corbett, Governor ▪ Ronald J. Tomalis, Secretary of Educationwww.education.state.pa.us Winter Keystone Exams Administration Training 19 Potential Consequences of Testing Violations For Students (cont.) If a student violates test security, it is the responsibility of the LEA to determine the consequences for the student. These consequences may include disciplinary action and/or the student retaking the test. ALL test security violations by students must be reported to PDE immediately.

20. Assessment Coordinator Training Tom Corbett, Governor ▪ Ronald J. Tomalis, Secretary of Educationwww.education.state.pa.us Winter Keystone Exams Administration Training 20 Data Available to PDE - examples Student erasures How long it takes a student to answer an item when taking the test on a computer When answers are changed and how often they are changed on a computer Statistical analyses of student scores and performance

21. Assessment Coordinator Training Tom Corbett, Governor ▪ Ronald J. Tomalis, Secretary of Educationwww.education.state.pa.us Winter Keystone Exams Administration Training 21 Cautions! Do actively proctor the test but don’t give any individual student help. Do encourage the class to check their answers but don’t encourage specific students to check their answers. Do report all prohibited actions.

22. Assessment Coordinator Training Tom Corbett, Governor ▪ Ronald J. Tomalis, Secretary of Educationwww.education.state.pa.us Winter Keystone Exams Administration Training 22 Cautions! Do not review student test or answer booklets (except as stated in the Administration Manual and the Accommodations Guidelines). Do not assist, direct, or counsel students during the administration of the test in any way that would influence student answers. Do not provide answers to students. Do not alter, influence, or interfere with a test response in any way, fill in any unanswered item, or instruct the student to do so. Do not discuss or provide feedback regarding test items. Do not use the answer sheet as scratch paper or as a method to eliminate incorrect answer options.

23. Assessment Coordinator Training Tom Corbett, Governor ▪ Ronald J. Tomalis, Secretary of Educationwww.education.state.pa.us Winter Keystone Exams Administration Training 23 To Report Suspected Violations, Contact The Pennsylvania Department of Education at 717-787-4234

24. Assessment Coordinator Training Tom Corbett, Governor ▪ Ronald J. Tomalis, Secretary of Educationwww.education.state.pa.us Winter Keystone Exams Administration Training 24 Assessments Available  Algebra I  Biology  Literature Accommodations are available for all tests.

25. Assessment Coordinator Training Tom Corbett, Governor ▪ Ronald J. Tomalis, Secretary of Educationwww.education.state.pa.us Winter Keystone Exams Administration Training 25 Administering the Assessment DO: maintain calm & quiet remove or cover all instructional materials provide: –blank scratch paper –sharpened pencils –highlighters encourage students return all test materials to secure location DO NOT: allow unsupervised breaks display visual cues (e.g., picture icons) provide pre-printed graphic organizers allow pens/colored pencils; stray marks prompt students keep any test materials use the answer sheet as scratch paper

26. Assessment Coordinator Training Tom Corbett, Governor ▪ Ronald J. Tomalis, Secretary of Educationwww.education.state.pa.us Winter Keystone Exams Administration Training 26 2012-13 Keystone Exams Accountability (Federal requirement) –All 11 th grade students must take all three Keystone Exams* –All non-11 th grade students completing a Keystone related course must take the appropriate Keystone Exam Only 11 th grade results will be used to calculate AYP Non-11 th grade students’ results will be banked until they’re in 11 th grade

27. Assessment Coordinator Training Tom Corbett, Governor ▪ Ronald J. Tomalis, Secretary of Educationwww.education.state.pa.us Winter Keystone Exams Administration Training 27 PDE-established Testing Window Wave One Test Dates – All subjects Testing window: December 3-14, 2012 Return all paper tests by December 19, 2012 Wave Two Test Dates – All subjects Testing window: January 9-23, 2013 Return all paper tests by January 25, 2013 Make-ups can occur anytime during the PDE-established window. Last day to return materials to DRC for all Keystone reporting is January 25, 2013

28. Assessment Coordinator Training Tom Corbett, Governor ▪ Ronald J. Tomalis, Secretary of Educationwww.education.state.pa.us Winter Keystone Exams Administration Training 28 PA CUSTOMER SERVICE Data Recognition Corporation understands the intricacies involved with large scale assessments. Our customer service representatives are always ready and willing to help with any questions or problems. Our number is 1-800-451-7849 Or email us at pacustomerservice@datarecognitioncorp.com