Presentation on theme: "Proctoring the Spring 2011 Measurements of Student Progress (MSP) Grades 3–8 Paper/Pencil This presentation is provided to assist in the training of proctors."— Presentation transcript:
Proctoring the Spring 2011 Measurements of Student Progress (MSP) Grades 3–8 Paper/Pencil This presentation is provided to assist in the training of proctors and should be augmented with special consideration appropriate for your local district Critical Information for Proctors Student Success Office of Superintendent of Public Instruction March 23, 2011
Errata Grade-Band 3-5 Page 116
Accommodated kits for students registered through the WAMS Online Test Registration system include a Pre-ID standard form test booklet. Test booklet labels and Return Shipping labels are color coded to ensure that receipt and scoring of all returned material is accurately processed. The latest version of the Washington State Accommodations Guidelines for Statewide Assessments combines IEP, 504 and ELL accommodations. Test booklet back covers (demographic page) have been revised. Student demographic and test status are now specific to the grade level and content. Proctors sign and submit Test Security Assurance Forms. The completed form must include an explanation of boxes checked No and notation of missing materials. Updates from 2010
The Assessments Test Preparation Question Format Response Formats and Tools Page number reference in the Directions for Administration manual Intent of the Assessment: To ensure the best opportunity for students to Demonstrate what they know and are able to do. Part 1Overview
It is desirable for students to be given a certain amount of practice so they will be familiar with the format of questions on state assessments. Students need to be given practice with multiple-choice, short answer, completion and essay formats in regular instructional activities. Such test preparation activities should be viewed as being a continual process, not something that is only done immediately prior to testing. Students who will be testing online must be provided at least one opportunity to review the Online Demo and Tutorials for the particular subjects in which they will test. Changes for 2010 and Beyond Teacher Resource Tool available at Test Preparation
MSP Question Format n Multiple-choice items have either three (grades 3, 4 and 5) or four (grades 6, 7 and 8) response options. For these questions, students must choose the best answer and completely fill in the circle next to the answer. Any unwanted marks must be erased completely. n Short-answer questions ask students to supply the answer. Dependent on content area, answers may be in the form of words, phrases, sentences, numbers and/or pictures/diagrams. n Completion questions ask students to supply the answer, which may be in the form of a word, phrase, short sentence and/or numeric answers on the answer line or in the box provided. n Essay questions in writing at grades 4 and 7 require students to write an essay in response to two prompts. n Stand-alone questions on the reading assessments are not connected with a passage. Stand-alone questions on the science assessments are not connected with a scenario. Stand-alone questions ask students to choose the best answer or write a word or phrase for completion. Review sample questions at the beginning of each content area in the DFA manuals
Only No. 2 pencils may be used on state assessments. These procedures also apply to the rough drafts and final copies of writing assessments. This limitation is based on scoring and testing protocols. Scanning of test booklets may be compromised by use of certain writing instruments. Further, the use of a particular writing instrument may guide or clue a student to a particular type of prewriting activity, in turn influencing the students response. Students may use a No. 2 pencil to underline or check/circle items or key words for future reference, but care should be taken not to make marks near circles on multiple choice questions or penetrate the paper. Response Formats and Tools These procedures also apply to the rough drafts and final copies of writing assessments.
Test Security State Laws Governing All test content is confidential and secure. No part of any test content may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying, recording or placement in any information storage and retrieval system. This includes but is not limited to and text messaging. Ensuring Test Security Test material must be maintained in a secure manner and not revealed to students prior to testing. Students must not be given inappropriate assistance during the time they are taking the test. The test has to be maintained in a secure manner before and after administration because test questions are reused over time. **Staff are not permitted to read, inspect, discuss or transmit secure test content**
Confidentiality Follow your building testing security plan Ensure confidentiality of test booklets under your control Generally Recognized Standards Ensure access, not advantage Provide appropriate allowable accommodations Confidentiality and Generally Recognized Standards
n Teachers are expected to provide students with an opportunity to acquire the knowledge and skills that will be assessed, primarily by providing students with a rich instructional program. n Teachers may not, under any circumstances, use secure test content for instruction of students. n Teachers shall maintain the confidentiality of individual students results. n Teachers may help students improve test-taking skills by: Teaching students test-taking strategies; Providing practice assessments that demonstrate various item formats; and Using resource materials such as assessment questions from the public domain. Responsibilities of Teachers
Test proctors are educational practitioners who: Must attend required training and read all assigned training materials; Provide a positive test taking environment; Administer assessments according to the Directions for Administration manual and any supplemental materials provided by OSPI; Ensure that assessment documents are given only to the student identified in the coding; Maintain confidentiality concerning secure content; Document and report any testing irregularities/breach in test security; Sign and submit Test Security Assurance Forms. The completed form must include an explanation of boxes checked No and notation of missing materials. Examples of Prohibited Activities Reviewing, revealing or copying test content. Causing achievement to be inaccurately measured or reported. Copying or reading student responses. Responsibilities of Test Proctors and Staff
n Because cell phones, iPods® and other communications devices have the capability of transmitting secure test content, they must be turned off and kept out-of-view and out-of-reach, until the testing session has completed and secure materials have been collected. Use of cell phones during testing will result in an irregularity and possible invalidation. It is important that school administrators and staff establish and communicate this policy to students. n Backpacks, bags and purses must be kept a distance from the student so that items may not be retrieved without leaving the seat. Communication Devices and Backpacks
n Participation in Testing and Special Education MSP/WAAS Participants New Non-English Proficient (NNEP) Absenteeism Part 3A: Preparation for Testing
All students enrolled during the testing window must participate in the MSP, MSP-Basic or WAAS-Portfolio assessment. Students are pre-registered and will receive Pre-ID test booklets or Pre-ID adhesive labels. Testing and special education: IEP teams review the available performance data and identify the most appropriate testing option for students in grades 3-8, in the content area for which they qualify for and receive special education services. Measurements of Student Progress Without accommodations With accommodations WAAS Portfolio MSP-Basic Level 2 Basic meets standard MSP/WAAS Participants
n NNEP students are those who first enrolled in a U.S. public school within the past 12 calendar months. They are not required to take the reading and writing assessment. Please keep in mind that these students test their second year in school.. n The No Child Left Behind Act (NCLB), however, does require NNEP students to take the mathematics and science assessments. Test scores, including those in mathematics, are not counted in any way (i.e., Report Card or AYP results). If they do not take the mathematics MSP, they will be counted in AYP as non- participants. As you know, NCLB requires 95% participation. New NonEnglish Proficient (NNEP) Students
n All Grades Students who are absent with a valid excuse and do not take the assessment will not be included in the proficiency portion of AYP or state results. However, they will be counted as non-participants for AYP purposes. Absences need to be reported, on the back cover (demographic page) of the student test booklet, either as excused or unexcused. This documentation must follow local school board policy on excused absences. n Grades 3–8 Students in grades 3–8 must be given an opportunity to make up missed sections of the assessment. Make-up session for students who miss one or more parts of the assessment must be scheduled after the initial administration. Students who miss a first-day writing session but are present for the second-day may be tested along with other students and make up the first session at a later time. Absenteeism
Guidelines for scheduling the Assessments Test Preparation Communicating with Parents and Students Identifying Proctors, Scribes, Volunteers Preparing Students for State Assessments Part 3Before Testing B: Testing Schedules
n The standardized schedule helps ensure the security of the assessment content and contributes to the validity and accuracy of student scores. n The MSP is an untimed test. Estimated timeframes are for planning purposes. 10–15 minute supervised breaks are allowed. Caution against discussing test content. Students generally remain in classroom; however, they may be permitted to leave the room, if supervised. Administration of all tests begins soon after the start of the school day. All late starts and early dismissals must be canceled on testing days as well as interruptions in testing for specialists or teacher planning. Contact your assessment coordinator for direction on accommodating students who arrive after testing begins. Follow your school testing plan for students who need additional time. Each test must be completed during the regularly scheduled day in which it was begun, unless specified in the students IEP or 504 Plan. Guidelines for Scheduling the Assessments
Statistical Sample Schools (SSS) MSP Writing SS: Schools identified begin testing on April 12 th and end testing on April 20 th (early window, expedited return). Data Recognition Corporation (DRC) has prescheduled your carrier pick-up of grades 4 and 7 participating Statistical Sample Schools. Writing (limited)- 4/21 * Only schools identified on the Early SSS Writing list: EarlySSSWritingMSPEarlySSSWritingMSP Completed test booklets return on April 21 st If a student is unable to be assessed during this window, return test booklet(s) to your school assessment coordinator for retention. The student may be assessed during the standard or makeup schedule. April 2011 SuMTuWThFSa * All other writing material administered May 2 nd through May 19 th (district approved schedule) and returns on standard schedule. Date selected in WAMS.
Part 3 -Section C: Ensuring a Proper Testing Environment n All testing locations must be posted with a TestingDo NOT Disturb sign. When placing the sign, care should be taken not to obscure windows. This posting assists in preventing interruptions in testing and facilitates the monitoring of testing by administration. n Remove or cover aids or prompts in the classroom that may help students answer test questions. n The following are samples of items permitted: Alphabet Simple number line Verbatim Copy of the Writing Checklists Glossaries for Non-Mathematics and Non-Science terms Mathematics Formula Sheet My Word List Compare Contrast Connect Analyze Interpret Synthesize Evaluate
n State assessments must be administered by trained staff members (e.g., teachers, ESAs, EAs, substitute teachers) of a school district under the general supervision of a certificated employee. n Student teachers and interns have a contractual relationship with the school districteven though they are not paid employeesand may assist in the administration of the assessments. n Volunteers may not administer or assist in the administration of any state assessments. Volunteers may assist in the supervision of students who need a break or have completed testing. Identifying Test Proctors and Scribes
n Mathematics Tools n Science Tools n Writing Tools n Scratch Paper n Calculators Part 3 Section D: Tools and Manipulatives
Dictionaries and Thesauruses For the Writing Assessments, students may use a commercially published thesaurus or dictionary. Teacher- or student-created dictionaries are not permitted. For the Reading, Mathematics or Science Assessments, dictionaries and thesauruses are not allowed on any session. Scratch Paper For the Writing Assessments, at least 3 sheets of yellow, lined letter-size (8 ½ x 11) scratch paper should be provided. Refer to Washington States Accommodation Guidelines for Statewide Assessments for tools available to students receiving Special Education or ELL Services: Writing Tools
No. 2 Pencils ONLY Pens, highlighters, markers, mechanical pencils, crayons, and pencils of 2.5, 3.0 etc., are NOT permitted; they will not be picked up by the scanners. Students may use a No. 2 pencil to underline or circle key words in the assessment directions. Scratch Paper For the Reading, Mathematics and Science Assessments, no additional paper of any kind is allowed, including lined or unlined scratch paper, patty-paper, wax paper or transparencies. For the Writing Assessment, students must be provided scratch paper for the prewriting and first drafts of each session. It is suggested that you provide at least 3 sheets of yellow, lined letter-size (8 ½" x 11) scratch paper so that it can be easily identified and removed for shredding. Providing Testing Materials
Calculators are permitted on the following assessments Mathematics (use optional) Grades 7 and 8 (MSP) Science (use optional) Grades 5 and 8 (MSP) Calculators are NOT permitted on the following assessments Mathematics Grades 3, 4, 5 and 6 Proctors are required to review the calculator section of the DFA for policies on use of and types of calculators allowed on state assessments. Students must be thoroughly familiar with the operation of the calculator they plan to use on the test. Calculators
Section E: Testing Materials MSP and Accommodated CD Forms Follow your school testing security plan for tracking materials to ensure materials are accounted for and returned to your school assessment coordinator. Follow building protocol for students who need additional time. Each student test for MSP (including Braille, large print and accommodated CD) has a unique security barcode number printed on the front cover, upper right hand corner. New this year Accommodated materials (Translated Mathematics and Science CDs, large print and Braille) will now be packaged as pre-Identified kit (zip-lock baggy) with a standard form test booklet. Tracking Secure Test Materials
Storage and Handling of Secure Materials All test booklets, alternate assessments and accommodated forms must be kept under secure, locked, limited access conditions at all times. Test Proctor is responsible for: Becoming proficient with the schools secure test material handling plan Daily accounting of all secure test material is critical. Ensuring secure storage of all test materials Ensuring accuracy of student demographic information Documenting test irregularities and security breaches Completing Test Security Assurance Form, including an explanation for boxes checked no and notation of missing materials. All missing materials must be immediately reported to your school assessment coordinator.
n Distributing and Collecting Booklets n Handling Defective Booklets During Testing n Monitoring and Certifying Test Administration n Reporting perceived Error on a Test n Documenting Irregularities Part 4During Testing
The reading, mathematics and science assessments are to be given in one session. The writing assessments are to be given in two sessions. Reading, mathematics and science test booklets must be collected after the completion of the testing day and returned to your school assessment coordinator according to your schools secure test material handling plan. Writing test booklets must be collected after the completion of session one and stored in a secure, locked, limited access area. Be sure to verify that the correct booklet is given to student identified. Return to your school assessment coordinator at completion of session two, according to your schools secure test material handling plan. Distributing and Collecting Booklets
It is possible that a student might receive a defective test booklet or that a test booklet may become damaged during testing. If a test booklet is incomplete or defective, the proctor should: Obtain a new test booklet from your school assessment coordinator; Verify the students demographics are gridded on the back cover of the replacement booklet; Document the testing irregularity in the Notes: Proctor/Coordinator Use box on the front cover of the replacement booklet; Tell the student to continue with the replacement copy, beginning after the last question answered in the defective booklet; and Band both the replacement and damaged/incomplete booklets together prior to returning to school assessment coordinator for transcription. Handling Defective Booklets During Testing
Monitoring & Certifying Test Administration Locations where testing is occurring must have a Testing – Do Not Disturb sign posted on the door to allow administrator monitoring and prevent unnecessary interruptions You may not paraphrase questions or read the questions to students. Test proctors and monitors must observe students to ensure: Students are engaged with the assessment and working independently Students are using only a No. 2 pencil Students are not using cell phones or other electronic devices, other than approved calculators. You may not read or comment on student essays, point out incorrectly answered question or point out questions that have not been answered.
Reporting Perceived Error on a Test If there appears to be an error on the assessment, instruct students to complete that section of the assessment. Assure the student that items found to contain errors will not be counted toward their score. Do not attempt to provide your own remedy. Alert your school and/or district assessment coordinator. Include the following information: content, grade level, form letter, test question number and page number. For security concerns, DO NOT copy the problem, share with colleagues or transmit this information via or text messaging. The district assessment coordinator will complete a Test Question Ambiguity Form. The state will provide a remedy if needed for all students in the state.
n Collect materials from students immediately after completion of testing. n Collect all Writing scratch paper, Mathematics Formula Sheets and Glossaries. Check to be sure that all papers are accounted for, then immediately and securely shred them. n Account for all secure materials. n Keep large print/Braille tests and accommodated forms (CDs) with the Standard Form A test booklet when returning to your school/district assessment coordinator. n Return all test materials to the school assessment coordinator. n Complete and submit a Test Security Assessment Form to your school assessment coordinator. After Testing
Part 8: Resources Test Proctor Checklists Accommodations Available to All Students Test Administration Irregularities Process Sample Test Booklet Covers Test Proctor and Classroom Testing Resources WAAS-DAPE Deliverables, DFAs and Test Booklets
n Wider Access n Accommodations Available for Students Receiving Services n Documenting Accommodations n Scribing Student Work ii: Universal Accommodations Available to Any Student
n The goal of the Washington Comprehensive Assessment Program is to assure every student has the opportunity to participate in the assessment, without providing a special advantage. n Refer to the Washington State Accommodations Guidelines for Statewide Assessments for specific accommodations available to students receiving Special Education Services and English Language Learners. The Checklist for accommodations available for all students is available in the Resources section of the DFA. Assure Wider Access
In addition to these procedures for wider access available to all students, several individualized accommodations may be used for students with limited English and students with disabilities. Special populations in Washington State include the following: n Students in Special Education Programs n Students with 504 Plans n English as a second language/bilingual students Accommodations Available for Students Receiving Services Refer to the Washington State Accommodations Guidelines for Statewide Assessments for accommodations for students with and IEP, 504 or ELL plan.
n Mark the accommodations used During Testing Box 6 must be completed on the back cover (demographic page) when a is provided a listed accommodation. n Important Note: Refer to the Washington State Accommodations Guidelines for Statewide Assessments When Speech Recognition Software or other assistive technology is used, ensure all secure test information has been deleted Documenting Accommodations
Scribing should only be used for students who are unable to write their own responses in the test booklet. The need for a scribe must be documented on the students IEP or 504 Plan. n Scribing should not be used to compensate for: Poor handwriting Poor spelling Difficulty with writing organization and slow production Students resistance to performing writing tasks n Partial Scribing may be used if documented in the students IEP or 504 Plan n Transcribing Student Work from a Computer Scribing for Students
Broken or Sprained Arms and Hands Students with a Broken Arm, Hand, etc may use a scribe on state assessments. Follow the steps outlined below: 1. The district should consider whether the student needs accommodations for general classroom instruction and, if so, create a 504 plan. 2. The school assessment coordinator must complete an Individual Testing Irregularity Report and submit it to the district assessment coordinator. 3. Document the scribing in the Notes: Proctor/Coordinator Use box on the front cover of the student test booklet and include the reason for scribing (e.g., student broke arm, hand, etc.). Documenting this accommodation will assist us if we receive scoring alerts from our contractor when the work in the booklet does not appear to be that of a student.
Section iii: Documenting Test Administration Irregularities n Consult your School Assessment Coordinator regarding all irregularities. n All testing irregularities must be documented on the front cover of test booklets in the Notes: Proctor/Coordinator box. n All individual and group testing irregularities must be gridded on the back cover (demographic page) of the student test booklet(s). n These irregularities must be promptly documented on forms located at Refer to Section R13-16 of the Directions for Administration manual for additional information regarding testing irregularities. Notify administration and parents of all potential invalidations
For Assistance Resource flow chart: 1.Review your district materials 2.Proctors: Contact your school assessment coordinators 3.School assessment coordinator: Contact your district assessment coordinator OSPI will refer calls from other district and school staff to their district assessment coordinator.