Presentation on theme: "2013 PSSA Assessment Coordinator Training"— Presentation transcript:
1 2013 PSSA Assessment Coordinator Training Pennsylvania Department of EducationData Recognition Corporation
2 Agenda Introductions – PDE General Overview – PDE PSSA Overview – PDE Test Security – PDEPDE Security Training – PDEPlanning for the Assessment – PDEParticipation and Exceptions to Participation – PDEAdministering the Assessment – PDEAYP – PDEReview Key Dates – DRCRoles and Responsibilities – DRCPaper/Pencil Administration – DRCOnline Administration – DRC
3 General Overview All policy decisions come from PDE All PSSA logistics are the responsibility of DRC and include:Delivery of Paper MaterialseDIRECT SystemInsight System (Online test engine)
4 PSSA Overview Available to students either online or paper/pencil Multiple-Choice (MC) and Constructed-Response (CR) items
5 PSSA OverviewStudents in grades 3-8 will be required to take the PSSA.PSSA results will be used for Adequate Yearly Progress (AYP).The 2013 PSSA will be based on the current AA/ECGrades 3-5 will have Field Test items based on the PACCThe entire PSSA will be based on the PACC in 2015
6 PSSA Overview PSSA and Keystone Exams Students in 8th grade or below who complete a course for which there is a Keystone Exam will take both the Keystone Exam and the PSSA.
7 PDE Policy – Test Security The assessments rely on the measurement of individual achievement. Any deviation from assessment procedures is strictly prohibited and will be considered a violation of test security.School administrators, teachers, and any other education personnel who are involved in the assessment program must maintain the security of all assessment materials at all times.Because the assessment must remain secure, teachers/Test Administrators should not have assessment materials in their possession at any time other than during the actual assessment administration.
8 PDE Policy – Test Security Test Security CertificationsThe Test Security Certifications must be signed after the assessments are administeredPrincipal, District Assessment Coordinator, School Assessment Coordinator, Test Administrator and Proctor (if applicable)Provided in Appendix D of Handbook for Assessment CoordinatorsAll other individuals handling secure materials MUST have a signed School Assessment Coordinator Test Security Certification on fileThe Chief School Administrator must retain all Certifications for three yearsDO NOT return these forms to DRC
9 PDE Policy – Test Security Test Security CertificationsIf an individual does not sign the appropriate Test Security Certification, the Chief School Administrator must provide the Department of Education’s Bureau of Assessment and Accountability with a written explanation of the reason or reasons why the Certification was not executed. The explanation must provide a description of the action taken by the Chief School Administrator in response to the failure to execute the Test Security Certification.
10 PDE Policy – Test Security PAsecureID List DistributionSchool assessment coordinators must generate a list(s) of students by PAsecureID to show all students taking the PSSA.The list should include for each student the test administrator, school name, year, and subject being administered.All lists must be retained at the district/school for three years; and be available when requested by PDE.
11 PDE Policy – Test Security Maintain test security:Refer to PDE security guidelines located atSearch for “Accommodations and Security”
12 Roles and Responsibilities District Assessment Coordinator (DAC)Attend required PDE trainingTrain school assessment coordinatorsReceive testsInventory testsDistribute tests to school assessment coordinator(s)Collect tests from school assessment coordinator(s)Inventory, package, and return tests
13 Roles and Responsibilities School Assessment Coordinator (SAC)Attend training offered by DACTrain Test Administrators (TAs) and ProctorsReceive tests from DAC (ship to district sites) or DRC (ship to school sites)Inventory tests for schoolPut labels on test booklets (Do not open test booklets while doing this!)Create testing schedule
14 Roles and Responsibilities School Assessment Coordinator (cont.)Distribute tests to TAs on the day and time scheduled for test administration.Monitor testing sessionsCollect tests from TAsMake sure no prohibited materials are on the classroom or hallway wallsMake sure tests are in a locked area with controlled and limited accessReturn all tests to DAC (ship to district sites) or DRC (ship to school sites)
15 Roles and Responsibilities You are responsible for the security and proper administration of these tests.
16 Roles and Responsibilities Test AdministratorsBe familiar with all testing protocols, including the “Ethical Standards of Test Administration (formerly the “DO’s and DON’Ts”)Follow all testing protocolsSign the Test Security Certification StatementMake students familiar with testing proceduresMake students feel comfortable
17 Roles and Responsibilities Test AdministratorsAnswer any questions students may have about test directionsWalk around the room during testingMaintain a calm, quiet environment during testingCollect and return test books to the SAC when testing is completeReport any suspected testing violations to the SAC and to PDE
18 Chain of Custody Tests should be secure at all times! DACs should inventory the tests as soon as they arrive in the District and keep them in a locked storage area that has limited access.SACs should inventory the tests as soon as they arrive in the School and keep them in a locked storage area that has limited access.
19 Chain of CustodyWhen distributing tests to TAs, the tests should be counted by the SAC in the presence of the TAWhen the tests are collected, they should be counted by the SAC in the presence of the TATests should be collected as soon as a testing session is completed unless another section is to be administered immediately
20 Chain of CustodyTests should be stored in a locked storage area. Only people who require access to the tests should have a key to the storage area.Samples of the test booklets are NOT to be furnished to the TAs as part of the training. TAs should NOT receive any test booklets until the test is to be administered.
21 Common ViolationsThe following are examples of testing violations. This is NOT an exhaustive list.Misuse of accommodations (e.g., reading the Math test to the entire class; reading aloud the Reading test)“Under” proctoring (e.g., inadequately monitoring the testing session)“Over” proctoring (e.g., reminding a student without the appropriate accommodation to answer a specific question)
22 Common ViolationsChanging answers or encouraging students to change their answers.Discussing the test or test questions with individual students.Reading aloud a math question or answer choice when doing so cues the correct answer.
23 Common ViolationsNot removing or covering instructional materials in the testing room or the hallways.Giving reminders to individual students or to the entire class (e.g., “Remember, we covered this last week.”)Allowing students to possess cell phones during testing.Allowing devices in the testing room that take pictures.
24 Common ViolationsCopying or recording any part of the secure test materialsViewing secure test material by teachers, proctors, administrators, etc.Returning test materials to students to complete or enhance answers
25 Potential Consequences of Testing Violations For Educators:Verbal reprimandWritten reprimandSuspension with or without payTerminationRevocation of certificationCriminal charges
26 Potential Consequences of Testing Violations For Students:Consequences for students violating test security (e.g., cheating, taking pictures of test questions) are up to the individual LEA.Students should be made aware of these consequences prior to testing.
27 Potential Consequences of Testing Violations For Students (cont.)If a student violates test security, it is the responsibility of the LEA to determine the consequences for the student. These consequences may include disciplinary action and/or the student retaking the test.ALL test security violations by students must be reported to PDE immediately.
28 Data Available to PDE - examples Student erasuresHow long it takes a student to answer an item when taking the test on a computerWhen answers are changed and how often they are changed on a computerStatistical analyses of student scores and performance
29 Cautions!Do actively proctor the test but don’t give any individual student help.Do encourage the class to check their answers but don’t encourage specific students to check their answers.Do report all prohibited actions.
30 Cautions!Do not review student test or answer booklets (except as stated in the Administration Manual and the Accommodations Guidelines).Do not assist, direct, or counsel students during the administration of the test in any way that would influence student answers.Do not provide answers to students.Do not alter, influence, or interfere with a test response in any way, fill in any unanswered item, or instruct the student to do so.Do not discuss or provide feedback regarding test items.Do not use the answer sheet as scratch paper or as a method to eliminate incorrect answer options.
31 To Report Suspected Violations, Contact The Pennsylvania Department of Education at 717-787-4234
33 Planning for the Assessment Testing Preparation DOs:Plan for testing rooms and timesPost PA General Description of Scoring GuidelinesMath Formula Sheet(s)Provide test administrators with:ManualsTest Security Certifications (located in back of PSSA Handbook)A schedule and plan for secure distribution and collection of materials after each sessionTraining to include correct labeling and codingTest administrators and students should have clear direction regarding the room and the time assigned for the administration of the tests.There should be a monitored area designated for any latecomers to prevent interruptions to a test session.To help facilitate a smooth test administration:For the writing test, the “old” Pennsylvania Domain Scoring Guide is permitted to be posted during the writing test, as well as the current Mode Specific Scoring Guidelines.All test administrators must be trained on how to administer the test. This allows new test administrators, as well as veteran test administrators, to feel comfortable with any changes in the PSSA tests.
34 Planning for the Assessment AccommodationsThe Accommodations Guidelines for students with IEPs, ELL students, and all students are available on department’s web site –The Federal No Child Left Behind Act requires that all students participate in the PSSAs.Remember that any accommodation used during PSSA testing should be part of the student’s everyday school environment.Students with disabilities are to be included in all state assessments and should be provided with appropriate accommodations.Accommodations should only be extended to the student as long as it does not compromise the integrity of the test.For example, Literature aloud the Literature assessment is not considered a valid accommodation since the purpose of this assessment is to measure skill in Literature and comprehending printed matter.A downloadable document outlining all acceptable accommodations is found on the Pennsylvania Department of Education’s web site.
35 Planning for the Assessment Be prepared for parental requests to view the test. Parental review must be done with a paper assessment booklet.Schedule small group setting(s).Schedule extended time setting(s).Assign test administrators for breaks and movement to other setting(s).Parental requests to view the tests must take place at the school or district setting with a monitor present at all times.Students that normally receive a small group setting for assessments should be provided with a similar setting.Parents must sign a confidentiality agreement before viewing any secure materials.
36 PASAEligible grade 3-8 students can participate in the PASA for Math, Reading, and ScienceIf a student meets the criteria to participate in the PASA, he/she must also participate in a school or district provided alternate assessment for Writing
37 ELL studentsELL students are treated the same as every other student with the following exceptions:Participation in the Math PSSA is mandatory but if the student is in their first year of enrollment in a U.S. school their scores do not count for AYP purposesParticipation in the Reading PSSA is optional for students in their first year of enrollment in a U.S. school
38 ELL studentsELL students are treated the same as every other student with the following exceptions:Participation in the Science PSSA is mandatory for students in their first year of enrollment in a U.S. school but scores do not count for AYP purposes
39 Administering the Assessment DO:maintain calm & quietremove or cover all instructional materialsprovide:blank scratch papersharpened pencilshighlightersencourage studentsreturn all test materials to secure locationDO NOT:allow unsupervised breaksdisplay visual cues (e.g., picture icons)provide pre-printed graphic organizersallow pens/colored pencils; stray marksprompt studentskeep any test materialsuse the answer sheet as scratch paperFor a more complete list of the PSSA dos and don’ts, reference the PSSA Handbook for Assessment Coordinators.You can clarify directions and offer encouragement to the students.Circulate around the room while the students are taking the assessment and be available as a resource.Allow students to create graphic organizers on the scratch paper provided at the time of testing without your assistance.Directions for all assessments may be read aloud, and a test administrator can have students explain directions aloud to confirm understanding.Algebra questions may also be read aloud; however, test administrators cannot read aloud any portion of the Literature assessment or the passages/multiple-choice portion of the Writing assessment.Some examples of items that cannot be present in the classroom include:Word walls, teacher-developed rubrics, vocabulary words and definitions, number lines, formula sheets (other than the official one from the assessment).Additionally, any hand-outs, posters, or charts developed as icons or visual clues to help students recall information are not allowed.You cannot help students answer items. This includes:• Helping the student eliminate some multiple-choice items, providing re-printed graphic organizers, pointing to key phrases in test questions for students, pointing to correct answers on the assessment, giving correct answers, or using a highlighter on the questions, text, or answers to prompt students.
40 Make-ups Make-up missed sessions as soon as possible Make-ups for all subjects can be administered up to the end of the testing window
41 Important Information The AYP Performance and Participation Attribution Map is located on the PDE website:Programs > Programs S-Z > State Assessment System>Pennsylvania Accountability System (PAS) > 2013 AYP Score and Participation Attribution MapA district that has placed a student into an alternate educational setting inside or outside the district is responsible for ensuring the student’s participation in the assessment.The AYP Score and Participation Attribution Map provides guidance for determining proper student attribution.Although the district is always responsible for ensuring that all of its students are tested, it is not necessarily responsible for ordering materials or administering the test to students who have been placed in educational settings inside or outside the district.
42 Important Information The entity delivering the student’s education is responsible for ordering and receiving materials and administering the test.Know your district’s procedures for Home Schooled students.Testing Cyber Charter School students.The testing site responsible for the education of a district-placed student is also responsible for ordering the testing materials and administering the test.This includes IU-run classrooms housed within a regular district school building. In this scenario, the district school building is responsible for ordering the materials so the IU personnel can administer the assessment to the students.The testing district is then responsible for attributing these students’ scores back to their districts/schools or residence.It is also important that Home Schooled students are handled properly by the district.A Cyber Charter School may enter into an agreement with districts to test students in the district. This does not alleviate the Cyber from responsibility. The student is attributed to the Charter School.
43 Bubbling booklets Bubbling booklets may include: And/or Filling in all information (for students who do not have a Precode Label)Demographic information provided on an answer booklet will not override information on a precode label.Please complete certain demographic information after the test has been completed (e.g., economically disadvantaged)And/orFilling in fields that are applicable to the testing situation (i.e., Accommodations)PDE asks that you bubble some of the demographic information AFTER the student has completed the assessment, for example economically disadvantaged and information regarding the testing situation.Some situations will require that you bubble much more information than others. For example, a booklet belonging to a student without a precode label will require more information to be bubbled than one belonging to an IEP student with a precode label. A precoded student’s answer booklet may only require that you bubble information regarding the testing situation.Ensure that the first name is bubbled the same as it is in PIMS.Information that is provided on an answer booklet will not override the information on the precode label.
44 Assessment Coordinators: Ensure all information is bubbled correctly! Demographic dataAssessment Coordinator?Race/ethnicityEconomic statusTest administrator?Other?Testing situation dataAssessment Coordinator?Non-assessed codesTest administrator?Absent without make upAccommodationsOther?
45 Assessment Coordinators: Training for those who will administer the assessment is required.Administrators must be a member of the school/district staff. No volunteers.This PowerPoint is available on PDE website.Utilize test administrator’s handbook.
46 Students who withdraw/transfer Student withdraws or transfers prior to the start of the testing windowPaper pencil testers – Discard student labelOnline testers – Remove student from test sessionStudent begins a test but is completely removed from the school’s enrollments before completing the entire assessmentPaper pencil testers – If the un-enrollment occurs before the end of the testing window, Place a “Do Not Score” label on top of the student label on the bookletOnline testers – Send an with student information (PAsecureID and School Code) and an explanation to
47 Encourage students to complete the test Encouraging students to meet only the minimum attempt logic may result in meeting the participation rate, but student’s score will be based on only those questions that were answered.Encourage all students to do their best!The attempt logic means that a student must attempt a minimum number of items in EACH section of the test.Encourage students as a group – you should not “check” individual answer sheets and point out questions for a student to complete.
48 Participation Does not negatively affect participation rate: Medical emergencyA recent physical or mental diagnosis that renders a student incapable of participating in the assessmentThe emergency is occurring at the time of the testing window. Mark the booklet at the time of the testing window!If you’re unsure, CALL!!!ELL student in his/her first year of enrollment in a US school (Reading only)Student participated in the PASACall PDE at if you have questions.
49 Participation Negatively affects participation rate Extended absence during entire testing windowParental requestOther – such as refusal to participateAbsent without make-upFailure to meet attempt logicThese items negatively affect participation.Student refusal should be bubbled as other.
50 Performance vs. Participation Only students enrolled for a full academic year (on or before October 1, 2012) count towards performance. ALL students must participate in the assessment.ParticipationEvery student enrolled as of the last day of the testing window must take the assessment.Participation - Every student enrolled as of the last day of the testing window (May 3, 2013) must take the assessment.Performance - Only students enrolled for a full academic year (on or before October 1, 2012) count towards performance. ALL students must participate in the assessment.
51 PDE-established Testing Windows Writing Testing WindowMarch 11-15, 2013Writing Make-up WindowMarch 18-22, 2013Reading/Mathematics Testing WindowApril 8-19, 2013Science Testing WindowApril 22-26, 2013Reading/Mathematics/Science Make-up WindowApril 29-May 3, 2013Materials should be returned when the majority of the population has completed an assessment.Ensure that early returns do not include booklets for students who need a make-up session.Make-ups can occur anytime during the PDE-established windowsLast day to return materials to DRC for all PSSA reporting is May 3, 2013
52 Key Dates Description Date Available PA Online Assessment Software Currently AvailablePA Online Assessment Test TutorialsManuals and User Guides (electronically)Handbook and DFA Hardcopies DeliveredBy February 11, 2013PA eDIRECT Test Setup System (online testing only)February 19, 2013Secure Materials DeliveredBy February 25, 2013PSSA Attributions/Demographic Corrections WindowMay 20-24, 20131% Redistribution WindowJuly 8-10, 2013District Student Performance Data Files and Parent LettersJune 13, 2013Preliminary Student Data Files and DRC AYP Reporting SystemJuly 22, 2013
53 Roles and Responsibilities District Assessment Coordinator (DAC)ResponsibilitiesOnlinePaper/PencilAttend DRC-led Assessment Coordinator trainingXVerify/set up eDIRECT accounts for District and School Users, and Test AdministratorsReview Handbook for Assessment Coordinators and DFAsReview Test Setup User GuideCreate and distribute a communication plan to all SACs prior to testingReview tutorials and Online Tools TrainingProvide training and support to SACsSchool Assessment Coordinator accounts in eDIRECT are established by the District Assessment Coordinator.This Administration Training is a train-the-trainer session. You are required to deliver this training to your School Assessment Coordinators.Anyone who is connected with the administration of the PSSA must be given this training.Test Administrators must be given ample time to read the Directions for Administration Manuals prior to orientation and the testing window.When scheduling the test sessions, the first days of the testing windows should be used to allow the school more flexibility if any unusual circumstances delay the anticipated start dates
54 Roles and Responsibilities School Assessment Coordinator (SAC)ResponsibilitiesOnlinePaper/PencilAttend DAC-led Assessment Coordinator trainingXVerify/set up eDIRECT accounts for school-level usersReview DFAs and distribute DFAs to Test AdministratorsReview Handbook for Assessment CoordinatorsReview Test Setup User GuideReview tutorials and Online Tools TrainingProvide training and support to Test AdministratorsSet up Test Sessions via eDIRECTCollect secure materials after testing and return to DAC or DRCSchool Assessment Coordinators can assign additional school-level permissions in eDIRECT.
55 Roles and Responsibilities Test Administrators (TA)ResponsibilitiesOnlinePaper/PencilAttend SAC-led Test Administrators trainingXReview Test Setup User GuideReview DFAsReview tutorials and Online Tools TrainingOversee and monitor Test SessionsCollect secure materials after testing and return to SACTest Administrators should ensure that all online testers have the opportunity to use the Tutorials and Online Tools Training.
57 Materials Receipt Notice NEWMaterials Receipt NoticeNEWNotice of Secure Material receipt MUST be provided via eDIRECTPermissions have been granted to District Assessment CoordinatorsDistrict Assessment Coordinators can provide permissions to School Assessment CoordinatorsThe Materials Receipt Notice must be completed in eDIRECT for every site that receives materials directly from DRC.<<CLICK>> When receiving your boxes of materials, make sure to check all of the labels to make sure they are yours and verify the number of boxes for which you are signing. Make sure you have the correct materials and sufficient quantities and verify that you have received the amount of booklets as indicated on your packing list. Make sure these are stored in a secure location.<<CLICK>><<CLICK>> Permission: Materials-Primary
58 The Materials Receipt Notice can be accessed by selecting ‘Materials’ from the eDIRECT navigation, then clicking ‘Receipt Notice.’On eDIRECT, go to Materials, Receipt Notice<<CLICK>>??
59 Accommodated Materials Accommodated Assessments are available in Braille and Large Print versionsAll student responses from Accommodated Assessments must be transcribed into a scannable answer booklet.A Spanish-translation version of the Mathematics and Science assessments are availableAdditional large print and Spanish-translation booklets must be ordered through eDIRECT.Contact DRC Customer Service for additional Braille booklets.<<CLICK>> When a student uses an accommodated version (Large Print, Braille), make sure all student responses (Multiple Choice and Open Ended items) are transcribed from the accommodated version into a scannable booklet using a number 2 pencil.All but Braille can be ordered through eDIRECT.No Audio CDs. Students needing the read aloud can take the Text-to-Speech accommodation through online testing.
60 NEW NEW Additional Materials Inventory/account for all materials. Additional materials should be requested AFTER material has been received and counts have been verified.All orders will be placed through eDIRECT, which will be available on February 19, 2013.Order additional materials as soon as possible.Additional orders must be placed through eDIRECT. DRC will not accept faxed forms or s to place additional materials requests.<<CLICK>> will be sent to the District Assessment Coordinators that the system is open.<<CLICK>> With the exception of ship-to-school sites, all additional materials will be ordered by and shipped to the District Assessment Coordinator.
61 Additional Materials Requests will be processed after the initial shipment of secure materials.
62 Match Booklets by Form Number The form numbers on the test and answer booklet MUST match to ensure accurate scoring of student responses.<<CLICK>> When distributing or redistributing answer booklets and test booklets, make sure the form numbers on the covers match.Form numbers are near the top. Make sure these match when distributing booklets.
63 Barcode LabelsAnswer booklets returned to DRC for processing must have a label attached.The only answer booklets that should NOT have labels attached are booklets that are unused and COMPLETELY blank.Whether a Student Precode or a District/School Label is used, page three needs to be filled out for any student using an accommodation, as well as any not tested codes on page one.DO NOT return a used answer booklet to DRC without a barcode label affixed to the front cover.<<CLICK>> Read slideThe barcode labels are not subject specific.Each school’s Student Precode Labels will be slip-sheeted by subject for ease of distribution; however, the labels do not contain a subject designation and can be used on any assessment.The District/School Labels and the Do Not Score Labels are not slip-sheeted by subject and may be used on any assessment.Booklets for students who are non-assessed and have been identified as such on the answer booklet must have a barcode label.Verify the number of booklets you need before you affix the labels.Do not attempt to move or remove any label that has been affixed to the front of an answer booklet.<<CLICK>> The accommodations information can only be reported at the time of testing.
64 Barcode Labels STUDENT PRECODE LABELS Student Precode Labels contain student demographic information as reported in eDirectPrecode labels for students no longer enrolled in your school should be destroyed.DRC cannot update a student’s record with new PIMS data if the name or PAsecureID printed on the precode label is different than the information in PIMS during the testing window.Read slideIf you receive a Student Precode Label for a student no longer enrolled at your school, destroy that label.The student demographic information associated with the Student Precode Label CANNOT be over-ridden by writing on the precode label or bubbling pages 1 & 2 of the answer booklet!Verify that the information printed on the Student Precode Labels is correct.<<CLICK>>If a student’s printed name or <<CLICK>> PAsecureID is incorrect (i.e., no longer matches what is in PIMS), do not use the label.DRC cannot update a student’s record with updated data from PIMS for final PSSA and AYP reporting if the name or PAsecureID printed on the label is different than the name or PAsecureID in PIMS during the testing window.All schools with precoded students in grades 4 – 8 or 11 will receive an additional set of Student Precode Labels for use with the PSSA-M Modified assessments.
65 Barcode Labels DISTRICT/SCHOOL LABELS District/School Labels contain district and school specific information only. These labels must beused when Student Precode Labels are not used.When using District/School Labels, the front cover and all applicable items on page 2 of the answer booklets must be hand-bubbled.Read slideDistrict/School labels are not subject specific.Never use labels from another school.Do Not make copies of labels.If you need more labels, fill out the additional materials request form found in the Handbook for Assessment Coordinators.
66 Barcode Labels DISTRICT/SCHOOL LABELS (cont) When using District/School Labels, the student’s name, birth date, and PAsecureID must be bubbled exactly as it appearsA student’s name, PAsecureID, and birth date must be bubbled on the answer booklet exactly as it appears in PIMS in order to match the student to the PIMS file for reporting.For example, if a student’s legal name in PIMS is Thomas, do not use Tom. If you use Tom, we will not be able to match back and use the correct data from PIMS for reporting.in your school’s student information system.
67 Barcode Labels DO NOT SCORE LABELS All sites will receive Do Not Score Labels for answer booklets that should not be scored.If a District/School Label is inadvertently affixed to a blank/unused booklet, affix a Do Not Score Label over it.Do Not Score Labels should be used if a booklet becomes torn, soiled, or is found to be defective.Student responses must be transcribed into an answer booklet of the same form designation if a student has begun working in a booklet that becomes unusable.
68 Do Not Score Labels must be affixed over any label already on the booklet.
69 Distributing and Tracking Secure Materials Use the Security ChecklistUpdate the Materials Accountability Form
70 Destroyed due to illness 2012Mr. Gillin4/164/174/18Keep your security checklists on file after you’ve returned your materials to DRC. The checklist can be very beneficial in determining the location of a missing booklet.Here is an example of how you might use the Security Checklist. <<CLICK>> talk to slide <<CLICK>> talk to slideElectronic versions of a school’s Security Checklist will be available by ing after February 27, 2013.Destroyed due to illnessMartin Pinkerton4/22‹#›
71 Materials Accountability Form NEWMaterials Accountability FormNEWAvailable electronically via the eDIRECT websiteInventory all materials to be returned to DRCDocument discrepancies in the online formForm can be accessed and updated throughout the testing windowUpdates should be made by May 3, 2013Every testing site is responsible for completing a Materials Accountability Form via eDIRECT.The Materials Accountability Form is your tool for notifying DRC of discrepancies in the receipt or return of secure materials.
72 The Materials Accountability Form can be accessed by selecting ‘Materials’ from the eDIRECT navigation, then clicking ‘Accountability Form.’
73 Return Instructions – Answer Booklets Remember that all answer booklets (used and unused) should be boxed separately from test booklets.<<CLICK>> Place answer booklets into a DRC return plastic bag.<<CLICK>> Using the supplied plastic ties, seal the bag tightly.<<CLICK>> Place sealed bag into a DRC box saved from the shipment.<<CLICK>> Add crumpled paper to fill up any space at top of box.
74 Return Instructions – Answer Booklets Use the box-flaps labeled A and B to affix the appropriate Return Shipment labels.All DRC boxes have flaps labeled A or B. These are the smaller flaps.<<CLICK>> When closing boxes, make sure to close the larger flaps first, making sure the to keep the A and B flaps exposed.<<CLICK>> Seal the top of the box using 3 strips of packing tape, making sure to overlap the tape and extend it so that it wraps around the sides of the box.<<CLICK>> Place a DRC return Shipping Label in box A<<CLICK>> Place a UPS-RS label in box B<<CLICK>> Seal the bottom of the box using 3 strips of packing tape, making sure to overlap the tape and extend it so that it wraps around <<CLICK>> the sides of the box.
75 Return Instructions – Test Booklets and Unopened Packages Test booklets and unopened packages (shrink-wrapped packs) do not need to go into a plastic bag.These materials can be placed directly into a box.<<CLICK>> Make sure to add crumpled paper to fill up any empty space.
76 Return Instructions – Test Booklets and Unopened Packages Follow the same labeling and sealing procedures for the boxes of test booklets.<<CLICK>> Make sure to use 3 strips of tape and place the DRC Return label in box A and the UPS-RS label in box B.<<CLICK>> Make sure to add 3 strips of tape to the bottom and make sure the tape wraps around and up the sides.
77 Return Instructions Material Pick Up If you do not have a regularly scheduled UPS pick-up or delivery, call UPS at (866) to arrange a pick up at least 24 hours prior to your requested pick-up.All Writing booklets must be shipped by March 27, 2013.All Reading/Math and Science booklets must be shipped by May 3, 2013.
78 Special Note Keep a copy of the UPS-RS tracking numbers used. When DRC has questions about a district’s assessment materials, we make follow-up phone calls after the testing window has closed.It is important to return these calls as soon as possible in order ensure fast and accurate reporting and to keep your schools off the missing materials report sent to PDE.Make sure that school personnel answering phones know who is responsible for handling PSSA questions from DRC.
81 System Overview Internet connectivity is required for testing Student responses are regularly saved to DRC servers throughout testingThe PA Online Assessment software must be installed on all computers to be used for testing. This should be done as soon as possible.
82 Administer TutorialsPrior to online testing, ensure students view the video tutorials for the applicable subject(s)Allow a minimum of 20 minutes for viewingTutorials can be reviewed as often as needed
83 PA Online Assessment Tutorials Access by double-clicking PA Online Tutorials icon on computer desktop
84 Administer Online Tools Training Students can practice using the online tools and become familiar with functionality of the softwareSchedule time for students to take the Online Tools Training (OTT) prior to testingOne OTT for each subjectAllow 15 minutes to take a single OTTDACs, SACs, and TAs should use OTT prior to administering an assessment
85 Online Tools TrainingAccess by double-clicking PA Online Assessments icon on computer desktop
86 Verify Student DataStudent data from a PIMS file cannot be updated in eDIRECTIf a student is not listed in eDIRECT, the student may need to be added to the system
87 Add Students – Manual Entry Click Add StudentEnter all required fieldsClick Save
88 Manage Students – Online Accommodations Use the Accommodations tab to enter student accommodationsThe Audio and Color Chooser Accommodation must be updated prior to testing
89 Create Test Sessions Select Test Sessions Select administration and schoolClick Show SessionsClick Add SessionsEnter required informationSearch for and assign studentsClick Save
90 Print Student Login Tickets Find Test SessionSelect Edit/Print iconClick Print All to print all the test tickets in the sessionClick Print Selected to print only selected test tickets in the sessionDay of Testing - Provide tickets to TAs/Teachers
91 During Testing Monitor student testing Test inactivity Pausing and exiting the testLoss of Internet connectivity
92 Special SituationsIf any of the following situations occur, send an with the student’s information and an explanation toStudent goes home ill before completing online assessmentStudent begins testing with wrong test ticketStudent begins testing with wrong accommodated versionStudent begins testing in the wrong subject
93 Collect MaterialsTAs must return all Student Login information and scratch paper to the SACAfter testing is complete, SACs must destroy the documents to ensure that secure data is not compromised
94 Testing CodesAccess the Edit Student page to update Testing Codes for a student
95 To contact someone from the Pennsylvania Department of Education The mission of the Pennsylvania Department of Education is to lead and serve the educational community, to enable each individual to grow into an inspired, productive, fulfilled lifelong learner.To contact someone from the Pennsylvania Department of Education(717)Or(717)
96 PA CUSTOMER SERVICEData Recognition Corporation understands the intricacies involved with large scale assessments.Our customer service representatives are always ready and willing to help with any questions or problems.Our number isOr us at
97 PSSA 2013 Test Proctor Procedures Review of Materials Security ProceduresEmbargoQuarantine at Selected SchoolsReminder - Submit Testing SchedulePDE Requirements
98 Test Proctoring Procedures Following is not allowedTeachers administering the test to their own students.E.g. A math teacher may administer the math test as long as he/she isn’t administering it to his/her own studentsThe same applies for Reading, Writing, and ScienceException for accommodationsOnly if the teacher provides unique accommodationOnly if there is a second proctor in the roomSchools
99 Scope of Monitoring Monitors will circulate through classes All SchoolsMonitors will circulate through classesMonitors will inspect test materials storage area using a new Materials Inspection formMonitors may observe small-group testingSelect group of schools receive enhanced monitoring
100 Embargo - Materials Security Schools must leave all testing materials in shrink-wrap until directed by the Office of AccountabilitySchool can unbox packets to count materialsOA delegate informs school when they may open materialsEmbargo will generally be lifted 1 week prior to testingIf you have not been contacted by Monday, April 1st (March 4th for writing and April 15th for science) , you may open materials on Tuesday, April 2nd (March 5th for writing andApril 16th for science)All Schools
101 Firm Embargo - Materials Security Before testing begins, schools may be asked to leave all testing materials unopened until directed by the Office of AccountabilityOA delegate inspects and secures materials upon receiptOA delegate informs school when they may open materialsOA delegate randomly inspects materials prior to testingSelected Schools Only
102 Quarantine - Materials Security During testing, the storage and distribution of testing materials may be supervised by delegates from the Office of AccountabilityFor selected schools, testing materials are stored by an OA delegate in a secure manner between testing sessionsFor selected schools, OA delegate arrives to open secure testing materials the morning of testing and remains on-site to re-secure materials once testing concludes for the day.Selected Schools Only
103 !REMINDER! Submit Testing Schedule Schools required to submit Testing Schedule to Office of Accountability no later than March 8Please use the online form located on OA website
104 PDE Requirement ---NEW BY April 5thThe Test Coordinators (called School Assessment Coordinators, SACs) MUST take a 45-minute online training and Pass with a score of 80% or better andAll the test administrators (TAs) and proctors at the school MUST complete this trainingThe training video MUST be included in the turn-around training on March 7‹#›
105 PDE Requirement ---NEW Schools MUST inform the parents and students of PDE’s policy on the possession and/or use of electronic devices during testingSchools come up with consequences of non-compliance and inform parents and studentsMust be done by March 11(sample letter in the folder)
106 PDE Requirement - Testing Rosters PDE asking for student-level test administration dataVerify and/or list the staff member who administered the Keystone for each studentIndicate any student that required make-up testingExcel file will be sent prior to testing and must be returned when testing is completed; pre-loaded data where possible
107 PDE Requirement - Certification Principal, School Assessment Coordinator, Test Administrator, and Proctor must sign a Test Security CertificationMust be signed after testingSecurity Certifications will be kept on file for 3 years at the school
108 Contact InformationOffice of Accountability websiteContact InformationOffice of Accountability/Assessment ( )DRC's Customer Service Representatives ( )