1. EOCEP FALL/WINTER 2014– 15 STC & TA TRAINING TOOL AUDIO PRESENTATION FOR SCHOOL TEST COORDINATORS FROM J. EPPS (7.5 MINS) AUDIO PRESENTATION FOR SCHOOL TEST COORDINATORS FROM J. EPPS (7.5 MINS) Located on eDIRECT under Documents/Presentations 1

2. Table of Contents TOPICSLIDE NUMBER Key DatesSlide 3 ResourcesSlide 4 What’s New or ChangedSlides 5–10 Test SecuritySlides 11–27 Test Security ScenariosSlides 18–27 STC ResponsibilitiesSlides 29–34 TA ResponsibilitiesSlides 35–38 Monitor ResponsibilitiesSlides 39–41 Online TestingSlides 42–57 Paper/Pencil TestingSlides 58–84 Materials Return ProceduresSlides 80–84 ReportsSlide 85 2

3. Key Dates DATEDELIVERABLE Oct. 7Test Administration Manuals arrive in districts; TAMs and DTC Supplements posted to eDIRECT Nov. 3Online Testing Software, OTTs, and Tutorials available Nov. 17Test Setup available in eDIRECT Nov. 17Secure materials – shipment 1 – delivered to districts Nov. 26Precode labels delivered to districts Dec. 17 Jan. 5-23 Jan. 5-16 Secure materials – shipment 2 – delivered to districts Online Testing window for SCPCSD Paper/Pencil Testing window for SCPCSD Feb. 2Last day to return materials Feb. 2 – Mar. 27ALTERNATIVE TESTING WINDOW Mar. 6Data files, ISRs, and rosters available on eDIRECT Mar. 20ISRs and student labels delivered to districts 3

4. Resources Test Administration Manual for Online and Paper/Pencil Testing (October 7) STC/TA Training Tool (October 21) Online Testing Technology Training Presentation (October 21) DRC INSIGHT Technology User Guide (November 3) Electronic Security Checklists and Packing Lists (November 14) 4

5. What’s New or Changed  GENERAL  New Algebra Course Code Intermediate Algebra: Functions & Modeling – 4117 Added to Answer Document, Header, and Test Setup  Test session durations in TAM Two (2) hours per test session is recommended Afternoon test sessions must be scheduled with sufficient time to allow students to finish testing in one day  TA Field – paper answer document and online testing seating chart 5

6. What’s New or Changed  ONLINE TESTING  TSM update Version 7.0.X More information in INSIGHT Technology User Guide and in Technology Training Presentation (updated for FW 2014-15)  Seating charts Required for every test session Secure and must be returned after testing Include: Layout of testing room Student first initial and last name Incorrect in TAM; above is the correct, required student name information Test session name TA Name 6

7. What’s New or Changed  OTT updates Oral Administration (HVA) OTT now available for all subjects Usernames and passwords appear on screen Public version of OTT available for standard (non-HVA forms) https://wbte.drcedirect.com/SC/portals/sc Accessed via Google Chrome INSIGHT software download not needed Available November 3 Updated to include technology enhanced (TE) item types for English Be sure to schedule practice sessions for students; separate from regular testing time. 7

8. What’s New or Changed  Procedures for Unlocking Tests See page B-26 in the TAM for actions to take It is not necessary to contact the SCDE if locking and unlocking occur in the same day.  Test Regeneration Automatic process when accommodations updated More information on slide 53 8

9. What’s New or Changed  Return of Nonscorable Materials Securely destroy: Student Test Tickets Testing Rosters Any paper with student writing Return via email: Completed security checklists and seating charts Materials returned via email must not contain personally identifiable information (PII). 9

10. What’s New or Changed  PAPER/PENCIL TESTING  Electronic security checklists only Paper (triplicate) copies no longer provided 10

11. Test Security 11

12. Test Administration Manual  Please read the EOCEP Test Administration Manual (TAM) carefully. The information in this presentation is intended to supplement, not replace, careful reading of the TAM. 12

13. Test Security  Test procedures are standardized.  Administration directions must be read as written in the TAM.  Pages 2-4 of the TAM provide a list of violations that could result in criminal prosecution and/or disciplinary action to an educator’s professional certificate. 13

14. Test Security  Most EOCEP materials are secure.  Test materials must be kept in secure, locked storage when not in use.  Secure materials must not be stored in a room that has a copy machine or fax machine. 14

15. Test Security  During testing, a trained TA must be present at all times in the classroom or computer lab.  If the TA must leave the room before testing begins, the test booklets, answer documents, and/or online student test tickets and test rosters must be stored securely or kept with the TA.  TAs should not discuss test questions with students at any time.  School personnel must not read test items at any time. 15

16. Test Security Agreement Forms  All school and district personnel who will have access to secure test materials are asked to sign an Agreement to Maintain Test Security and Confidentiality form.  Test security forms should be signed and returned to the DTC after each person has participated in EOCEP training.  Updated test security forms are for EOCEP only. 16

17. Test Security Violations  If a test security violation is observed within a school, it must be reported to the STC or DTC as soon as possible.  The STC and/or DTC must complete a Test Security Violation Action Form.  Send the completed form to Kathryn Rhodes at the SCDE. 17

18. Test Security – Case 1 During an EOCEP small group administration, a student told the administrator that she had reviewed a question with her teacher, Ms. Greene, the previous day. When questioned, Ms. Greene indicated that she had reviewed ten questions from the previous year’s test with her students. She remembered the questions were ones that her students had difficulty with on last year’s exam. 18

19. Test Security – Case 2 Several months before the test, Mr. Bright was given worksheets by another teacher. The teacher told Mr. Bright that the materials would help his students prepare for the EOCEP Algebra 1 test. Mr. Bright copied the worksheets and gave them to the other Algebra teachers in his school. The teachers used the worksheets with their students to review for the EOCEP test. After testing, one of the teachers noticed that one page of the worksheet had a footer that stated “EOCEP: Secure Test”. 19

20. Test Security – Case 3 Mrs. Cross picked up her son, Lane, from Poet High School on a day in which he had taken the EOCEP English 1 test. She asked Lane how he had done on the test. Lane told his mom that she didn’t need to worry because his teacher had helped him. Lane said his teacher walked around the room during the test, looking over the student’s shoulders at their computer screens. Occasionally, the teacher would point to an answer on the screen indicating that Lane should change his answer. 20

21. Test Security – Case 4 Ms. Dixon was a first-year teacher administering EOCEP to her high school students. She seated her students in the media lab according to the seating chart she had made. She then read the directions and passed out the online test tickets. Ms. Dixon wanted to administer the test properly. Even though she had attended a pretest training workshop, she felt uncertain about whether she had delivered the directions properly. She went to the teacher next door to ask about administration directions. 21

22. Test Security – Case 5 Ms. Douglas was a compassionate teacher. She wanted all of her students to do well on the EOCEP Algebra 1 test. She walked up and down the aisles during testing to check student progress and give them a “pat” of encouragement. At one point, she saw that Sheila was only on number 15 and noticed that the student was not feeling well. She asked the student, “Is your arm hurting you?” Sheila said yes, so Ms. Douglas helped Sheila to exit the online test and then she took Sheila to the nurse’s office. 22

23. Test Security – Case 6 Mr. Edwards, a teacher at Springfield High School, is very thorough. He wants to make sure that students get as many points as possible on the EOCEP. During testing, as each student finishes, he asks them to go to the Review/End Test screen. If he sees a blank response, he instructs the student to return to the item and answer it. 23

24. Test Security – Case 7 The STC told Mr. Jones to check the roster to determine the accommodations Lindsay would need when taking the online EOCEP English 1 test. During testing, Mr. Jones forgot to pass out headphones to students who needed oral administration. Toward the end of the testing session, the STC stopped by Mr. Jones’ room and noticed that Lindsay was not wearing headphones. The roster indicated that oral administration was specified in her Individual Education Program (IEP). 24

25. Test Security – Case 8 Ms. Carboni, the TA, directed the monitor, Mrs. James, to answer student questions during the EOCEP Algebra 1 test. When one student raised his hand, Mrs. James read the question and the four answer choices to him. The student did not have an IEP or 504 Plan and was not an ESOL/LEP student. 25

26. Test Security – Case 9 Ms. Ortlund, the Test Administrator, began to read the Online Administration Directions for the EOCEP Biology test. She read the section informing students that they may not have any electronic devices but she did not collect the students’ cell phones, nor had she asked the students to place their belongings at the front of the room before the test. During the test, she saw a student pull his cell phone out of his pocket and appear to be photographing the computer screen. 26

27. Test Security – Case 10 In order to save time, Mr. Fatica decided to have his students practice the Online Tools Training (OTT) immediately before the actual test administration. To be efficient, he handed out the student Test Tickets as soon as the students were seated. The class then began to work on the OTT as a group, openly discussing the practice items. Four students mistakenly used their test tickets to login to their actual tests during the OTT session. At the end of the practice session they had nearly completed the entire test. 27

28. STC, TA, & Monitor Requirements 28

29. School Test Coordinator Requirements  STCs must be:  Certified employees of the district  Knowledgeable about test security and testing policies  STCs must attend a training session conducted by the DTC.  STCs must read and understand policies and procedures outlined in the TAM.  STCs must read and sign the appropriate Agreement to Maintain Test Security and Confidentiality form. 29

30. School Test Coordinator (STC) Responsibilities  STCs must notify students and parents of the testing schedule.  STCs must hold training sessions for TAs and monitors.  STCs must distribute and collect signed Agreement to Maintain Test Security and Confidentiality forms.  If online testing, STCs must read the INSIGHT Technology User Guide, available on eDIRECT. 30

31. School Test Coordinator (STC) Responsibilities  Inventory test materials.  Record any missing materials on the School Security Checklists.  Notify the DTC if any secure materials are:  damaged;  missing;  or if any additional materials are needed  Note: Algebra reference sheets and graph paper are not provided in hard copy for online testers. 31

32. Handling Secure Materials  Store in a secure location.  Prepare test materials for distribution.  Distribute test materials to TAs on the day of testing only. 32

33. Security Checklists  Paper security checklists will no longer be provided.  Electronic copies will be available on eDIRECT.  STCs email security checklists to their DTC. 33

34. STC Procedures During Test Administration  Ensure TAs receive all secure test materials they will need to administer the exam.  Make sure TAs receive reference sheets, graph paper, and other supplemental materials, if applicable. 34

35. Test Administrator Requirements  A TA must meet one of the following criteria:  Certified employee  Critical needs teacher  Substitute teacher  Certified teacher with an expired teaching certificate  Non-certified employee approved by the DTC  Attend a training session.  Sign the Agreement to Maintain Test Security and Confidentiality form. 35

36. TA Responsibilities Before the Test Administration  Read the Test Administration Manual. Understand all policies and procedures.  Make sure the classroom is ready for testing.  Assist with the coding of answer documents, if applicable, for paper/pencil testing.  Create a seating chart for each online test session. 36

37. TA Responsibilities During the Test Administration  Collect all prohibited electronic devices, or preferably, ask that students place their book bags and other belongings together at the front of the testing room.  Hand out test booklets and answer documents.  Follow the Administration Directions in the TAM.  Ensure students are following the directions. 37

38. TA Responsibilities After the Test Administration  Complete answer document demographic information, as needed.  Place Braille materials into the plastic bag.  Sign in secure materials on the School Security Checklist. 38

39. Monitor Requirements  Use of monitors is recommended, and monitors must be trained.  Monitors must sign an Agreement to Maintain Test Security and Confidentiality form.  Monitors cannot be in rooms where their close relatives are being tested.  Monitors must not be left in charge of a test administration session. 39

40. Monitor Responsibilities  Distribute and collect test materials.  Ensure students receive the correct answer documents.  During testing, ensure students:  Follow directions  Mark their responses in the appropriate area of the answer document  Use only the allowable supplemental materials specified in the TAM  Do not give or receive help to or from other students 40

41. Monitor Responsibilities  Help maintain test security.  Refer all student questions to the TA.  Check restrooms for reference materials such as books or notes.  Retrieve additional test materials from the STC if needed during testing.  Serve as a messenger between the TA and the STC. 41

42. ONLINE TESTING 42 November 3INSIGHT Software and TSM Updates Online Tools Training (OTT) Tutorial November 17Test Setup Available December 1 – January 28 January 5-23 State Testing Window District online window is Jan. 5-23 February 2 – March 27Alternative Testing Window

43. Online Testing  SEATING CHART  Required for each online test session  Include test session name, TA name, all student first initials and last names, and seating locations Note requirement for student names above; incorrect in TAM  Can be created using graph paper or other paper  PowerPoint seating chart creator available on eDIRECT  Secure material; must be returned after testing  STCs send completed seating charts to DTCs; DTCs send via email to SC Project Team 43

44. Online Testing– Training & Support  TUTORIAL  Available via eDIRECT (no login required)  Desktop link when INSIGHT software is installed  Includes audio narration  Guides TAs and students through testing experience, including testing tools and navigation  Highly recommended to be used prior to Online Tools Training (OTT) May be used in a large-group setting 44

45. Online Testing– Training & Support  ONLINE TOOLS TRAINING (OTT)  Available within INSIGHT software Regular and oral administration (HVA) versions available for all subjects  Public version available: https://wbte.drcedirect.com/SC/portals/sc Does not include audio for oral administration  Simulates the student testing experience Correct answers and scores not provided  Technology enhanced item types included for English  Highly recommended that students review as much as needed prior to testing; opportunity to become familiar with online testing tools and functionality 45

46. Online Testing– Training & Support  TAM – TEST SETUP (eDIRECT)  Includes instructions and screen shots for managing testing Student – profiles and demographic information Test Sessions Print rosters and test tickets Monitor testing 46

47. Precode  All student records from the precode update file will be loaded into eDIRECT and placed into a test session.  Students testing online  Demographic information may be modified in eDIRECT  Students testing paper/pencil  No action is needed in Test Setup  Students do not need to be removed from test sessions  Paper/pencil testers can be changed to online testers  New students can be added, as needed 47

48. Prepare for Online Testing  Read the Test Administration Manual for Online and Paper/Pencil Testing  Read the INSIGHT Technology User Guide  Schedule sessions for students and test administrators to view the Tutorial  Schedule sessions for students to use the Online Tools Training (OTT)  OTT sessions must be separate from and prior to the operational testing session. 48

49. Online Testing Accommodations ONLINE ACCOMMODATIONFEATURES Oral Administration Human Voice Audio (HVA) for directions, items, and passages (same audio as CD-ROM) Text-to-Speech (TTS) for tools and Help content Schools must provide headphones Loose-Leaf Same as regular Form A test Paper test booklet also provided Loose-Leaf + Oral Administration Same features as oral administration; student must also have loose-leaf accommodation Schools must provide headphones 49

50. Online Testing Accommodations ONLINE ACCOMMODATIONFEATURES Large-Print Fully scalable; students can view items in larger format by testing at workstation with larger monitor Text and graphics approx. 30% larger, depending on monitor size and screen resolution Same scaling of items using a 20-inch monitor versus a standard 15-in monitor Large-Print + Oral Administration Same features as oral administration; student must also have large-print accommodation Schools must provide headphones Sign Language Same Form C test a paper/pencil student would receive Video Sign Language (VSL) for ASL and PSE is not available for Fall/Winter 2014-15. 50

51. Human Voice Audio (HVA)  When audio is playing (stop/starting points/pause):  When audio is not playing (stop/starting points/play): 51

52. Test Setup – Rosters & Tickets  STUDENT TEST ROSTER  Contains form number and username/password assigned to each student  Can be exported to Excel spreadsheet  Can be used as security checklist to sign in/sign out test tickets  Secure material – must be distributed, collected, accounted for, and securely destroyed following testing May not be transmitted via email or insecure fax 52

53. Test Setup – Rosters & Tickets  STUDENT TEST TICKETS  Generated automatically  Contain all login information needed to begin testing Passwords are case sensitive  STC or TA prints tickets and roster prior to testing  TA verifies that each student has the correct ticket  Tests activated once a student logs in with username and password printed on ticket Stagger logins to help avoid login issues due to bandwidth  Secure material – must be distributed, collected, accounted for, and securely destroyed following testing 53

54. Test Setup – Tickets 54

55. Regenerating a Test  AUTOMATED PROCESS  If a student’s accommodations are updated, the ticket will be automatically updated, if needed.  eDIRECT message will tell user if a new ticket needs to be printed.  If accommodations are updated for a student who has started testing the ticket will not automatically regenerate. STCs should contact the DTC for any students who start testing without the appropriate accommodations. 55

56. Restarting a Test  Students can “Pause” and then have 20 minutes to resume testing  If student does not return within 20 minutes, student can log in later the same day using the same test ticket  Student responses, sticky notes, highlighters, flags, and cross- offs will be saved  A test may be exited due to inactivity (fire, drill, student left without clicking “Pause”)  If student does not return within 20 minutes, student can log in later the same day using the same test ticket  Student responses, sticky notes, highlighters, flags, and cross- offs will be saved 56

57. Restarting a Test, continued  If the student does not resume testing that day, contact the SCDE and SC Project Team for approval to have the student’s test unlocked (see page B-26 of the TAM for actions to take).  If a student submits a test by mistake:  If testing is to resume the same day, contact the SC Project Team to have the student’s test unlocked.  If testing is to resume a different day, contact the SCDE for approval to unlock the student’s test. Then contact the SC Project Team to have the test unlocked. 57

58. PAPER/PENCIL TESTING 58 January 5-16District paper/pencil testing window February 2 – March 27Alternative Testing Window

59. Test Booklets and Answer Documents  Students receive the following materials:  One answer document for each subject  One test booklet for each subject  Customized test booklets, if required 59

60. IEP/504 Plan Accommodations  Setting  Timing  Scheduling  Presentation  (See Appendix C in TAM for additional information) 60

61. IEP/504 Plan Accommodations, continued  Response Options  Nonverbal indication of answer choices  Dictation of responses  Braille response options  Responding in the test booklet  Supplemental Materials and Devices  See TAM Appendix C for additional information 61

62. ESOL/LEP Students  Accommodations  Bilingual dictionary  Reward and/or translate directions  Oral administration (Algebra, Biology, and U.S. History)  Individual or Small Group Administration/Setting  Timing  See TAM Appendix D for additional information 62

63. Materials – Form A  REGULAR FORM A  Test Booklet  Answer Document  Oral Administration Script Use with base form (form number ends in zero) of Form A TB when oral admin is identified in IEP  Audio CD-ROM Use with base form of Form A TB when oral admin is identified in IEP PC-compatible 63

64. Materials – Form A  LOOSE LEAF  Test Booklet Algebra, Biology, USHC – one question per page English – passage over multiple pages; multiple items per page  Answer Document Not included in the test packet Answers must be recorded in an answer document for scoring  Oral Administration Script or Audio CD-ROM Can be used with loose leaf test booklet 64

65. Materials – Form A  LARGE PRINT  Test Booklet Algebra – reference sheet, large print ruler, and graph paper also included  Answer Document Not included in the test packets Answers must be recorded in an answer document for scoring  Oral Administration Script or Audio CD-ROM Can be used with large print test booklet 65

66. Materials – Form C  SIGN LANGUAGE  Test Booklet  Answer Document Not included in the test packet Answers must be recorded in an answer document for scoring  Sign Language DVD Use with Form C TB when signed admin is identified in IEP ASL and PSE available on the same DVD Use with DVD player or computer with DVD capabilities 66

67. Materials – Form C  BRAILLE  Test Booklet Print and brailled versions Braille TA notes also included Algebra – braille reference sheet and braille ruler included  Answer Document Not included in the test packet Student may use a braillewriter or other method. TA transcribes responses into answer document.  Braille Oral Admin Script/Braille Audio CD-ROM Use with Form C TB when oral admin is identified in IEP PC-compatible 67

68. Response Options – Responding in the Test Booklet  Responding in the test booklet is an IEP/504 standard accommodation.  TA must transfer the student’s multiple-choice responses from the test booklet into the answer document.  Monitor must verify responses were recorded accurately.  TA codes the “Response Options” bubble in the IEP/504 Standard Accommodations box on page 1 of the answer document. 68

69. Administering the Test  Administration directions include information to be read to students.  TAs must read aloud the test that is printed in the shaded boxes.  TAs and monitors should distribute materials when indicated in the Administration Directions. 69

70. Administering the Test  Four sets of administration directions are provided in the TAM.  Algebra 1/Mathematics for Technologies 2 (TAM pages 65-68)  Biology 1/Applied Biology 2 (TAM pages 69-71)  English 1 (TAM pages 72-74)  United States History and the Constitution (TAM pages 75-77) 70

71. Labeling Answer Documents – Precode Labels  Precode labels are produced for students who have their online testing flag set to “N.”  Coding the student’s name by hand onto the answer document is not mandatory, but is strongly recommended.  Districts can check hand-coded information that is reported on the data file.  The contractor also uses hand-coded information as a double check if answer document information needs to be researched.  Hand-coding is mandatory when a precode label is not used. 71

72. Labeling Answer Documents – Precode Labels 72

73. Answer Documents  One per subject – Form A and Form C testers  Students must record responses in an answer document  If IEP allows student to respond in the test booklet, the TA and monitor must transcribe responses into an answer document  PS# and Student State ID – start coding at left; leading zeroes not necessary  Do not open unused, shrink-wrapped packages  TA INITIALS – added to front of answer document  Instructions in TAM for students to code TA initials 73

74. Coding Answer Documents 74

75. Coding Answer Documents 75

76. School/Class Header Sheet  Header is brown  Complete one for each class and subject area  Use leading zeroes for section number  Ensure Tested School and Reported School SIDNs are valid  Instructions for coding are located on back of header 76

77. School/Class Header Sheet Discrepancies and Issues – may affect 36-Hour reporting Student Information System (SIS) Code incomplete Multiple subjects under a single header Invalid tested or reported school SIDN Instructional Activity Code does not correspond with the answer documents under the header 77

78. Labeling Answer Documents – Do Not Score Labels  Apply Do Not Score Labels to:  Used or mislabeled answer documents that the contractor should not score.  Do Not Score Labels are white and are printed 10 per sheet.  Return answer documents with Do Not Score Labels in boxes designated as “nonscorable”.  Do NOT apply Do Not Score Labels on:  Unused overage answer documents (Do not open unused, shrinkwrapped packages of answer documents).  Answer documents with the IEP Invalidation bubble marked. 78

79. STC Return Procedures  Verify every answer document is hand-coded correctly.  Verify every header is hand-coded correctly.  Teacher name  SIDN(s)  SIS Code  Number of answer documents returned under header sheet  Use, sign, and return security checklists. 79

80. STC Return Procedures Ensure headers are placed with corresponding answer documents. Classes/subjects may be mixed within boxes. Place all scorable materials in the plastic bag provided by DRC. 80

81. Packaging Procedures  Place all scorable test materials in plastic return bags provided by the contractor, seal the bags tightly, and place them in the scorable boxes.  Place all nonscorable test materials in the nonscorable boxes. (Plastic bags are not needed for nonscorable materials). 81

82. Packaging Procedures  Fill any empty space in the boxes with crumpled paper or bubble wrap ensuring that testing material does not shift during transit. Make sure voids are filled to the top of the box.  Fold the outer flaps (with old shipping labels) in, exposing the A & B flaps. 82

83. Packaging Procedures  Tape boxes securely by using three pieces of packing tape on BOTH the top and bottom. Overlap the tape, and make sure it wraps around the sides at least two inches. 83

84. Reports  36-hour Reports – Web view and CSV  Email to district and school when updated  Electronic reports posted to eDIRECT  Data Files  Individual Student Reports  Summary Reports  Rosters  Reports from fall/winter 2013-14 removed on March 6  ISRs and student labels arrive in districts on March 20 84