North Carolina EXPLORE and PLAN Test Administration Training September 11, 2012

Carol Clark Senior Coordinator Contract Operations Management ACT, Inc. Iowa City, Iowa

Serves as the entry measure of academic progress toward college and career readiness when used with PLAN and the ACT Designed to help 8 th and 9 th grade students Curriculum-based achievement test that measures college readiness Assesses academic progress Helps students understand and begin to explore the wide range of career options open to them Career Interest Inventory and educational/career plans collected

Provides a midpoint assessment of academic progress toward college and career readiness when used with EXPLORE and the ACT Designed to help 10 th grade students Curriculum-based achievement test that measures college readiness Most powerful predictor of performance on the ACT Used for course placement including dual-enrollment/rigorous courses Career Interest Inventory and educational/career plans collected

The testing window for EXPLORE and PLAN: October 1 – October 31, 2012 Answer Document Return Deadline (ADRD) November 16, 2012 Important Dates

1 or 2 day administration: Student Information & noncognitive sections always first Four academic tests performed second In no case should the academic portion of the exam be administered prior to the noncognitive components 2012 Test Administration

EXPLORE Test Standard Time English 30 minutes (no break) Mathematics 30 minutes (10-minute break) Reading 30 minutes (no break) Science 30 minutes Students Must Complete All Sections

PLAN Test Standard Time English 30 minutes (no break) Mathematics 40 minutes (10-minute break) Reading 20 minutes (no break) Science 25 minutes Students Must Complete All Sections

EXPLORE 8 th /9 th Grade PLAN 10 th grade ACT 11 th /12 th grade Score Scales Relationship English Math Reading Science English Math Reading Science English Math Reading Science Writing

Who may test? State provides school eligibility to ACT. EXPLORE = 8 th grade, PLAN = 10 th grade State affiliated public schools When can I test? Testing window: October 1 – 31, 2012 Schools determine test date within the test window Testing can be given anytime during the day Who orders? State submits eligibility list to ACT Supplemental and accommodated orders placed by district PLAN and EXPLORE for North Carolina

TEST ADMINISTRATION POLICIES 11

Standard Testing Requirements Apply to all days of testing Facilities Personnel Security Exact Timing Test Day Documentation 12

Selecting / Preparing Rooms Desks & surfaces Students face same direction Adequate spacing Bulletin boards Comfortable temperature and lighting Limited distractions Materials provided by school Extra #2 pencils, pencil sharpener, calculators, Supply of scratch paper,audio CD or cassette player 13

Standard-Time Testing Staff Roles Test Supervisors Room Supervisors One for each room Proctors – assist room supervisor A proctor may be used in addition to the room supervisor in rooms with 10 or more examinees. A Proctor must be used if a room has 26 or more examinees Reader and Gridder 14

Training Testing Staff Staff must read the Supervisor’s Manual Train testing staff prior to test day Policies and requirements Pre-test duties Test-day assignments Attentiveness during testing Post-test activities Conduct a brief training session on test day 15

Attentiveness During Testing Read only the appropriate Supervisor’s Manual or Administration Instructions Walk around room Discourage prohibited behavior Answer questions about testing procedures Must not engage in non-test related activities: No grading papers No reading books No talking casually No using computer No eating or drinking in the test room 16

PRE-TEST ACTIVITIES 17

Testing Materials Check all materials upon arrival Report shortages or evidence of tampering Contact ACT Customer Service at Securely store test materials 18

Testing Materials (cont’d) What materials do I receive? Supervisor’s Manual “Why Take EXPLORE or PLAN?” handouts “Instructions for Completing Your Answer Folder” Test booklets Answer folders School header Return envelopes School posters Materials are shipped two weeks prior to the testing window 19

Pre-Test Activity Read the Supervisor’s Manual Determine test date Test Supervisor identifies: Room Supervisor, Proctors and trains staff Reserve test rooms Determine when to complete non-test sections Determine if testing one or two days? Will sort codes be used? Will supplemental local items be administered? 20

Pre-ID Barcode Labels Optional tool to save administration time and ensure accuracy Order by downloading the Pre-ID order form and template at Apply to page 1 of the answer folder prior to test day Pre-ID labels will be shipped separately from test materials Make certain pre-ID barcode label corresponds to correct student (e.g., double-check labels for twins, students with the same/similar first and last names) 21

Determine 1-Day or 2-Day Administration 1-Day Administration –Student Information components of the test must be administered first, followed by the four academic tests 2-Day Administration –Student Information components of the test are administered on Day 1. Academic tests administered on Day 2 22

Pre-test Session: Non-test Portions Only students may complete the non-test portions of the answer document (not staff) Pre-test session must be held before academic test portion Include all students in this session, including any with accommodations Verbatim instructions 23

Choose a Testing Option Determine which administration option will be used to present instructions for student information prior to test day: Option 1: TS reads all directions aloud to students as they follow along Option 2: Students read most of the directions themselves Option 3: Test supervisor reads directions for Pre-ID label users aloud to students as they follow along 24

Prior to Testing Check-in and Secure test materials Distribute copies of Why Take PLAN or EXPLORE? to students Remind students Bring 2 - #2 pencils and erasers Bring permitted calculator Bring Student ID DO NOT bring cell phone or any electronic devices 25

Test Day Pre-planning Select testing rooms Organize answer documents Assign and train staff Authorized Room Supervisors should prepare test day materials – other trained staff may help Practice verbal instructions Give student reminders 26

TEST DAY 27

Avoiding the Pitfalls Arrange test room seating appropriately Administer tests in proper sequence Ensure full amount of time is allowed for each test Room Supervisor frequently circulates through the testing room to ensure students are working on the correct exam and discourage inappropriate behavior Do not leave testing room unattended 28

Test Day: Briefing Session Room Supervisors and Proctors Arrive at least 30 minutes prior to student check-in Review procedures Last-minute details Test Supervisor hand-deliver test materials to Room Supervisor(s) 29

Admitting Students Direct students to seats Alphabetical Left / right and front / back No late arrivals No cell phones or other electronic devices 30

Permitted Calculators Details on permitted calculators at Prohibited features - see website Check at the door upon students entering the room and periodically during Test 2 – Mathematics Permitted calculator is ultimately the student’s responsibility If school provides students calculators – distribute before testing begins as students are being admitted to the test room 31

Exact Timing of Tests Use more than one timepiece (not a cell phone) Time each room individually No “central” timing Provide 5-minute remaining reminders You may post Start and Stop times and or time allowed for each test on the board. Record times in the Supervisor’s Manuals 32

Break(s) Between Tests There are no break(s) identified during the exam Break(s) are at the discretion of the testing location Suggested Breaks: –1-Day administration 5-10 min break prior to the start of Test min break between Tests 2 and 3 –2-Day administration 5-10 min break between Tests 2 and 3 33

Irregularities Document irregularities using the Testing Irregularity Report (TIR) in the back of the Supervisors Manual Retain TIR’s and voided answer documents until results are received and returned to students Copy TIR’s involving defective materials, challenged test items or timing errors and forward to ACT 34

Types of Irregularities Defective materials Examinee illnesses Mistimed tests Marking or reading in future section of answer folder or test booklet Student challenge of testing items Irrational behavior Unauthorized testing aids Voiding answer folders 35

POST-TEST 36

Post-Test: Test Room Documentation Room Supervisors Responsibilities Account for all test booklets, answer folders and scratch paper before dismissing students Verify you have an answer folder for each student who tested Check answer folders to ensure correctly marked and student information is entered on the folder Secure testing materials 37

Post-Test: Test-Day Documentation Test Supervisor Account for all materials returned by each Room Supervisor Complete Testing Irregularity Reports for all irregularities Schedule and administer makeup testing Securely store used test books to be returned to students with score reports Destroy unused answer folders Complete School Header Fill in accommodation codes Keep copies for your files of all forms and reports mailed to ACT 38

Returning Test Materials ADRD November 16, 2012 Return answer folders (standard, makeup, and special testing) together, to ACT immediately after your last testing session. Keep test booklets for return to students for review once score reports arrive Use the prepaid, pre-addressed mailing envelop(s) provided with your order or box large amounts of answer documents to the address below: EXPLORE (or PLAN) Scoring Service 2727 Scott Blvd. P.O. Box 4026 Iowa City, IA

Packing Test Materials Follow the instructions for packing order listed in the back of the Test Supervisors Manual: School Header – top (one per grade) Testing Irregularity Reports (only those reporting defective material or testing challenges) Test Supervisor’s Comment Forms Answer Folders Class Group Header EXPLORE only (optional) Answer Folders 40

Shipping Test Materials ACT provides a UPS return mailing label If your school has regular pickup, leave packages in a supervised secure area of the school Do Not call UPS if they do not make regular stops at your location Take sealed packages to a staffed UPS drop-off location Make note of the drop-off location and time Do not leave packages at an unattended drop-off location 41

Other Test Materials Keep voided answer folders for your records Destroy used answer folders Used text books should be stored and returned to students with score reports Securely store unused test books. Provide to staff when reviewing the item-response data in reporting Return Braille test forms after test results have been reviewed with students All other material should be securely destroyed 42

ACCOMMODATIONS 43

Test Accommodations We will discuss: Approval/Eligibility Accommodation Options Accommodated Material Ordering Materials Administration procedures Return of materials 44

Accommodations Approval Accommodations are a local (school) decision No approval is needed from ACT Suggestions include: Current documented disability within the last three years Supported by Individual Education Plan (IEP) or 504 plan Align to what student is granted in regular classroom 45

Accommodation Options Audio CD or Braille test book Reader (with use of reader’s script) Scribe to record student responses Additional breaks with standard time Separate test sessions Testing over multiple days Extended time to complete each test Sign language interpreter 46

Accommodated Material The following accommodated testing material is available from ACT: Large print package Braille Booklet Audio CD Reader’s Script 47

Ordering Accommodated Material ACT provided order form by district testing coordinators. ed or faxed to ACT Test materials are shipped to arrive in schools by indicated “need by date” Order Deadline: September 5,

Accommodations Testing Administer at a time mutually convenient for student and test supervisor As close as possible to the date administered to other students Extended time, reader and marker assisted students should be tested individually in a separate room. One per student Students using audio cassette or CD can test as a group provided they have individual ear phones and can progress on their own Administer tests in proper sequence – never unattende d 49

Accommodations Testing (cont’d) If separate sessions/days, must complete each test (Test 1, Test 2, etc.) in a single session When using Large-print response worksheet, item responses must be transferred by staff to the standard answer folder for scoring Mark the one accommodation code that best describes the accommodation on the back of the answer folder 50

Avoiding the Pitfalls – Accommodations All students in a room must be working on the same test section at the same time, unless self-paced No single test session may be longer than one day for multi-day testing Tests must be administered in sequence (test 1, then test 2, then test 3…) 51

Avoiding the Pitfalls – Accommodations (cont’d) Days of testing must be administered in sequence (Day 1 first, then Day 2) Review Manuals for appropriate student seating arrangements All students must be seated facing the same direction All students must be within Room Supervisor’s line of sight One Room Supervisor required for each room – No “dual” supervision of students in different rooms One student per reader 52

Returning Accommodations Materials Mark the appropriate accommodations code on the answer folder Return used accommodations answer folders together with used standard test answer folders and appropriate School Header Sheet for return to ACT ACT does not require return of accommodated test materials with exception of braille test forms 53

Reporting 54

EXPLORE and PLAN Reporting School Reports Package:District Reports Package: -Student Reports (2) -Student Score Labels (2) -Student List Report -Profile Summary Report -Presentation Packet -Intervention Rosters -Item Response Summary Report -Student Level Data File -School Norms- District Norms

EXPLORE and PLAN Reporting (cont’d) College Readiness Standards Report (EXPLORE only) 56

EXPLORE / PLAN Customer Services –877/789/2925 EXPLORE Student Website – PLAN Student Website – Webcast posted to the state website – Questions?