1. K-PREP END-OF-COURSE QUALITY CORE PRESENTED BY: KATHY MOORE AND PAM POWERS KDE:OAA: KM&PP: 10/12/2015 1

2. NEW PLATFORM - SAME ASSESSMENT ACT purchased an online platform to replace the Vantage system. Ordering, rostering, and student testing experience will be different. The assessment is the same. Two separate EOC sessions Multiple Choice 1 (Paper or Computer) Multiple Choice 2 (Paper or Computer) School staff may choose to utilize both paper/pencil and CBT at the same site. Students must complete both sections using the same mode (paper or CBT) Sessions are 45 minutes each KDE:OAA: KM&PP: 10/12/2015 2 Both

3. MONITORING TESTING TIMES Paper/pencil and Computer-based sessions must be timed by the test administrators. There is not built in timer for Computer-based testing. This is a change for Computer-based testing. KDE:OAA: KM&PP: 10/12/2015 3 Both

4. GLOSSARY OF TERMS CBT-Computer Based Testing P/P- Paper/Pencil Pacific Metrics (aka Pac Met) – ACT’s new QualityCore national online system (replaces Vantage) DTC-National role = Kentucky role – DAC STC-National role = Kentucky role – BAC TA –National role = Kentucky role – person substituting for teacher during test administration Daily Access Code – 5 letter system generated code needed for student access to the online testing system (unique to each class, each day) A full listing can be found at: http://www.qualitycore.act.org/wp- content/uploads/2015/08/New_Roles_and_Definitions.pdfhttp://www.qualitycore.act.org/wp- content/uploads/2015/08/New_Roles_and_Definitions.pdf KDE:OAA: KM&PP: 10/12/2015 4 Both

5. ROLES AND RESPONSIBILITIES KDE:OAA: KM&PP: 10/12/2015 5

6. DAC RESPONSIBILITIES Ensure all staff with the potential to be involved with testing have been trained on the Administration Code and/or Inclusion of Special Populations Assign/Edit BACs and Technology Coordinators Print and/reissue password for BACs and Technology Coordinators Set up school testing windows Work with Technology Coordinator to download secure browser Monitor daily administration reports KDE:OAA: KM&PP: 10/12/2015 6 http://www.qualitycore.act.org/wp-content/uploads/2015/08/New_Roles_and_Definitions.pdf Both

7. BAC RESPONSIBILITIES Register school for testing (one-time event) Assign teachers and test administrators Print and/reissue passwords for teachers and test administrators Review and edit rosters (teacher/class and student/class) Assign accommodations Download and print class rosters Print Avery labels (CBT) Reopen test sessions (CBT) Monitor reports KDE:OAA: KM&PP: 10/12/2015 7 http://www.qualitycore.act.org/wp-content/uploads/2015/08/New_Roles_and_Definitions.pdf Both

8. TECHNOLOGY COORDINATOR RESPONSIBILITIES Access Technology Resources Download secure browser http://www.qualitycore.act.org/resources/ (If the secure browser was loaded prior to September 15, it will need to be reloaded.) Communicate with DAC as needed KDE:OAA: KM&PP: 10/12/2015 8 http://www.qualitycore.act.org/wp-content/uploads/2015/08/New_Roles_and_Definitions.pdf CBT

9. TEACHER RESPONSIBILITIES COMPUTER-BASED TESTING View and print Daily Access Code View and/or print student rosters Reopen test sessions View reports PAPER/PENCIL TESTING View and/or print student rosters View reports KDE:OAA: KM&PP: 10/12/2015 9 http://www.qualitycore.act.org/wp-content/uploads/2015/08/New_Roles_and_Definitions.pdf Both

10. TEST ADMINISTRATOR RESPONSIBILITIES Know which classes are to be tested Will have access to and distribute Daily Access Code to students KDE:OAA: KM&PP: 10/12/2015 10 http://www.qualitycore.act.org/wp-content/uploads/2015/08/New_Roles_and_Definitions.pdf CBT

11. GETTING STARTED Review QualityCore Trainings conducted by Pacific Metrics and KDE http://education.ky.gov/AA/Assessments/Pages/EOC.aspx Download and Review manuals http://www.qualitycore.act.org/resources Access the system http://www.qualitycore.act.org/login/ KDE:OAA: KM&PP: 10/12/2015 11 Both

12. DAC RESPONSIBILITIES KDE:OAA: KM&PP: 10/12/2015 12 Both

13. ACCESS TO ONLINE SYSTEM DAC names are already in the system DACs received Username and Password from ACT on September 1 Note: As of the date of this presentation student information from Infinite Campus has not been loaded into the system. KDE is working with ACT for the initial upload which will be followed multiple updates during the year. KDE:OAA: KM&PP: 10/12/2015 13 http://www.qualitycore.act.org/login/ Both

14. TESTING WINDOWS – DAC Two broad state windows Within each window, schools choose a 10-day window (consecutive days) to complete the four tests, including make-up sessions. Within the 10-day window, schools choose one day per content area. Multiple content areas may be tested per day. For P/P testing, DACs will need to individually enter the chosen 10 day school window for each school in the system. For schools using CBT testing only, DACs may use the broad state windows. KDE:OAA: KM&PP: 10/12/2015 14 Both October 1 – December 18, 2015 January 4 – July 15, 2016

15. TESTING SESSIONS Paper Testing: ALL students must be tested at the same time, in the same content area. Computer Testing: Multiple testing sessions can be utilized in a single day. The first computer based test must begin at the same time as the paper based test. School staff may choose to utilize both paper and CBT at the same site. Students must complete both sections using the same mode (paper or CBT) Note: A 10-15 minute break is allowed between test sessions. KDE:OAA: KM&PP: 10/12/2015 15 Both

16. SETTING TEST WINDOWS Paper/Pencil Testing Setting large semester window forces the school to contact ACT to order materials. Set windows based on individual test schedule needed, not by large semester window. Set Individual Test Windows for Paper/Pencil Testing Must be established 30 days prior to first day of testing to receive pre-printed materials Accommodated materials Computer-Based Testing Set windows based on large semester window. School will create roster for testing within the semester window. Only contact ACT for accommodated paper/pencil materials. Set Semester Test Windows in system for Computer-Based Testing October 1 – December 18, 2015 January 4 – July 15, 2016 KDE:OAA: KM&PP: 10/12/2015 16 Both

17. SETTING TEST WINDOW(S) PER SCHOOL Test Coordinators Manual pp. 13-15 KDE:OAA: KM&PP: 10/12/2015 17

18. CREATING STC (BAC) OR SCHOOL ACCOUNTS DAC CREATES BAC ACCOUNT(S) BAC CREATES TEACHER ACCOUNTS KDE:OAA: KM&PP: 10/12/2015 18 http://www.qualitycore.act.org/login/ Both

19. CREATE SCHOOL/BAC ACCOUNTS Test Coordinators Manual pp. 15-19 KDE:OAA: KM&PP: 10/12/2015 19

20. CREATE SCHOOL ACCOUNTS KDE:OAA: KM&PP: 10/12/2015 20

21. PRINT/EMAIL PASSWORD LETTERS KDE:OAA: KM&PP: 10/12/2015 21

22. RESET/REISSUE BAC PASSWORD KDE:OAA: KM&PP: 10/12/2015 22

23. CREATING TEACHER ACCOUNTS DAC CREATES BAC ACCOUNT(S) BAC CREATES TEACHER ACCOUNTS KDE:OAA: KM&PP: 10/12/2015 23 http://www.qualitycore.act.org/login/ Both

24. CREATING TEACHER ACCOUNTS Manual Creation – Test Coordinators Manual pp. 65-68 CSV file upload – Test Coordinators Manual pg. 65 or wait for KDE upload KDE:OAA: KM&PP: 10/12/2015 24

25. ASSIGN A TEACHER TO A CLASS KDE:OAA: KM&PP: 10/12/2015 25

26. EDIT A TEACHER’S CLASS KDE:OAA: KM&PP: 10/12/2015 26 Both

27. EDUCATOR RESOURCES The QualityCore Educator Resources are included in the new platform and CIITS. Benchmark Assessments Course Descriptions and Syllabus Course Objectives Course Outline Test Blueprint Example Unit Formative Item Pool KDE:OAA: KM&PP: 10/12/2015 27 Both

28. CREATING STUDENT ROSTERS ORDERING MATERIALS KDE:OAA: KM&PP: 10/12/2015 28 Both

29. LOADING STUDENT INFORMATION Student information will have to be loaded by school until KDE notifies districts regarding the state student upload. The state upload is currently in development and will be completed as soon as possible. KDE will then extract multiple times from Infinite Campus (IC) throughout the year to update students enrolled at the high school level within each district. Please keep student records updated in IC. Note: Middle school students taking courses for high school credit will not be included. KDE:OAA: KM&PP: 10/12/2015 29 Both

30. STUDENT ROSTER UPLOAD BY SCHOOL Function available to add multiple student records to roster(s) via upload. Detailed instructions are posted to the ACT QualityCore website. (http://www.qualitycore.act.org/technology-documents/)http://www.qualitycore.act.org/technology-documents/ Ad Hoc currently in Infinite Campus for each course to create the CSV file needed for upload into the QualityCore system. EOC Bulk Roster Registration Algebra II EOC Bulk Roster Registration Biology EOC Bulk Roster Registration English II EOC Bulk Roster Registration U. S. History KDE:OAA: KM&PP: 10/12/2015 30 Both

31. KDE STATE COURSE CODES KDE:OAA: KM&PP: 10/12/2015 31 ENGLISH II 230110-English 2 230162-Pre-IB English 2 230166-AP Language and Composition ALGEBRA II 270311-Algebra 2 U.S. History 450809-U.S. History Survey 450812-United States History, Reconstruction to the Present 450814- AP American History 450879-Advanced US History (newly added) BIOLOGY 302601-Life Science/Biology 1 302602-Biology II 302603-Honors Biology 302611-Biochemistry 302612–Botany 302613-Microbiology 302614-Ecology 302618–Medical Science 302623-IB Environmental Systems 302643-Pre-IB Biology 302644-IB Biology 2 302645-IB Biology 3 302646-AP Biology 302680-AgriBiology 302698-Intro Biology with Earth/Space Science 303010-Astrobiology 303053 - Conceptual Progression Science III 303091-Integrated Science I 303092-Integrated Science II 303093-Integrated Science III Both

32. ROSTERS Rosters are created by either the District Student Upload CSV file or the KDE student/teacher upload. For those who need to test before the KDE/ACT file upload with student and teacher information, please do the following Teachers must be created and associated with a class. Students must be associated with a teacher during creation of the student account. The above two steps may be accomplished at one time by following the directions for a Student Upload. Accommodated materials are ordered by including the information in each student profile. KDE:OAA: KM&PP: 10/12/2015 32 Both

33. ADD A NEW STUDENT TO A ROSTER KDE:OAA: KM&PP: 10/12/2015 33

34. ASSIGNING ACCOMMODATIONS To verify that all accommodations have been assigned in the system, view the available accommodations reports. Once entered in the ACT QualityCore online system, accommodation information is automatically sent to ACT for order fulfillment of the associated materials 30 days prior to administration. KDE:OAA: KM&PP: 10/12/2015 34

35. ACCOMMODATED MATERIALS Accommodated materials can be ordered in the online system at the same time as P/P materials or by contacting ACT QualityCore Support at 866-764-7228. Accommodated materials must be ordered at least 4 weeks in advanced of testing date. BACs need to ensure that Block L (Special Codes) of the student answer document is properly bubbled with the appropriate accommodation. Special Codes can be found on page 17 of the Administration Manual. KDE:OAA: KM&PP: 10/12/2015 35 Both

36. RECEIVING/STORING MATERIALS KDE:OAA: KM&PP: 10/12/2015 36 P/P

37. RECEIVING/STORING MATERIALS Shipments will be to the district—specific information will shared through email when available Verify the material received matches the Packing List Check shipment contents Testing Boxes Test Booklets with answer document (reference sheets) Reference Sheets- Alg 2 only Administration Manual, Teacher Manual School Header—in Administration Manual Group Header- One per roster KDE:OAA: KM&PP: 10/12/2015 37 Materials are to be securely stored at all time when not in use. Discrepancies— Call (866) 764-7228 P/P

38. RECEIVING/STORING MATERIALS CONTINUED Tracking Log useful for distribution to teachers Form found in Administration Manual and Test Administration Manual KEEP original boxes for return shipping. KDE:OAA: KM&PP: 10/12/2015 38 P/P

39. COMBINED MC TEST BOOKLETS AND ANSWER DOCUMENTS Student answer document with pre-printed student information is located inside the test booklet. Cover of test booklet contains pre-printed roster and student information. Booklets are packed by roster for easy distribution on test day. KDE:OAA: KM&PP: 10/12/2015 39 P/P

40. Bubble student information in boxes A-G, I and J. 40 P/P

41. ANSWER DOCUMENT W/O PRE-PRINTED STUDENT INFO Student On Roster: If student is on the roster, the Test Coordinator must retrieve the student’s QualityCore ID from the system. Click Teacher Management Tab, View Rosters, appropriate roster, and select print roster to view the QualityCore ID. Grid student information on the answer document including the QualityCore ID in box D. Student Not On Roster: Add student to roster. A QualityCore ID will be generated. Click Teacher Management Tab, View Rosters, appropriate roster, and select print roster to view the QualityCore ID. Grid student information on the answer document including the QualityCore ID in box D. KDE:OAA: KM&PP: 10/12/2015 41 P/P

42. ADMINISTERING THE EOC ASSESSMENT KDE:OAA: KM&PP: 10/12/2015 42 Both

43. TEST DAY ACTIONS Teacher Manual includes scripts for both paper/pencil and computer-based testing. Teacher Manual Scripts begin on page 12. KDE:OAA: KM&PP: 10/12/2015 43 Both

44. ACCEPTABLE MATERIALS COMPUTER Scratch Paper-Please collect and destroy securely. Calculators Reference Sheets (Algebra II) PENCIL/PAPER Scratch work is to be done in the test booklet. Calculators Reference Sheets (Algebra II) 44 KDE:OAA: KM&PP: 10/12/2015 Both

45. PROHIBITED MATERIALS COMPUTER Notes Foreign language or English dictionary Personal alarms on devices such as cell phones and watches PENCIL/PAPER Scratch paper Notes Foreign language or English dictionary Personal alarms on devices such as cell phones and watches 45 KDE:OAA: KM&PP: 10/12/2015 Both

46. IRREGULARITIES A disturbance or distraction occurs that could affect one or more students’ scores. A student becomes ill and discontinues testing. A student questions or challenges a test item. A student uses unauthorized testing aids. Complete a Testing Irregularity Report Forms found in Administration Manual Keep copy for own records Return original to ACT placed behind the School Header Sheet KDE:OAA: KM&PP: 10/12/2015 46 Both

47. STUDENT OATH The Student Oath is similar to Kentucky’s K-PREP Student Honor Code. Students using Computer-based testing must agree to the oath before the system will allow them to access the test. KDE:OAA: KM&PP: 10/12/2015 47 Both

48. NEW KDE CALCULATOR POLICY Follow ACT’s calculator policy for all ACT assessments. http://education.ky.gov/AA/Assessments/Pages/ACT.aspx Calculator information is also in the Administration Manual, Test Administration Manual and Test Coordinators Manual (pg. 4) http://www.qualitycore.act.org/resources KDE:OAA: KM&PP: 10/12/2015 48 Both

49. SEATING CHART KDE:OAA: KM&PP: 10/12/2015 49 Both

50. EXEMPTION TYPES Medical Exemption choice requires more detailed information, including Date of Diagnosis and Hospitalization. More detailed descriptions are needed for approval. Extraordinary Circumstance (Other Exemption) choice has open field to enter information. For both types of exemptions, see the associated Medical Exemption and Extraordinary Circumstance forms on the KDE website. SDRR will be open for exemption applications in November and remain open throughout the school year. KDE:OAA: KM&PP: 10/12/2015 50 Both

51. EOC TEST POLICY The student will take the EOC assessment at the end of instruction. If student is enrolled in an EOC class and will not pass the class, then the student will not test until instruction is complete. The policy has not changed from last year. KDE:OAA: KM&PP: 10/12/2015 51 Both

52. TEST SECURITY The Kentucky Department of Education (KDE) along with the testing contractor will be doing analysis of student responses and data to determine if possible inappropriate practices have occurred. All instances of impropriety should be reported Student Testing staff Complete ACT Security Agreement Form found in each manual Keep copy for own records Fax to ACT KDE:OAA: KM&PP: 10/12/2015 52 Both

53. SHIPPING/RETURNING MATERIALS KDE:OAA: KM&PP: 10/12/2015 53 P/P

54. RETURN SHIPPING Packing Envelopes Used Answer Documents Testing Irregularity Report Instructions can be found in Administration Manual Boxes Pre-addressed shipping labels for scorable and nonscorable Instructions and graphics can be found in the Administration Manual. KDE:OAA: KM&PP: 10/12/2015 54 KDE and ACT recommend return shipping from the school. P/P

55. RETURN SHIPPING REGULAR VS. ACCOMMODATED MATERIALS Materials must be returned within two days after testing is completed. Two different return addresses. Regular materials: Manuals (used and unused) Test Booklets (used and unused) Reference Sheets Completed Test Booklet Tracking Log All completed scannable answer documents Accommodated materials Large-print Test Booklets (used and unused) Large-print Reference Sheets (used and unused) Audio CDs Reader Scripts (used and unused) Braille Test Booklets and Reference Sheets Completed Test Booklet Tracking Log KDE:OAA: KM&PP: 10/12/2015 55 QualityCore Processing Center 50 Education Way Dover, NH 03820 ACT Services McCarrel Center 2727 Scot Blvd. P.O. Box 4059 Iowa City, IA 52243-4059 P/P

56. GROUP HEADERS One per roster created online If pre-printed: Verify teacher’s name gridded in Block B matches name on Teacher Roster. Verify the course gridded in Block C is correct. Enter the class period in Block D. If not pre-printed: Grid Block B with teacher name exactly as it appears on Teacher Roster screen. Fill in circle Block C next to course and Block D for class period Complete the rest of the sheet according to printed directions. KDE:OAA: KM&PP: 10/12/2015 56 P/P

57. RETURN SHIPPING: GROUP HEADERS KDE:OAA: KM&PP: 10/12/2015 57 Group Header 1 Roster 1 Roster 2 Group Header 2 P/P

58. REPORTS KDE:OAA: KM&PP: 10/12/2015 58 Both

59. REPORTS FROM NEW SYSTEM P/P student results will be available in the online system in 5 days after receipt of materials by ACT. CBT—currently student results will be available in the online system in 5 days. KDE is working with ACT to improve the delivery time of the CBT results. KDE:OAA: KM&PP: 10/12/2015 59 Both

60. REPORTS FROM VANTAGE Student reports from previous administrations are available from ACT. District Assessment Coordinators and School Test Coordinators can request EOC reports from the old Vantage system. Contact ACT QualityCore Support by phone (866-764-7228) or by e- mail at QualityCoreSupport@act.org to request reports.QualityCoreSupport@act.org The customer support team will send a secure URL where the reports can be downloaded. A password will be sent to decompress the files. KDE:OAA: KM&PP: 10/12/2015 60 Both

61. QUESTIONS DACINFO@EDUCATION.KY.GOV (502) 564-4394 KDE:OAA: KM&PP: 10/12/2015 61 Both