2. QualityCore New DAC/BAC Test Administration Training August 16, 2013 Scot Calvert ACT, Inc. Jennifer Stafford Policy Advisor Kentucky Department of Education Jennifer.stafford@education.ky.gov

3. Agenda What’s New Testing Windows and Sessions Responsibilities and Deadlines Accommodations Materials Group Headers Answer Documents Return Shipping Prohibited/Acceptable Materials Online Testing Resources 1

4. Glossary of Terms CBT-Computer Based Testing P&P- Paper and Pencil Vantage- ACT QualityCore’s online system VanGuard 2

5. What’s New Removal of graduates from Vantage (2012 and 2013) KDE/ACT upload/update of student accounts Inactivate duplicate student accounts Bulk Student Roster Upload Function Preparation for year three State Course Codes Online Stress Test 3

6. Removal of Graduates from Vantage New Policy: Graduates will be removed from the Vantage system by ACT in December following graduation dates. Allows school staff time to print Individual Student Reports. ACT and KDE will work together to determine when this effort will be complete. Please review the DAC Monday e-mails for additional information about this effort. 4

7. Create and Upload Students KDE will extract from Infinite Campus (IC) students enrolled in IC at the high school level within each district. Be sure student records are updated in IC by September 6 ACT will create student accounts at the appropriate school. Student grade levels will reflect current status in IC. Accounts for students enrolled after this effort will need to be created or moved by the school. Note: Middle school students taking courses for high school credit will not be included. 5

8. Duplicate Student Accounts KDE and ACT are working collaboratively to purge the system of duplicate accounts. The target is to have this work done this fall. After this effort, school staff should review school lists to verify quality of work. Please review DAC Monday e- mails for additional information. 6

9. Bulk Student Roster Upload New function available to add multiple student records to roster(s) via upload. Detailed instructions will be posted to ACT’s QualityCore website prior to the start of October testing. The instructions document will also be sent via the DAC Monday e-mail. Ad Hoc currently in Infinite Campus for each course ▫EOC Bulk Roster Registration Algebra II ▫EOC Bulk Roster Registration Biology ▫EOC Bulk Roster Registration English II ▫EOC Bulk Roster Registration U. S. History 7

10. Preparation for Year Three Creation of new teacher accounts Inactivate teacher accounts no longer in the school Upload student demographics per the layout in Vantage Addition of new ninth graders 8

11. KDE State Course Codes English II Biology 230110-English 2 230162-Pre-IB English 2 302601-Life Science/Biology 1 302602-Biology II 302611-Biochemistry 302613-Microbiology 302614-Ecology 302623-IB Environmental Systems 302643-Pre-IB Biology 302644-IB Biology 2 302645-IB Biology 3 302646-AP Biology 302680-AgriBiology 302685-Agriscience 302698-Intro Biology with Earth/Space Science 303010-Astrobiology 303091-Integrated Science I 303092-Integrated Science II 303093-Integrated Science III 302603 - Honors Biology (newly added) 302618 - Medical Science (newly added) 9 270311-Algebra 2 450809-U.S. History Survey 450812-United States History, Reconstruction to the Present 450814- AP American History Algebra II U.S. History

12. Online Stress Test The purpose of this assessment is to provide Kentucky educators assurance the online system will work with a large number of students in the system at once. ACT must prove the system has been fixed; if it cannot, the state will likely look for a different testing vendor for the 2014-15 school year. *See August 19, DAC Monday E-mail for more details. 10

13. When students are tested 11 Example 1Example 2Example 3 Student passes semester 1 Student passes trimester 1 Student passes semester 2 Student fails semester 2 Student fails trimester 2 Student takes examStudent retakes semester 2 Student takes trimester 3 Student takes examStudent retakes trimester 2 Student takes exam

14. 12 Two Sessions Two separate EOC sessions Multiple Choice 1 (Paper or Computer) Multiple Choice 2 (Paper or Computer) School staff may choose to utilize both paper and CBT at the same site. Users must complete both sections using the same mode (paper or CBT) Sessions are 45 minutes each Paper sessions are timed by the test administrator. Computer sessions are timed automatically by the computer.

15. Testing Sessions Paper Testing: ALL students must be tested at the same time, in the same content area. Computer Testing: Multiple testing sessions can be utilized in a single day. The first computer based test must begin at the same time as the paper based test. Note: A 10-15 minute break is allowed between test sessions. 13

16. 14 Testing Windows (Includes Paper and Computer Testing) Six EOC test windows per year August 1-September 13 October 1-November 15 December 2-January 17 February 3-March 14 April 1-June 13 June 16-July 15 Within each window, schools choose a 10-day window (consecutive days) to complete the four tests, including make-up sessions. Within the 10-day window, schools choose one day per content area. Note: MC1 and MC2 must be given in order on the same day. May schedule multiple content tests on same day.

17. 15 Non-Traditional Windows (Includes Paper and Computer Testing) Six EOC test windows per year ▫August 1-September 13 ▫October 1-November 15 ▫December 2-January 17 ▫February 3-March 14 ▫April 1-June 13 ▫June 16-July 15 Within each window, schools choose one day per student(s) to complete sessions. Note: MC1 and MC2 must be given in order on the same day. May schedule multiple content tests on same day.

18. Traditional vs. Non-Traditional? High Schools with only Traditional Courses: Use School’s 10-day window Alternative Schools with only Non-Traditional Courses: Use State’s broader window Schools with both Traditional and Non-Traditional Courses: Use both school’s 10-day and State’s broad window 16

19. Access to Online System Username and Password Needed https://qc.vantage.com/qualitycore/do/log DACs grant access to others in the district 17

20. Steps for Ordering Confirm Unit Usage (DACs/Designee) Create/Upload Users & Teachers (DACs/Designee) Create/Upload Students (KDE/ACT, Local) Create Class Test Rosters (Local) Finalize Class Rosters (Local) Note: Valuable Resources are located at: http://www.act.org/stateservices/kentucky/before.ht ml http://www.act.org/qualitycore/qcresources.html 18

21. Responsibilities District or School Administrator: Conduct Administration Code and Inclusions Training Confirm Unit Usage per school Determine Paper or Computer Testing Estimate Number of Students Testing ACT will print the Confirmed Unit Usage per school. DAC/BAC should order additional tests to ensure enough materials are received. Determine Testing Dates Create/Upload Students (New enrollees) 19

22. Create and Upload Students KDE will extract from Infinite Campus (IC) students enrolled in IC at the high school level within each district. ACT will create student accounts at the appropriate school. Student grade levels will reflect current status in IC. Accounts for students enrolled after this date will need to be created by the school. Note: Middle school students taking courses for high school credit will not be included. 20

23. Responsibilities School Administrator: Create Class Roster Name: Options 1. Name by school, course, teacher, and period i.e. CCHS, Algebra II, C. Greer, period 5 2. Name by school, course, per teacher i.e. CCHS, Algebra II, C. Greer 3. Name by school, course i.e. CCHS, Algebra II Note: Separate class roster for extended time for computer based (specific timing). 21

24. Responsibilities School Administrator or Teacher: Finalize Class Rosters Verify all students to be tested are on roster No roster in SDRR at this time Print or save electronic copy to use as a reference for accountability in SDRR at the end of school year. Create seating chart 22

25. Test Form Changes 23 Before Form Change All end 2012-03-31 After Form Change All end 2012-07-31 During Form Change Ends 2012-03-31 Ends 2012-07-31

26. Target Dates Deadlines for August 1 – September 13 Begin Testing the Week of:August 1August 5August 12August 19August 26September 2September 9 Confirm Unit UsageJune 6June 10June 17June 24July 1July 8July 15 Create/Upload Users & TeachersShould be Complete Create/Upload StudentsJune 20June 24July 1July 8July 15July 22July 29 Create Class Test RostersJune 27July 1July 8July 15July 22July 29August 5 *Finalize Class Rosters July 4July 8July 15July 22July 29August 5August 12 24 *Finalize Class Rosters must be completed four (4) weeks and one day prior to testing. Other dates are targets for workload management.

27. Target Dates Deadlines for October 1 – November 15 End-of-Course Testing Begin Testing the Week of: October 1October 7October 14October 21October 28November 4November 11 Confirm Unit Usage August 6August 12August 19August 26September 2September 9September 16 Create/Upload Users & Teachers Should be Complete Create/Upload Students August 20August 26 September 2September 9September 16September 23September 30 Create Class Test Rosters August 27 September 2 September 9September 16 September 23 September 30October 7 *Finalize Class Rosters September 2 September 8 September 15September 22 September 29October 6October 13 25 *Finalize Class Rosters must be completed four (4) weeks and one day prior to testing. Other dates are targets for workload management.

28. Target Dates Deadlines for December 2 – January 17 End-of-Course Testing Begin Testing the Week of: December 2December 9December 16 December 23December 30January 6January 13 Confirm Unit Usage October 7October 14October 21NANovember 4November 11November 18 Create/Upload Users & Teachers Should be Complete Create/Upload Students October 21October 28November 4NANovember 18 November 25December 2 Create Class Test Rosters October 28November 4November 11NANovember 25December 2December 9 *Finalize Class Rosters November 3 November 10November 17NADecember 1December 8December 15 26 *Finalize Class Rosters must be completed four (4) weeks and one day prior to testing. Other dates are targets for workload management.

29. Accommodations 2009 Inclusion of Special Populations Must have a current IEP, 504 or PSP with accommodations listed Accommodations should not be introduced just for the assessment Must be student initiated Accommodations must not impact content validity 27

30. Accommodated Testing Paper OnlyPaper and Computer R = Reader A = Audio B = Braille LP = Large Print Scribe Extended Time Paraphrasing Manipulatives Prompting/Cueing Behavior Modification Interpreter (sign language) Dictionaries/Thesauri 28

31. Ordering Accommodated Test Materials Navigate to http://www.act.org/stateservices/kentuckyhttp://www.act.org/stateservices/kentucky Select the Resources tab (top right side of screen) Select Test Accommodations (left side of screen) Download and complete the KDE Accommodated Testing Materials Order Form. Once the order form is completed, email it to QualityCoreCustomerService@act.org QualityCoreCustomerService@act.org Note: This process is for accommodated materials, not test booklets. Paper units must be allocated to the school and students must be on finalized roster for order to be complete. 29

32. Ordering Accommodated Test Materials Order Deadline This includes ordering of reader scripts. E-mail Form to QualityCore Customer Services (QualityCoreCustomerSercice@act.org) Form available at: http://www.act.org/stateservices/kentucky/accommodations.html http://www.act.org/stateservices/kentucky/accommodations.html 30 Begin Testing the Week of: October 1October 7October 14October 21October 28 November 4 November 11 Accommodations Order September 3September 9September 16September 23 September 30October 7October 14 Begin Testing the Week of:December 2December 9December 16 December 23 December 30January 6January 13 Accommodations OrderNovember 4November 11November 18 NADecember 2December 9December 16 Begin Testing the Week of:August 1-September 15 Accommodations OrderShould be complete

33. Exemption Types Medical Exemption choice requires more detailed information, including Date of Diagnosis and Hospitalization. More detailed descriptions are needed for approval. Extraordinary Circumstance (Other Exemption) choice has open field to enter information. For both types of exemptions, see the associated Medical Exemption and Extraordinary Circumstance forms on the KDE website. Procedure Change: SDRR will be open for exemption applications in Fall and remain open throughout the school year. 31

34. Exemption Information Student identifying information Name SSID Grade Gender DOB School Name Test Type Exemption Type Explanation of Medical or Extraordinary issue Relevant dates 32 1.Keep paper form on-file in the district. 2.Enter information electronically into SDRR. An Exemption Request is NOT automatically approved.

35. Receiving/Storing Materials Shipment going to DACs will be identified with course name, school and BAC’s name, as well as course name for easy distribution Check shipment contents Testing Boxes Test Booklets with answer document. Reference Sheets- Alg 2 only Test Supervisor’s Manual, Room Supervisor’s Manual School Header Group Header- One per roster plus a small overage Box 1 Contains Packing List 33 Store SECURELY LOCKED storage Discrepancies— Call (866)764-7228

36. Seating Chart 34

37. Group Headers One per roster created online Group headers will be pre-printed with School name, Test Roster name, Course code, and Test Assignment Roster ID. Example: If Ms. Jones has 3 Algebra II rosters in Vantage, there will be 3 separate Group Headers. 35

38. 36 B: Test Roster Name A: School Name C: Course D: Vantage Test Assignment Roster ID

39. Combined MC Test Booklets No longer separate multiple choice test booklets. Change effective spring of 2013. Student answer document with embedded student information is located inside the test booklet. Cover of test booklet contains embedded roster and student information. Booklets are packed by roster for easy distribution on test day. 37

40. Answer Document without embedded student info. Student On Roster: If student is on the roster, click on the name to locate QualityCore ID. Complete boxes A thru D on answer document. Student Not On Roster: Add student to roster from User Student List. Complete boxes A thru D on answer document. **Student’s name must be gridded on answer document exactly as shown on roster. **If units not available, contact DAC to have more units allocated to your school. 38

41. Bubble student information 39

42. Return Shipping: Group Headers 40 Group Header 1 Roster 1 Roster 2 Group Header 2

43. Return Shipping Packing Envelopes Used Answer Documents Testing Irregularity Report Instructions can be found in the Test Supervisor’s Manual Boxes Used and unused tests booklets in the boxes stamped with their course names Instructions can be found in the Test Supervisor’s Manual 41 KDE and ACT recommend return shipping from the school.

44. Irregularities A disturbance or distraction occurs that could affect one or more students’ scores. A student becomes ill and discontinues testing. A student questions or challenges a test item. A student uses unauthorized testing aids. Complete a Testing Irregularity Report (Test Supervisor’s and Room Supervisor’s Manuals) 42

45. Prohibited Materials ComputerPencil/Paper Notes Foreign language or English dictionary Scratch paper Notes Foreign language or English dictionary 43

46. Acceptable Materials ComputerPencil/Paper Scratch Paper-Please collect and destroy securely. Calculators Reference Sheets (Algebra II) Scratch work is to be done in the test booklet. Calculators Reference Sheets (Algebra II) 44

47. Practice Online Testing Coordinate with District Technology Coordinators to verify workstations are ready for online testing CBT Launch Demo PPT QC CBT QuickStart LaunchTest Teachers/Students may use the Launch Demo to practice the system. 45

48. Locating Launch PPT and Test 46 www.act.org/stateservices/kentucky

49. 47

50. Resources/Manuals 48

51. Retrieve Codes from System Test Control Code Vanguard Exit Code 49

52. Online Testing Student will choose their correct birthdate from the dropdown menu and accept the User’s Agreement. The student has the option of completing a tutorial before beginning the test. 50

53. Student Login Page 51

54. Accept User Agreement 52

55. Complete Login 53

56. Choose Correct Test 54

57. Directions 55

58. Directions (continued) 56

59. Test Display 57 Time Remaining Tools

60. Student Prompt After Answering 58

61. Skipping a Question 59

62. Bookmark a Question 60

63. Student Review Page 61

64. 62

65. 63 Take a Break or End the Test Break

66. 64 Test Control Code

67. Test Security The Kentucky Department of Education (KDE) along with the testing contractor will be doing analysis of student responses and data to determine if possible inappropriate practices have occurred. All instances of impropriety should be reported ▫Student ▫Testing staff 65

68. Resources Kentucky QualityCore Website www.act.org/stateservices/kentucky www.act.org/stateservices/kentucky Kentucky Department of Education http://education.ky.gov/AA/distsupp/Pages/EO C.aspx http://education.ky.gov/AA/distsupp/Pages/EO C.aspx 66

69. Contact Information ACTKDE ACT Customer Services: E-mail: QualityCoreCustomerService@ act.org QualityCoreCustomerService@ act.org Phone: 866.764.7228 Assessment Support and Research: E-mail: dacinfo@education.ky.gov dacinfo@education.ky.gov Phone: 502.564.4394 Jennifer Stafford E-mail: Jennifer.stafford@education.k y.gov Jennifer.stafford@education.k y.gov 67