1. QualityCore Preparing for Testing February 1-March 15 Joe Dell Brasel, Ed.D. Principal Consultant ACT Atlanta Office joedell.brasel@act.org Jennifer Stafford, Policy Advisor Office of Assessment & Accountability Kentucky Department of Education jennifer.stafford@education.ky.gov

2. 1 Agenda  Testing Windows and Sessions  Responsibilities and Deadlines  Accommodations  Materials ~Group Headers ~Labels ~Answer Documents  Return Shipping  Prohibited/Acceptable Materials  Online Testing  Resources

3. 2 Testing Windows Includes Paper and Computer Testing  Five EOC test windows per year ~October 1-November 15 ~December 1-January 15 ~February 1-March 15 ~April 15-June 15 ~June 16-July 31  Within each window, schools choose a 10-day window (consecutive days) to complete the four tests, including make-up sessions.  Within the 10-day window, schools choose 2 consecutive days per content area. ~Option A (2 Days): 1 day for MC1/MC2; 1 day for CR Note: MC1 and MC2 must be given in order on the same day. ~Option B (1 Day): 1 day for MC1/MC2 and CR

4. 3 Test Window Example for Option A  Testing window ~February 1-March 15  Two week window ~February 13-24  Two days for each subject ~February 13, 14: English II ~February 15, 16: Algebra II ~February 17, 20: Biology ~February 21, 22: U.S. History *Make-up sessions after the original test date within February 13-24.

5. 4 Test Window Example for Option B  Testing window ~February 1-March 15  Two week window ~February 13-24  One day for each subject ~February 13: English II ~February 14: Algebra II ~February 15: Biology ~February 16: U.S. History *Make-up sessions after the original test date within February 13-24.

6. 5 Three Sessions  Three separate EOC sessions ~Multiple Choice 1 (Paper or Computer) ~Multiple Choice 2 (Paper or Computer) ~Constructed Response (Paper)  Sessions are 45 minutes each ~Paper sessions are timed by the test administrator. ~Computer sessions are timed automatically by the computer.

7. 6 Testing Sessions Paper Testing: ALL students must be tested at the same time, in the same content area. Computer Testing: Multiple testing sessions can be utilized in a single day. Note: A 10-15 minute break is allowed between test sessions.

8. 7 EOC Testing Timeframe  Day 1 for MC1/MC2  Paper Based Testing must be completed at the same time (similar to the ACT administration)  Computer Based Testing can be completed throughout the day in multiple sessions  Day 2 (or the same day as MC) for Constructed Response  Since it is only Paper Based, testing must be completed at the same time (similar to the ACT administration)

9. 8 EOC Test Schedule (con’t)  Day 1 for MC1/MC2  Paper Based Testing Example ~All students test from 8:30-10:00.  Computer Based Testing Example ~Group A tests from 8:30-10:00 ~Group B tests from 10:30-12:00 ~Group C tests from 1:00-2:30  Day 2 (or the same day as MC) for Constructed Response  Paper Based Constructed Response ~All students test from 9:00-9:45

10. 9 Feedback from Stakeholders For the Non-Traditional Setting More Flexibility Needed Students in Non-Traditional Settings may finish at various times throughout the year Impossible to test all non-traditional students in the 10-day window Testing should work to support students in alternative pathways

11. 10 Non-Traditional Windows Includes Paper and Computer Testing  Five EOC test windows per year ~October 1-November 15 ~December 1-January 15 ~February 1-March 15 ~April 15-June 15 ~June 16-July 31  Within each window, schools choose one or two consecutive days per student(s) to complete sessions. ~Option A (2 Days): 1 day for MC1/MC2; 1 day for CR Note: MC1 and MC2 must be given in order on the same day. ~Option B (1 Day): 1 day for MC1/MC2 and CR

12. 11 More Flexible Test Process for Non-Traditional Settings  New flexible test process will be used for the remaining EOC windows in 2011-12.  The focus is on creating test schedules for individual students as each student completes the course.

13. 12 More Flexible Test Process for Non-Traditional Settings  Students may test at any time during the established EOC state windows.  If students complete the course outside the EOC windows, they must test during the next window.

14. 13 When to use the flexible test process?  High School with only Traditional Courses-Original Process  Alternative Schools with only Non- Traditional Courses-New Process  School with both Traditional and Non- Traditional Courses-Original and New Processes

15. 14 Responsibilities District or School Administrator:  Administration Code and Inclusions Training  Confirm Unit Usage per school ~Determine Paper or Computer Testing ~Estimate Number of Students Testing –No automatic overage. DAC/BAC should order additional tests per school. ~Set 10-Day Test Window  Create/Upload Students (i.e. roster)

16. 15 Create and Upload Students  Quality Core Student Template must be populated.  Report in IC to pull all high school students: Under KY State Reporting -> KDE Reports -> EOC Assessment.  Directions  After selecting the school from the menu bar, select Generate Report. When given the option to Save or Open the file, choose Open.  Save the file with the.xls extension.  According to ACT, staff must paste the results of the report in the template provided by ACT before uploading the information.  For questions, please contact Lisa McKinney at (502) 564-2020 or lisa.mckinney@education.ky.gov lisa.mckinney@education.ky.gov

17. 16 Responsibilities School Administrator:  Create Class Roster Name: ~Name by school, class, teacher, and period –i.e. CCHS, Algebra II, C. Greer, period 5 ~Separate class roster for extended time School Administrator or Teacher:  Finalize Class Rosters ~Verify all tested students are on roster ~No roster in SDRR at this time ~Print or save electronic copy to use as a reference for accountability in SDRR at the end of school year. ~Create seating chart

18. 17 Seating Chart

19. 18 Deadlines Deadlines for February 1-March 15 End-of-Course Testing Begin Testing the Week of:February 1February 6February 13February 20February 27March 5March 12 Confirm Unit UsageDecember 7December 12December 19December 26January 2January 9January 16 Create/Upload Users & TeachersShould be Complete Create/Upload StudentsDecember 21December 26January 2January 9January 16January 23January 30 Create Class Test RostersDecember 28January 2January 9January 16January 23January 30February 6 Finalize Class RostersJanuary 4January 9January 16January 23January 30February 6February 13

20. 19 Accommodated Testing Types of Accommodations  Paper Only R = Reader * (English 10 - pending regulation) A = Audio B = Braille LP = Large Print  Paper and Computer T1.5 = Time and a half T2 = Double time UT = Untimed

21. 20 Ordering Accommodated Test Materials Order Accommodated Materials by: This includes ordering of reader scripts. Fax Form to QualityCore Customer Services (Form available at: http://www.act.org/stateservices/kentucky/accommodations.html) http://www.act.org/stateservices/kentucky/accommodations.html Begin Testing the Week of:February 1February 6February 13February 20February 27March 5March 12 Accommodations OrderJanuary 4January 9January 16January 23January 30February 6February 13

22. 21 Receiving/Storing Materials  Shipment going to DACs will be identified with course name, school and BAC’s name for easy distribution  Check shipment contents ~Testing Boxes –Test Booklets ~Miscellaneous Boxes –Two Answer Folders (MC1/MC2 and CR) –Pre-ID Labels –Reference Sheets--Algebra II –Test Supervisor’s Manual (MC), Room Supervisor’s Manual (one per 25 students (MC)), and Constructed Response Supervisor’s Manual –School Header –Group Header Store SECURELY LOCKED storage Discrepancies— Call (866)764-7228

23. 22 Supplemental Order Process  Email: qualitycore@act.orgqualitycore@act.org  Quantity needed per course

24. 23 Group Headers  Two per class, per teacher ~One for MC1/MC2 and one for CR  Example: If Ms. Jones has 3 Algebra II classes, there will be 6 separate Group Headers. 3 MC Group Headers 3 CR Group Headers

25. 24

26. 25

27. 26 Group Headers

28. 27

29. 28 Pre-ID Labels  Arrive in Miscellaneous Box(s)  Two labels per student ~MC1/MC2 ~CR  Errors on label  Do not edit  Make corrections online within class roster  No Label  Add new students online

30. 29 Answer Document and Labels Do you have a label for the student?

31. 30 Answer Document and No Label  Student On Roster: ~If student is on the roster, click on the name to locate QualityCore ID. Complete boxes A thru D on answer document.*  Student Not On Roster: ~Add student to roster from User Student List.** ~Complete boxes A thru D on answer document. *Student’s name must be gridded on answer document exactly as shown on roster. **If units not available, contact DAC to have more units allocated to your school.

32. 31 Answer Document and Not Included on Student Template  Student Not Included on Student Template:  Student must be created/uploaded into online system ~Create new Student User on Site Administration page ~Add student to roster ~Complete boxes A through D on answer document. NOTE: Before testing, each student must have a QualityCore ID and listed on the roster.

33. 32

34. 33 Return Shipping  Packing  Envelopes ~Used Answer Documents (MC1/MC2 and CR) ~Testing Irregularity Report –Instructions on pages 12-17 of Test Supervisor’s Manual  Boxes ~Used and unused tests booklets in the boxes stamped with their course names ~Unused answer documents and manuals in the boxes stamped “Miscellaneous” –Instructions on pages 12-17 of Test Supervisor’s Manual KDE and ACT recommend return shipping from the school.

35. 34 Irregularities  A disturbance or distraction occurs that could affect one or more students’ scores.  A student becomes ill and discontinues testing.  A student questions or challenges a test item.  A student uses unauthorized testing aids.

36. 35 Prohibited Materials Computer  Notes  Foreign language or English dictionary Scratch paper is allowed. Please collect and destroy securely. Pencil/Paper  Scratch paper  Notes  Foreign language or English dictionary Scratch work is to be done in the test booklet.

37. 36 Acceptable Materials  Reference Sheets—Algebra II  Approved Calculators ~List found on page 23 of the Test Supervisor’s Manual ~List found on page 4 of the Room Supervisor’s Manual

38. 37 Online User’s Guide  Online User’s Guide should be accessed through the secure online system.  No support materials will be shipped for online testing.

39. 38 Practice Online Testing  Coordinate with District Technology Coordinators to verify workstations are ready for online testing.  CBT Launch Demo PPT  QC CBT QuickStart LaunchTest  Teachers/Students may use the Launch Demo to practice the system.

40. 39 Online User’s Guide

41. 40 Retrieve Codes from System  Test Control Code  Vanguard Exit Code

42. 41 Student Roster Information  Retrieve student login information from Test Roster section of the online system.  Print out the Student Login page that contains each student’s QualityCore ID.  Teacher or Student will input the student’s information exactly as it is in the online system.  QualityCore ID  First Name  Middle Initial (optional)  Last Name

43. 42

44. 43 Online Testing  Student will choose their correct birthdate and accept the User’s Agreement.  The student has the option of completing a tutorial before beginning the test.

45. 44 Reviewing Online Test  Before the student submits a completed test module, a review page will display. This page will list all items on the test, the status of each item (answered, unanswered, or bookmarked), and how much time the student has left to review his/her work.

46. 45 Student Login Page

47. 46 Accept User Agreement

48. 47 Complete Login

49. 48 Choose Correct Test

50. 49 Directions

51. 50 Directions (continued)

52. 51 Test Display Time Remaining Tools

53. 52 Student Prompt After Answering

54. 53 Skipping a Question

55. 54 Bookmark a Question

56. 55 Student Review Page

57. 56

58. 57

59. 58

60. 59 Resources  Archived WebEx http://www.education.ky.gov/KDE/Instructional+Resources/C urriculum+Documents+and+Resources/KDE+- +Webex+Information+and+Resources.htm http://www.education.ky.gov/KDE/Instructional+Resources/C urriculum+Documents+and+Resources/KDE+- +Webex+Information+and+Resources.htm  How-To Website http://www.act.org/qualitycore/how.html http://www.act.org/qualitycore/how.html  Kentucky QualityCore Website www.act.org/stateservices/kentucky www.act.org/stateservices/kentucky