1. Preparing for Testing April 15-June 15 and June 16-July 31 Joe Dell Brasel, Ed.D. Principal Consultant ACT Atlanta Office joedell.brasel@act.org Jennifer Stafford, Policy Advisor Office of Assessment & Accountability Kentucky Department of Education jennifer.stafford@education.ky.gov

2. 1 Agenda  Testing Windows and Sessions  Responsibilities and Deadlines  Accommodations  Exemptions  Materials  Return Shipping  Prohibited/Acceptable Materials  Online Testing  Grading Scale  Resources

3. 2 Three Sessions  Three separate EOC sessions ~Multiple Choice 1 (Paper or Computer) ~Multiple Choice 2 (Paper or Computer) ~Constructed Response (Paper)  Sessions are 45 minutes each ~Paper sessions are timed by the test administrator. ~Computer sessions are timed automatically by the computer.

4. 3 Testing Sessions  Paper Testing: ALL students must be tested at the same time, in the same content area.  Computer Testing: Multiple testing sessions can be utilized in a single day. Note: A 10-15 minute break is allowed between test sessions.

5. 4 Traditional Test Windows/Options Includes Paper and Computer Testing  Five EOC test windows per year ~October 1-November 15 ~December 1-January 15 ~February 1-March 15 ~April 15-June 15 ~June 16-July 31  Within each window, schools choose a 10-day window (consecutive days) to complete the four tests, including make-up sessions.  Within the 10-day window, schools choose option of 1 day or 2 consecutive days per content area. ~Option A (1 Day): 1 day for MC1/MC2 and CR ~Option B (2 Days): 1 day for MC1/MC2; 1 day for CR ~May schedule multiple content tests on same day. Note: MC1 and MC2 must be given in order on the same day.

6. 5 Test Window Example for Option A  Testing window ~April 15-June 15  Two week window ~April 16-27  One day for each subject ~April 16: English II ~April 17: Algebra II ~April 18: Biology ~April 19: U.S. History *Make-up sessions after the original test date within April 16-27.

7. 6 Test Window Example for Option B  Testing window ~April 15-June 15  Two week window ~April 16-27  Two days for each subject ~April 16, 17: English II ~April 18, 19: Algebra II ~April 23, 24: Biology ~April 25, 26: U.S. History *Make-up sessions after the original test date within April 16-27.

8. 7 Feedback from Stakeholders For the Non-Traditional Setting  More flexibility needed  Students in Non-Traditional Settings may finish at various times throughout the year  Impossible to test all non-traditional students in the 10-day window  Testing should work to support students in alternative pathways

9. 8 Non-Traditional Test Window/Options  Five EOC test windows per year ~October 1-November 15 ~December 1-January 15 ~February 1-March 15 ~April 15-June 15 ~June 16-July 31  Within each window, schools choose one day or two consecutive days per student(s) to complete sessions. ~Option A (1 Day): 1 day for MC1/MC2 and CR ~Option B (2 Days): 1 day for MC1/MC2; 1 day for CR  May schedule multiple content tests on same day. Note: MC1 and MC2 must be given in order on the same day.

10. 9 More Flexible Test Process for Non-Traditional Settings  Flexible test process will be used for the remaining EOC windows in 2011-12.  The focus is on creating test schedules for individual students as each student completes the course.  WebEx Training, EOC Traditional and Non-traditional testing, October 31, 2011 KDE Website: http://www.education.ky.gov/kde/instructional+resources/curriculum+documents+and+resour ces/kde+-+webex+information+and+resources.htm http://www.education.ky.gov/kde/instructional+resources/curriculum+documents+and+resour ces/kde+-+webex+information+and+resources.htm

11. 10 Traditional vs. Non-Traditional?  High Schools with only Traditional Courses: Use School’s 10-day window  Alternative Schools with only Non- Traditional Courses: Use State’s broader window  Schools with both Traditional and Non- Traditional Courses: Use both school’s 10-day and State’s broad window

12. 11 Steps for Ordering  Confirm Unit Usage  Create/Upload Users & Teachers  Create/Upload Students  Create Class Test Rosters  *Finalize Class Rosters Note: Valuable Resources are located at: www.act.org/stateservices/kentucky

13. 12 Responsibilities District or School Administrator:  Conduct Administration Code and Inclusions Training  Confirm Unit Usage per school ~Determine Paper or Computer Testing ~Estimate Number of Students Testing –No automatic overage. DAC/BAC should order additional tests per school. ~Determine Testing Dates  Create/Upload Students (i.e. roster)

14. 13 Create and Upload Students  Quality Core Student Template must be populated.  Report in IC to pull all high school students: Under KY State Reporting -> KDE Reports -> EOC Assessment.  Directions  After selecting the school from the menu bar, select Generate Report. When given the option to Save or Open the file, choose Open.  Save the file with the.xls extension.  According to ACT, staff must paste the results of the report in the template provided by ACT before uploading the information.  For questions, please contact Lisa McKinney at (502) 564-2020 or lisa.mckinney@education.ky.gov lisa.mckinney@education.ky.gov

15. 14 Responsibilities  School Administrator:  Create Class Roster Name: ~Name by school, class, teacher, and period –i.e. CCHS, Algebra II, C. Greer, period 5 ~Separate class roster for extended time  School Administrator or Teacher:  Finalize Class Rosters ~Verify all students to be tested are on roster ~No roster in SDRR at this time ~Print or save electronic copy to use as a reference for accountability in SDRR at the end of school year. ~Create seating chart

16. 15 Confirm Unit Usage When the Test Form Changes Before Form Change All end 2012-03-31 After Form Change All end 2012-07-31 During Form Change Ends 2012-03-31 Ends 2012-07-31

17. 16 Target Dates Deadlines for April 15 –June 15 End-of-Course Testing Begin Testing the Week of:April 16April 23April 30May 7May 14May 21May 28June 4June 11 Confirm Unit UsageMarch 5 March 12March 19March 26April 2April 9April 16 Create/Upload Users & TeachersShould be Complete Create/Upload StudentsMarch 5March 12March 19March 26April 2April 9April 16April 23April 30 Create Class Test RostersMarch 12March 19March 26April 2April 9April 16April 23April 30May 7 *Finalize Class RostersMarch 19March 26April 2April 9April 16April 23April 30May 7May 14 *Finalize Class Rosters must be completed four (4) weeks prior to testing. Other dates are targets for workload management.

18. 17 Target Dates Deadlines for June 16–July 31 End-of-Course Testing Begin Testing the Week of:June 18June 25July 2July 9July 16July 23July 30 Confirm Unit UsageApril 23April 30May 7May 14May 21May 28June 4 Create/Upload Users & TeachersShould be Complete Create/Upload StudentsMay 7May 14May 21May 28June 4June 11June 18 Create Class Test RostersMay 14May 21May 28June 4June 11June 18June 25 *Finalize Class RostersMay 21May 28June 4June 11June 18June 25July 2 *Finalize Class Rosters must be completed four (4) weeks prior to testing. Other dates are targets for workload management.

19. 18 Accommodated Testing Paper Only R = Reader A = Audio B = Braille LP = Large Print Scribe Paper and Computer Extended Time Paraphrasing Manipulative Prompting/Cueing Behavior Modification Interpreter (sign language) Dictionaries/Thesauri English 10 Readers Approved - 2011-2012 No Readers - 2012 and beyond

20. 19 Ordering Accommodated Test Materials April 15-June 15 Order Accommodated Materials by: This includes ordering of reader scripts. Fax Form to QualityCore Customer Services Form available at: http://www.act.org/stateservices/kentucky/accommodations.html http://www.act.org/stateservices/kentucky/accommodations.html Begin Testing the Week of: April 16April 23April 30May 7May 14May 21May 28June 4June 11 Accommodations OrderMarch 19March 26April 2April 9April 16April 23April 30May 7May 14

21. 20 Ordering Accommodated Test Materials June16-July 31 Order Accommodated Materials by: This includes ordering of reader scripts. Fax Form to QualityCore Customer Services Form available at: http://www.act.org/stateservices/kentucky/accommodations.html http://www.act.org/stateservices/kentucky/accommodations.html Begin Testing the Week of: June 18June 25July 2July 9July 16July 23July 30 Accommodations Order May 21May 28June 4June 11June 18June 25July 2

22. 21 Exemption Types  Medical Exemption choice requires more detailed information, including Date of Diagnosis and Hospitalization. More detailed descriptions are needed for approval.  Extraordinary Circumstance (Other Exemption) choice has open field to enter information.  For both types of exemptions, see the associated Medical Exemption and Extraordinary Circumstance forms on the KDE web site and in the Forms section of the DAC/BAC.

23. 22 Exemption Information  Student identifying information  Name  SSID  Grade  Gender  DOB  School Name  Test Type  Exemption Type  Explanation of Medical or Extraordinary issue  Relevant dates 1.Keep paper form on-file in the district. 2.Enter information electronically into SDRR. An Exemption Request is NOT automatically approved.

24. 23 Receiving/Storing Materials  Shipment going to DACs will be identified with course name, school and BAC’s name for easy distribution  Check shipment contents ~Testing Boxes –Test Booklets ~Miscellaneous Boxes –Two Answer Folders (MC1/MC2 and CR) –Pre-ID Labels –Reference Sheets--Algebra II –Test Supervisor’s Manual (MC), Room Supervisor’s Manual (one per 25 students (MC)), and Constructed Response Supervisor’s Manual –School Header –Group Header Store SECURELY LOCKED storage Discrepancies— Call (866)764-7228

25. 24 Supplemental Order Process  Email: qualitycoreOM@act.org Quantity needed per coursequalitycoreOM@act.org  See example below: MASON COUNTY SCHL DIST MASON COUNTY HIGH SCHOOL Biology suborder 8233 10 tests Eng 10suborder 82324 tests April 16– April 27

26. 25 Seating Chart

27. 26 Group Headers  Two per class, per teacher ~One for MC1/MC2 and one for CR  Example: If Ms. Jones has 3 Algebra II classes, there will be 6 separate Group Headers. 3 MC Group Headers 3 CR Group Headers

28. 27

29. 28 Information for Group Headers

30. 29 Completing Group Headers Test Roster Name (Block B)

31. 30 Completing Group Headers Assignment ID (Block D)

32. 31 Pre-ID Labels  Arrive in Miscellaneous Box(s)  One per student answer folder ~MC1/MC2 ~CR  Errors on label  Do not edit  Make corrections online within class roster  No Label  Add new students online

33. 32 Answer Document and Labels Affix label to answer folder. Do not bubble student information

34. 33 Answer Document and No Label  Student On Roster: ~If student is on the roster, click on the name to locate QualityCore ID. Complete boxes A thru D on answer document.*  Student Not On Roster: ~Add student to roster from User Student List.** ~Complete boxes A thru D on answer document. **Student’s name must be gridded on answer document exactly as shown on roster. **If units not available, contact DAC to have more units allocated to your school.

35. 34 Answer Document and Not Included on Student Template  Student Not Included on Student Template: Student must be created/uploaded into online system ~Create new Student User on Site Administration page ~Add student to roster ~Complete boxes A through D on answer document. NOTE: Before testing, each student must have a QualityCore ID and listed on the roster.

36. 35 Bubble student information No label

37. 36 Return Shipping: Group Headers Group Header 1 MC/MC English 10 CR English 10 Group Header 2

38. 37 Return Shipping  Packing  Envelopes ~Used Answer Documents (MC1/MC2 and CR) ~Testing Irregularity Report –Instructions on pages 12-17 of Test Supervisor’s Manual  Boxes ~Used and unused tests booklets in the boxes stamped with their course names ~Unused answer documents and manuals in the boxes stamped “Miscellaneous” –Instructions on pages 12-17 of Test Supervisor’s Manual KDE and ACT recommend return shipping from the school.

39. 38 Irregularities  A disturbance or distraction occurs that could affect one or more students’ scores.  A student becomes ill and discontinues testing.  A student questions or challenges a test item.  A student uses unauthorized testing aids.

40. 39 Materials Computer Prohibited  Notes  Foreign language or English dictionary Allowed  Scratch Paper-Please collect and destroy securely.  Calculators  Reference Sheets (Algebra II) Pencil/Paper Prohibited  Scratch paper  Notes  Foreign language or English dictionary Allowed  Scratch work is to be done in the test booklet.  Calculators  Reference Sheets (Algebra II)

41. 40 Online User’s Guide  Online User’s Guide or CBT Manual should be accessed through the secure online system.  No support materials will be shipped for online testing.

42. 41 Practice Online Testing  Coordinate with District Technology Coordinators to verify workstations are ready for online testing  CBT Launch Demo PPT  QC CBT QuickStart LaunchTest  Teachers/Students may use the Launch Demo to practice the system.

43. 42 Locating Launch PPT and Test www.act.org/stateservices/kentucky

44. 43

45. 44 Resources/Manuals

46. 45 Retrieve Codes from System  Test Control Code  Vanguard Exit Code

47. 46 Student Roster Information  Retrieve student login information from Test Roster section of the online system.  Print out the Student Login page that contains each student’s QualityCore ID.  Teacher or Student will input the student’s information exactly as it is in the online system.  QualityCore ID  First Name  Middle Initial (optional)  Last Name  Date of Birth (dropdown menu selection)

48. 47

49. 48 Online Testing  Student will choose their correct birthdate from the dropdown menu and accept the User’s Agreement.  The student has the option of completing a tutorial before beginning the test.

50. 49 Student Login Page

51. 50 Accept User Agreement

52. 51 Complete Login

53. 52 Choose Correct Test

54. 53 Directions

55. 54 Directions (continued)

56. 55 Test Display Time Remaining Tools

57. 56 Student Prompt After Answering

58. 57 Skipping a Question

59. 58 Bookmark a Question

60. 59 Reviewing Online Test Before the student submits a completed test module, a review page will display. This page will list all items on the test, the status of each item (answered, unanswered, or bookmarked), and how much time the student has left to review his/her work.

61. 60 Student Review Page

62. 61

63. 62 Take a Break or End the Test Break

64. 63 Test Control Code

65. 64 EOC Subject Test Course Letter Grade EOC Scale Score Link to CPE-College Readiness Benchmark FDCBA U.S. History 125-135136-143144-147148-152153-175148 English II 125-135136-143144-149150-157158-175150 Algebra II 125-135136-140141-143144-148149-175144 Biology 125-135136-144145-147148-152153-175148 Grading Scale Under Review

66. 65 Test Security  Recent loss of certification for Kentucky educators emphasizes a serious issue.  Senate Bill 64 (2012 Kentucky General Assembly) an Act relating to assessment ethics has been filed.  authorize prosecution of violations (a prosecuting attorney and the Attorney General may investigate allegations of violations and prosecute violations);  require the Office of Education Accountability to periodically review assessment results and anomalies; and provide for fine upon conviction of not more than $1,000 and disciplinary action by the Education Professional Standards Board.

67. 66 Resources  Archived WebEx http://www.education.ky.gov/KDE/Instructional+Resources/C urriculum+Documents+and+Resources/KDE+- +Webex+Information+and+Resources.htm http://www.education.ky.gov/KDE/Instructional+Resources/C urriculum+Documents+and+Resources/KDE+- +Webex+Information+and+Resources.htm  How-To Website http://www.act.org/qualitycore/how.html http://www.act.org/qualitycore/how.html  Kentucky QualityCore Website www.act.org/stateservices/kentucky www.act.org/stateservices/kentucky