1. 2/15/2006 Online Test of Computer Skills Update & Information on Other Online Assessment Efforts Presenters: Scott Ragsdale Randy Craven February 15 & 16 2006 Accountability Conference Greensboro, NC

2. 2/15/2006Scott Ragsdale Session Purpose  Cover the results of the Pilot Administration of the Online Test of Computer Skills  Review the current/recent events  Review the Computer Skills Alternate Assessment  Review the spring 2006 test activities  Review the Physics Online Feasibility Study  Review EOC Online 2006-07

3. 2/15/2006Scott Ragsdale 2005 Online Test of Computer Skills Pilot Administration  Purpose of the pilot administration was to deploy the operational Online Test of Computer Skills with delayed reporting  LEAs were requested to test all 8th grade students so that standard setting could be set on census data  Provided high stakes data for standard setting

4. 2/15/2006Randy Craven 2005 Pilot Administration Results  109,584 students tested  99% students completing administration  98% of students finished in 130 minutes or less  432 experimental items/embedded – 18 items for each student  99% SIQ data collected for Students Tested

5. 2/15/2006Randy Craven 2005 Pilot Administration Results 120,157 students registered for Online Test of Computer Skills 302 students registered for Computer Skills Alternate Assessment 745 schools with 8th grade students tested 97 schools with non-8 th grade students tested 3,094 non-8 th grade students tested

6. 2/15/2006Randy Craven 2005 Pilot Administration Results Percentage of Platforms Used

7. 2/15/2006Randy Craven 2005 Pilot Administration Results  679 Teachers responded to surveys for experimental items   375 schools provided teacher survey responses   Total Teacher Surveys Completed = 44% of schools with successful completions   568 Help Desk tickets created for Computer Skills or NCDesk   263 Help Desk tickets created for NCRegistration   166 Help Desk tickets classified as irregularity or misadministration processing

8. 2/15/2006Scott Ragsdale Current/Recent Activities  Pilot Administration Completed  Computer Skills Alternate Assessment Bias Review and Form Review  North Carolina Computer Skills Advisory Committee  Standard Setting Process  Recommendation to the State Board of Education

9. 2/15/2006Scott Ragsdale Next Steps  NCDPI Report of Activities and recommendation of standards to the State Board of Education  March 1-2: State Board of Education Action on First Read  March 6: Release Scale Scores and Pass/Fail status to LEA Test Coordinators  March 6: Scores released via NCRegistration and available in CSV format

10. 2/15/2006Randy Craven Adjustments to Spring 2006 Testing  NCDesk Update  Client side and server side adjustments to reduce error messages presented to students during the test  Continue button re-labeled to Next Section  Before Next Section button is activated, students will be required to check that they understand they will not be able to return to the section  Resuming students returned more often to the last item acted upon  No students permitted to be returned to a section once completing the test

11. 2/15/2006Randy Craven Adjustments to Spring 2006 Testing  LEA Test Coordinators will have the ability in NCRegistration to reset tests Reset ID number for tracking purposes Reset ID number for tracking purposes Put reset ID number on misadministration documentation Put reset ID number on misadministration documentation  Only students not passing or not having begun a test will be allowed to test

12. 2/15/2006Scott Ragsdale Next Administration Notes  Spring Semester Testing Window March 20, 2006 – June 16, 2006 March 20, 2006 – June 16, 2006  Summer Testing Window July 1, 2006 – July 28, 2006 July 1, 2006 – July 28, 2006  Sight impaired may have to use the Computer Skills Alternate Assessment until JAWS compatibility issues are resolved  No Teacher Survey needed for Spring

13. 2/15/2006Scott Ragsdale Score Reporting Schedule – Spring 2006 Testing Dates/Week(s) Reporting Date March 20 – March 24 March 31 March 27 – April 7 April 14 April 10 – April 21 April 28 April 24 – May 5 May 12 May 8 – May 19 May 26 May 22 – June 2 June 9 June 5 – June 16 June 23

14. 2/15/2006Scott Ragsdale Computer Skills Alternate Assessment  Proficiency test used to meet standard  Comparable standard to Online Test of Computer Skills  Who should do this?  Must register student(s) in NCRegistration to receive materials  Files available on TNN  Local scanning/scoring  SIQs to be completed on NCRegistration

15. 2/15/2006Randy Craven EOC-Physics Online Feasibility Study  Register students in NCRegistration beginning in April  Browser-based online assessment  More info on http://cuacs8.mck.ncsu.edu/physics http://cuacs8.mck.ncsu.edu/physics  Virtual Simulations used on last 4 items 1 Flash Format 1 Flash Format 2 Java Format with files to load 2 Java Format with files to load  Soft section breaks – unlike Online Test of Computer Skills – students can navigate forward and backward across the entire test until completed  SIQ completion required before student can be started  Standard administrations to be completed on the same day

16. 2/15/2006Randy Craven EOC Online 2006-07  Optional  Entire School+Subject must either use all online or all paper-pencil  NCDPI is planning to print enough materials for all students in the state to take paper-pencil tests.  Registering & Scheduling to be done on NCRegistration  Format follows Physics Feasibility Study (with adjustments)  SIQs required to be completed in order to test  Students will have to complete on the same day unless they have an accommodation recorded in SIQ  Technical problem can be allowed as a valid reason for letting a student return on another day. This process will have to be set up in NCRegistration.  May need to have a lottery for number of students and/or session slots – a per subject per day quantity will likely have to be established in order to keep the test servers responsive to students.  3 week window at end of course for student  ~ 6 week window that will be open for sessions to be scheduled for fall and spring

17. 2/15/2006Scott Ragsdale Thank You! The success of one is most often the result of the struggle and resolve of a thousand.

18. 2/15/2006Randy Craven Q & A  Online Test of Computer Skills  Computer Skills Alternate Assessment  EOC-Physics Online Feasibility Study  EOC Online 2006-07

19. 2/15/2006Randy Craven Additional Resources  http://cskills.ncsu.edu/nccs/ http://cskills.ncsu.edu/nccs/  http://cskills.ncsu.edu/ncdesk/ http://cskills.ncsu.edu/ncdesk/  http://www.ncpublicschools.org/curriculum/computer skills/ http://www.ncpublicschools.org/curriculum/computer skills/ http://www.ncpublicschools.org/curriculum/computer skills/  http://community.learnnc.org/dpi/tech/ http://community.learnnc.org/dpi/tech/  http://www.ncpublicschools.org/accountability/testing /computerskills/ http://www.ncpublicschools.org/accountability/testing /computerskills/ http://www.ncpublicschools.org/accountability/testing /computerskills/  http://tps.dpi.state.nc.us/ http://tps.dpi.state.nc.us/