Computer-Based Testing FCAT/FCAT 2.0/EOC Computer-Based Testing FCAT/FCAT 2.0/EOC Florida Association of MIS June 12, 2012 Susie Lee, Director of Test Administration, K-12 Bo Elzie, Project Director, Computer-Based Testing Certification Department of Education

Background The DOE began a certification process for determining CBT readiness in using an online tool. All participating schools certified readiness and 500,000 computer-based assessments were successfully administered. The certification process continued in , and over one million assessments were successfully administered. The Department created and has maintained a 15 member Computer-Based Testing (CBT) Advisory Committee which meets regularly via conference call to provide input on all readiness activities for computer-based testing. The committee is comprised of district assessment, MIS, and technology staff. The Department also maintains an ongoing cross-division communications team that meets regularly to discuss and take action on CBT issues.

Background: 4 Certifications in Fall Certification FCAT Mathematics Retakes FCAT Reading Retakes (CBT optional) FCAT 2.0 Reading Retakes Winter Certification December/January Algebra 1 EOC Assessment Spring Certification (FCAT and FCAT 2.0) FCAT Mathematics Retakes FCAT Reading Retakes (CBT optional) FCAT 2.0 Reading Retakes Grade 6 FCAT 2.0 Reading Grade 10 FCAT 2.0 Reading Spring Certification (EOCs) Algebra 1 Biology 1 Geometry U.S. History field Test (sampled high schools only)

Spring 2012 FCAT/FCAT 2.0 ◦ FCAT 2.0 Reading Retake: 51,539 ◦ FCAT Mathematics Retake: 32,525 ◦ FCAT Reading Retake: 11,307 ◦ FCAT 2.0 Grade 6 Reading: 200,109 ◦ FCAT 2.0 Grade 10 Reading: 185,668 ◦ Total: 481,148

Spring 2012 EOC Assessments ◦ Algebra 1: 202,146 ◦ Biology 1: 190,687 ◦ Geometry: 188,362 ◦ U.S. History: 54,883 ◦ Total: 636,078 Total Number of Spring CBT Assessments: 1,117,226

Most Common Issues Student submits test or is marked complete early (requires FDOE action) Student tests using wrong authorization ticket Technical problems resulting in students getting kicked out of a test ◦ Local issues – in almost all cases, problems discovered and resolved quickly ◦ Other issues – bad weather, internet service went down, etc.

Summer 2012 Algebra 1: July 23 – August 10 (districts select administration week) No Certification process for summer Infrastructure Trial is recommended for workstations that will be used for testing

Transition

New Computer-based tests: ◦ Grade 5 FCAT 2.0 Mathematics ◦ Grade 7 FCAT 2.0 Reading ◦ Grade 9 FCAT 2.0 Reading ◦ Civics Field Test The FCAT Reading Retake is no longer administered

TestNav 6.9 TestNav 6.9 will continue to be the computer-based testing platform ◦ Requires software download ◦ Secure, locked-down browser ◦ Runs on tablets (except for iPads) but not recommended ◦ Fall all schools will need to download updated software

How do we ensure that schools are ready for the continued transition to CBT?  Stakeholder feedback indicated that the DOE certification process to determine CBT readiness should continue in with some modifications.  An infrastructure trial will still be required for each computer that will be used for CBT, and this will be managed locally.  Superintendent certification of CBT readiness will still be required.

Certification Process Certification Process Section I (Computer Inventory), Section II (scheduling) and Section III (Checklist) of the online certification tool will remain essentially the same. However, there will only be two certification periods: fall/winter and spring. The Fall/Winter Computer-Based Assessments are: October 8-12, 2012 or October 15-19, 2012 (Districts decide) FCAT Mathematics Retakes and FCAT 2.0 Reading Retakes November 28 – December 19, 2012 Algebra1, Biology 1, Geometry EOC Assessments

The Spring Computer-Based Assessments are: April 8-19, 2013 FCAT Mathematics Retakes FCAT 2.0 Reading Retakes April 15-26, 2013 FCAT 2.0 Reading, Grades 6,7,9, and 10 FCAT 2.0 Mathematics, Grade 5 April 22-May 10, 2013 U.S. History EOC Assessment April 29-May 17, 2013 Algebra 1, Biology 1, and Geometry EOC Assessments April 29- June 7, 2013 Civics EOC Field Test Certification Process, Continued

Critical Dates Critical Dates DPS memo goes out August 6, 2012 Tool opens for fall/winter certification August 27, 2012 Tool closes for fall/winter certification September 21, 2012 Tool opens for spring certification February 18, 2013 Tool closes for spring certification March 22, 2013

Educator Equipment / Hardware Student Equipment / Hardware Professional Development ProgramComments XXXTitle I, Part A These funds may only be used in schools designated as Title I schools. Use of Title I funds for computer-based assessment is more likely to be compliant with federal regulations in school wide programs rather than targeted assistance programs XTitle II, Part AThese funds may be used only for professional development in core subject areas X Title II, Part B, Math and Science Partnerships This is a competitive program from the state to the sub-recipients. XXX Individuals with Disabilities Education Act (IDEA) For the most part, these funds can be used only to benefit students with disabilities; so for example, use of these funds for professional development would be limited to educators serving students with disabilities. XXX School Improvement Grants (1003a and 1003g) The extent to which these funds can be used to support computer-based assessment will depend on the state’s approved plans for use of the funds. XXX Race to the Top (RTTT) State Grant Funds can be used consistent with approved state/local scopes of work. XXX Title VI, Part A, Grants for State Assessments and Related Activities Generally available for any purpose which supports the development and/or administration of state assessments and standards at the discretion of the state (may include the costs of working in partnerships with other states).. The following table delineates several potential federal fund sources for supporting computer-based assessments. In determining applicability to any particular situation, care must be taken to ensure that proposed allocations and expenditures do not violate federal requirements related to supplanting. In particular, note that supplanting is presumed to occur when federal funds are used to implement a state-level requirement or federal funds are use to provide a benefit to an eligible population while non-federal funds are used to provide the same benefit to other populations that are not eligible for the federal program. Each situation must be individually analyzed to determine whether proposed uses of funds are compliant with federal requirements. Note: Title III is not included in this listing because USED has interpreted the supplement/not supplant provision to specifically preclude use of Title III funds for assessment purposes. Potential Federal Grant Resources for Funding Computer- Based Assessment

General Specifications (Windows/PC and Apple/Macintosh) Each computer must meet or exceed the following General Specifications in addition to the applicable Operating System Specifications below:  500 MB available disk space  1024x768 screen resolution  Keyboard and mouse (or other pointing device)  High-speed internet connection Operating System Specifications Windows/PC Windows XP (Service Pack 3)  Pentium III 733 MHz processor  512 MB RAM Windows (Service Pack 1)  Pentium III 1 GHz processor  1 GB RAM Windows 7  Pentium III 1 GHz processor  1 GB RAM Apple/MacintoshMac OS X 10.4  G3, G4, G5 500 MHz processor  512 MB RAM Mac OS X 10.5  Intel, G4, G5 867 MHz processor  512 MB RAM Mac OS X 10.6  Intel processor  1 GB RAM 2012–2013 Computer-Based Testing System Minimum Specifications

Additional Specifications for TestHear (Accommodated Forms)  TestHear will operate on Windows PC workstations and on Macintosh workstations that have Mac OS 10.5 or later installed and are running Windows (e.g., via Boot Camp). TestHear will not work on Mac OS X 10.4 or on Macs that cannot also run Windows.  For students requiring the screen reader, the computer must be equipped with an audio card and headphones. Updated 9/2/ –2013 Computer-Based Testing System Minimum Specifications (Cont’d) For an optimal student experience, any computer that takes a noticeably long period of time (e.g., more than 10 seconds) to start and run applications, even computers which meet the requirements above, should not be used for high-stakes computer-based testing, if possible. The testing platform does not permit access to other applications during testing. This means that any applications that may automatically launch during testing will interrupt the student’s testing session, logging the student out of the test. Applications such as antivirus updates, power management software (laptops), screen savers, and with automatic message notifications should be configured so they do not launch during test sessions.

The Future “It is a simple fact that access to high-speed broadband is now as vital a component of K-12 school infrastructure as electricity, air conditioning and heating.” SETDA, Recommendations: An external Internet connection to the ISP – At least 100 Mbps per 1,000 students/staff WAN connections from the district to each school and among schools – At least 1 Gbps per 1,000 students/staff Recommendations: An external Internet connection to the ISP – At least 1 Gbps per 1,000 students/staff WAN connections from the district to each school and among schools – At least 10 Gbps per 1,000 students/staff

Questions or Comments?