Region 4 Pre-SFIREG October 2007

What We Will Cover Today Executive SummaryCompany ProfileWhy Use iCBT?iCBT OverviewiCBT Step-by-StepAgency Tools & ReportsSecurity ConsiderationsConcluding RemarksQ & A

Executive Summary The Concept The Opportunity The Potential Our Internet computer-based testing solution offers distinct advantages over paper-based testing Eliminate agency operating costs Increase flexibility and access Improve testing security Improve test validity via usability services and reporting tools Our convenient, proven, and cost effective testing services provide a total solution for your agency’s certification and licensure needs

Metro Institute Training Institute was founded in 2000 to provide initial applicator training & CEUs. In 2003, Metro Institute partnered with university researchers to design and build a complete Internet computer-based testing system for Arizona SPCC. Who We Are… Today, Metro Institute offers comprehensive design, development, and administrative services for government agencies, corporations, and trade and professional associations. Metro Institute has delivered over 36,000 proctored computer-based tests. What We Do… Metro Institute provides a complete solution: convenient testing locations, a secure network, proctored testing, and outstanding customer service at an affordable price. We work hard to build and nurture long-term business relationships with our clients – not as a vendor but as a partner. How We Do It… Company Profile

Paper Less Flexible Less Convenient Less Secure Expensive to Administer iCBT More Flexible More Convenient More Secure Free to Administer Why Use iCBT? Paper vs. Internet Computer-Based Testing (iCBT)

How iCBT Works iCBT Overview

How iCBT Works iCBT Overview The Metro Institute Online Testing System is a robust, feature-rich Web-based software application for administering, scoring, and reporting tests. Based on the Microsoft.NET Framework and Microsoft SQL Server, it is a proven technology that has delivered over 36,000 examinations for licensure and certification. The Online Testing System is a complete package that manages all aspects of the testing process. Test and User AdministrationAppointment SchedulingProctoringExaminationReporting & Analysis

Applying Agency receives the test taker’s application and approves it Scheduling The test taker calls Metro Institute to schedule their agency approved test(s) Proctoring The test taker arrives at testing center and is proctored into test(s) Test-Taking The test taker takes one or more tests Reporting Metro Institute sends test results to agency iCBT in 5 Basic Steps iCBT Step-by-Step 12345

Step #1: Applying to State Agency Metro’s Testing services integrate well with your agency application submission and approval process. iCBT Step-by-Step 1 Applying Agency receives the test taker’s application and approves it 1 Application is reviewed and approved by agency personnel Agency approval to test is submitted to Metro electronically The approval to test can be sent to Metro’s servers by automated transfer or manually via the agency’s feature-rich administration website.

Step #2: Scheduling the Appointment iCBT Step-by-Step Scheduling The test taker calls Metro Institute to schedule their agency approved test(s) 2 Convenience is our priority. Test takers choose where and when they would like to take their test(s). The test taker calls Metro Institute’s toll free telephone number Metro staff queries the testing system for the agency’s approval to test Approval is confirmed and the test is scheduled on the testing system’s calendar A test taker cannot simply visit a testing center without first having the approval to test verified by Metro staff in the home office. This is just one of several sequential security steps to prevent access to testing materials.

Step #3: Proctoring the Test Taker iCBT Step-by-Step Proctoring The test taker arrives at testing center and is proctored into test(s) 3 Proctoring is all about security and the integrity of the testing process: identification, verification, and controlled access. A photo ID is requested and identification is verified A digital photo is taken and uploaded to the testing system The test taker is proctored into the specific test scheduled for that day This proctoring process activates the scheduled test. The test cannot be accessed without this proctor-activation process. The proctor escorts the test taker to an available kiosk workstation

Controlled Access to Test Questions Agency application approved & received Appointment scheduled by Metro staff Test taker must arrive on schedule day at specific location State issued photo ID verified Proctor takes photo and activates approved test Proctor logs test taker into testing workstation Testing system verifies the IP address iCBT Step-by-Step Seven events must be completed in sequence before a single test question can be accessed

Step #4: Taking the Test iCBT Step-by-Step Test-Taking The test taker takes one or more tests 4 The test taking experience combines simplicity and ease of use with the powerful and robust features most requested by your peers. At start, the system creates a uniquely randomized test and the timer begins Each encoded answer is immediately sent to the testing system If time expires, the test is immediately closed The test is graded and the test taker is given a print-out of their pass/fail results For improved security, at no time are the testing materials installed or stored on the local workstation.

Step #5: Reporting the Test Results iCBT Step-by-Step Reporting Metro Institute sends test results to agency 5 Receiving and processing test results is made easy with Metro Institute’s fully automated electronic delivery options. The test results and test taker photo are sent electronically to the agency… Test takers who pass receive their agency license or certification! Each test taker’s completed test is permanently archived. Agency personnel can use the Agency Administration website at any time to review any test taker’s test and answers.

The Test Taker Experience Metro Institute Online Test Demo iCBT Step-by-Step 5

Agency Administration Website Agency Tools & Reports Reports and Analysis Tools Test Administration Tools Test Taker Administration Tools Daily test results Overall test assessment Question assessment Location assessment Test management Question pools Review & comment tools Supplemental materials Printed tests Account management Application management Individual result histories Onsite photo IDs

Popular Reports Score Distribution Report (Histogram) Discrimination Index Report Test Results Analysis: Location Test Question Analysis: % Correct Average Time to Complete Test Agency Tools & Reports

Sample: Score Distribution Report (Histogram) Agency Tools & Reports

Sample: Discrimination Index Agency Tools & Reports

Sample: Test Results by Location Agency Tools & Reports

Technical Security Server Security o IP address restricted o Firewall & port management o MD5 encryption Workstation Security o IP address restricted o Hardened kiosk o Local onsite firewall Physical Security Hosting Provider Security o Professional security team o Dedicated backup power o Dedicated data backups Testing Site Security o Photo ID o Monitored, non-public facilities Security Considerations Security At Every Turn Seven events must be completed in sequence before a single test question can be accessed

Concluding Remarks

Questions & Answers