1. ATP February 2001, Tucson Dick Soule Vice President, Business Development Assessment Systems, Inc. 610.617.5166 dsoule@harcourt.com Matching Needs to Test Delivery Modes

2. ATP February 2001, Tucson Association of Test Publishers  Issues/Needs  Examinations  Candidates  Locations  Technology  Other  Testing Modes  Matching Needs to Test Delivery Modes © Assessment Systems, Inc., 2001

3. Selecting the Right Testing Mode(s) Needs/Issues for Exams: Item/test security Items and tests must be protected because of either the investment made in development and/or to maintain the integrity of the testing program. © Assessment Systems, Inc., 2001

4. Currency Item/test security When changes in the content are necessary of the exam to accommodate new information. Selecting the Right Testing Mode(s) Needs/Issues for Exams: © Assessment Systems, Inc., 2001

5. Question formats Currency Item/test security When there is a need for questions formats that go beyond multiple choice (point & click, free response, etc.) or for multimedia assets (audio or video). Selecting the Right Testing Mode(s) Needs/Issues for Exams: © Assessment Systems, Inc., 2001

6. Item bank Question formats Currency Item/test security When the size of the item bank is small. Selecting the Right Testing Mode(s) Needs/Issues for Exams: © Assessment Systems, Inc., 2001

7. Immediate results When candidates must receive their results immediately after completing the assessment. Selecting the Right Testing Mode(s) Needs/Issues for Candidates: © Assessment Systems, Inc., 2001

8. Surveillance Immediate results When candidates must be positively identified prior to testing and continuously monitored during testing to ensure the integrity of the assessment and to prevent cheating. Selecting the Right Testing Mode(s) Needs/Issues for Candidates: © Assessment Systems, Inc., 2001

9. Walk-ins Surveillance Immediate results When the program must accommodate candidates appearing for the exam without making a reservation. Selecting the Right Testing Mode(s) Needs/Issues for Candidates: © Assessment Systems, Inc., 2001

10. Self-pacing Surveillance Walk-ins Immediate results When candidates must be able to complete the exam at their own pace at a convenient time. Selecting the Right Testing Mode(s) Needs/Issues for Candidates: © Assessment Systems, Inc., 2001

11. Consistency Self-pacing Walk-ins Surveillance Immediate results When the testing-taking experience must be consistent across all students to ensure equal opportunity. Selecting the Right Testing Mode(s) Needs/Issues for Candidates: © Assessment Systems, Inc., 2001

12. Access When candidates must be able to take exams at a location close to their home or work site. Selecting the Right Testing Mode(s) Needs/Issues for Locations: © Assessment Systems, Inc., 2001

13. Large Groups Proximity When groups of more than 10 individuals must be testing together rather than over several days. Selecting the Right Testing Mode(s) Needs/Issues for Locations: © Assessment Systems, Inc., 2001

14. Computer availability When the organization has very limited funds to invest in the computer hardware needed for computer-based testing. Selecting the Right Testing Mode(s) Needs/Issues for Technology: © Assessment Systems, Inc., 2001

15. Connectivity Computer availability When the number and/or bandwidth of connections to the organization are limited. Selecting the Right Testing Mode(s) Needs/Issues for Technology: © Assessment Systems, Inc., 2001

16. Database Connectivity Computer availability When the organization needs to aggregate candidate results at one or more levels, such as by organization or segment. Selecting the Right Testing Mode(s) Needs/Issues for Technology: © Assessment Systems, Inc., 2001

17. Cost When cost is a primary driver and must be kept down even if this means sacrificing some features of the testing program. Selecting the Right Testing Mode(s) Other Needs/Issues: © Assessment Systems, Inc., 2001

18. Speed of reporting Cost When the speed of reporting results for individual candidates or groups is a major factor. Selecting the Right Testing Mode(s) Other Needs/Issues: © Assessment Systems, Inc., 2001

19. P&P w/ Onsite Scoring Proctored paper & pencil testing at one or more sites with answer sheets scored on-site using a portable scanner. Answer sheets are then forwarded on to a central scoring site for batch processing and aggregate reporting. Large groups can be accommodated. Matching needs to test delivery modes Strength Neutral Weakness Security Currency Formats Item bank Immediacy Surveillance Walk-Ins Self-Pacing Consistency Access Groups Limited Connectivity Database Cost Reporting Needs/Issues ExaminationsCandidate Location TechnologyOther P&P w/ Batch Scoring Proctored paper & pencil testing at one or more sites with answer sheets returned to a central location for batch processing. Reports are sent to individuals and organizations after processing is completed. Large groups can be accommodated. CBT Centers Computerized testing on a consistent hardware platform using standardized procedures at a dedicated vendor assessment center. Results can be provided to candidates immediately after testing and are forwarded overnight for group reporting. CBT Client Computerized testing on a consistent hardware platform using standardized procedures at a client site certified by vendor. Requires that hardware comparable to vendor centers is installed at the site. Results can be provided to candidates after testing and are forwarded overnight for group reporting. CBT Mobile Computerized testing on a high-end laptops using standardized procedures at a third party site such as a hotel. Screen size is slightly smaller than most vendor center computers. Results can be provided to candidates immediately after testing and are forwarded overnight for group reporting. Proctored Internet Tests taken at a site having Internet access. Proctors can either be supplied by vendor or the organization with vendor certification. Bandwidth and trans- mission speed issues may limit the multimedia assets available for the exam. In addition, Internet transmission is less secure than a dedicated network. Unproctored Internet Tests taken at a site having Internet access. This model is probably only appropriate for self-assessments or practice tests. Again, bandwidth and trans- mission speed issues may limit the multimedia assets available for the exam, and Internet transmission is less secure than a dedicated network. Mixed Mode (PP & CBT) Tests administered in both Paper & Pencil and CBT Testing Modes © Assessment Systems, Inc., 2001