ITAB IT Aptitude Battery © CogniMetrics, Inc., 2006 NAMIS Product Fair Fairfax, VA. January 11 th, 2006

Content navigator ITAB: IT Aptitude Battery What is the ITAB? ITAB and the U.S. Navy ITAB: procedural skills What is procedural skill? Examples of procedural skills ITAB: tests Measurement purpose ITAB 1: Hidden Target Test ITAB 2: Battery Test Computer game-like tests How do ITAB tests measure PKL aptitude?How do ITAB tests measure PKL aptitude Innovative features ITAB: Test Data ITAB: Test Report ITAB: Information ITAB: technical information ITAB: access information The compass icon appears on many slides in the slide show. Click on one of its arrows to return to the navigator page. © CogniMetrics, Inc., 2006

ITAB IT Aptitude Battery The ITAB is the worlds first battery of fully interactive tests of human intelligence. A product of: CogniMetrics, Inc. San Antonio, TX What is the ITAB? © CogniMetrics, Inc., 2006

ITAB IT Aptitude Battery The Navy Mission requires its personnel to be able to operate a great variety of technical systems. The cognitive skill required for using such systems is called procedural knowledge, or procedural skill. Traditional tests of intelligence, such as the ASVAB, were not designed to measure aptitude for procedural skill learning. ITAB and the U.S. Navy © CogniMetrics, Inc., 2006

ITAB procedural skills Procedural skill is knowledge that a person uses to interact with a physical, or conceptual, system to achieve a particular goal. What is procedural skill? © CogniMetrics, Inc., 2006

Procedural skills vary in complexity from performing operator maintenance on a M16A1 rifle, to preparing board weapon systems for operation, to operating board weapon systems, and to remotely controlling UAVs. Cognition research in the nineties has deepened our insight into how procedural skills are learned. Examples of procedural skill ITAB procedural skills © CogniMetrics, Inc., 2006

ITAB tests The ITAB tests measure the aptitude to learn procedural skills (procedural knowledge). We will refer to this aptitude as PKL aptitude (procedural knowledge learning aptitude). Measurement purpose © CogniMetrics, Inc., 2006

ITAB tests ITAB 1: Hidden Target Test Task: The Interface of the Hidden Target test generates a two-dimensional search space consisting of a rectangular grid of equally spaced horizontal and vertical lines. The subject is required to determine where a target is located in as few steps as possible. The subject can move a cursor across the two-dimensional space from junction to junction using a set of arrow keys. To indicate his or her first guess the subject clicks at the key. The feedback of the task-environment indicates the distance between the tested location and the location of the hidden target in City Block metric.. bar keys HELP menu © CogniMetrics, Inc., 2006

ITAB tests ITAB 2: Battery Test Task: the test requires the individual to test whether the presented batteries work. Each new trial starts with a set of nine batteries to be tested. The battery tester is designed such that batteries have to be tested in pairs. The goal of the task is to identify the defective batteries in as few steps as possible. Each set of nine batteries contains two defective batteries. HELP MENU button Feedback window © CogniMetrics, Inc., 2006

The feel of a computer game Combining a game-like character and an intuitive interface gives ITAB tests an advantage in testing populations that have developed an aversion against school math and the static logic of traditional intelligence tests. ITAB tests © CogniMetrics, Inc., 2006

How do ITAB tests measure PKL aptitude? The tests provide an interactive task environment in which the individual has to achieve a goal. The tests measure: how feedback is incorporated into follow-up actions how quickly this leads to a more or less efficient procedure ITAB tests © CogniMetrics, Inc., 2006

Innovative features 1.ITAB tests provide an (interactive) task environment.task environment 2.Actions of individuals are not scored as singleton answers to distinct problems, but analyzed as sequence patterns. sequence patterns ====== 3.The test report is organized according to an empirically tested structural equations model.test report ITAB tests © CogniMetrics, Inc., 2006 CONTINUE

ITAB: TEST DATA Each ITAB test provides an interactive task- environment. An examinee action (user action) changes the environment (system action) and the examinee receives feedback about the new state of the task-environment (system output). The diagnostic components of the ITAB tests measure these changes per user step and analyses: sequential aspects of the user actions The informational content of each new system state ITAB tests © CogniMetrics, Inc., 2006

ITAB: TEST REPORT The diagnostic components of the ITAB tests organize the many measurements into three scores that are intuitively accessible. The individual test reports provide these scores for prediction purposes as well as detailed analysis of test performance that may help understanding and improving it. ITAB tests © CogniMetrics, Inc., 2006

ITAB: TEST REPORT systematic approach e5 e4 intelligence e7 e6 e3 e2 e1 PKL(B) ENT_B e9 MEAN _ BRT e10 VAR_BRT e11 e8 ITAB tests © CogniMetrics, Inc., 2006

ITAB: TEST REPORT systematic approach e5 e4 intelligence e7 e6 e3 e2 e1 PKL(B) ENT_B e9 MEAN _ BRT e10 VAR_BRT e11 e8 ITAB tests © CogniMetrics, Inc., 2006

systematic approach e5 e4 intelligence e7 e6 e3 e2 e1 diagnostic information ITAB: TEST REPORT PKL(B) ENT_B e9 MEAN _ BRT e10 VAR_BRT e11 e8 predictor score procedural learning aptitude score ITAB tests © CogniMetrics, Inc., 2006

ITAB: TEST REPORT systematic approach e5 e4 intelligence e7 e6 e3 e2 e1 diagnostic information PKL(B) ENT_B e9 MEAN _ BRT e10 VAR_BRT e11 e8 predictor score consistent and careful work style efficiency information processing ITAB tests © CogniMetrics, Inc., 2006

ITAB: TEST REPORT systematic approach e5 e4 intelligence e7 e6 e3 e2 e1 PKL(B) ENT_B e9 MEAN _ BRT e10 e8 Battery Test VAR_BRT e11 ITAB tests © CogniMetrics, Inc., 2006

ITAB: TEST REPORT systematic approach e5 e4 intelligence e7 e6 e3 e2 e1 PKL(H) ENT_H e9 MEAN _ HRT e10 e8 Hidden Target Test VAR_HRT e11 RETURN ITAB tests © CogniMetrics, Inc., 2006

Measurement claim:procedural knowledge handling (aspect of general intelligence) Number of tests:2 (HTT and BT) Administration time:10 minutes per test (average) Languages:English, Spanish, German, Dutch Test Publisher:CogniMetrics, Inc. Published:March 2004 Price:see: bulk discounts negotiable Reliabilities:HTT (0.88 – 0.97) BT (0.80 – 0.87) Validities: construct validity studies:see: FOR MORE INFORMATION predictive validity studies:currently under way with: - Air Force Research Lab, Brooks City Base; - Navy Directorate Selection and Classification, Washington, D.C. FOR MORE INFO... Download ITAB manuals: Report on construct validity: (paper 066; powerpoint presentation 066). ITAB information ITAB: Technical Information © CogniMetrics, Inc., 2006

ITAB: Access Information Web site: Select Select language:English, Spanish, German, Dutch Username:Password:Test: ASMR ASMRS Hidden Target ASMR ASMRU Battery Test ITAB information © CogniMetrics, Inc., 2006

Thanks for reviewing this CogniMetrics proposal For further information, Please contact: Dr. Martin J. Ippel (210) 481 – 0261 © CogniMetrics, Inc., 2006

Interactive Task Environment: Complete interactivity is achieved by creating an internal representation of the task-environment. Artificial Intelligence technology is used to compute the intelligence of each step. RETURN © CogniMetrics, Inc., 2006 ITAB tests

Analysis of behavior sequences Unlike traditional tests, ITAB tests do not consists of items with a standard set of responses. The individual is free to act within the task-environment. The individual must produce a sequence of actions to achieve a goal, while using the feedback provided by the task-environment. Performance assessment is based on analysis of these action sequences. RETURN © CogniMetrics, Inc., 2006 ITAB tests