1. Research Part 3

2. Interface:BaselineAlt IndependentCognitively -Eng Problem Scenario:Ownship Firing Question Complexity:Lo High Cognitive Design Principles Used: 1 Automation of Unwanted Workload 2 0 2 0 1 1 0 0 2 2 2 2 2 Use of Alert Messages & Color Coding 2 0 1 1 0 0 2 2 2 2 3 Appropriate Data Grouping 2 0 2 11 1 2 2 2 2 4 Use of Metaphor 2 0 2 1 1 1 2 2 2 2 2 2 5 Display Name Related to Function 2 2 2 0 2 2 0 0 2 2 2 2 6 Consistent Meaningful Grouping 2 0 2 1 2 2 1 1 2 2 2 2 7 Use of Status Indicators 2 0 2 0 1 1 1 1 2 2 2 2 8 Necessary Information Only 1 0 1 1 1 1 1 1 2 2 2 2 9 Judicious Redundancy 0 1 0 1 2 2 2 2 10 Multiple Coding of Data To Promote Cognitive Flexibility 1 0 1 0 1 1 0 0 1 2 1 2 Condition Total 16 3 16 5 13 13 8 8 19 20 19 20 Interface Total 40 42 78 0=Absence of Cognitive Design Principle (CDP) 1=Partial Presence of CDP 2= Full Presence of CDP

3. Research Model Problem Domain: Anti Submarine Warfare Independent Variables 1. Interface (three levels:) 1.1. Baseline 1.2. Cognitively engineered 1.3. Alternate independent 2. Problem (two levels:) 2.1. Ownship 2.2. Firing 3. Question type: (two levels:) 3.1. Yes/No 3.2. Multiple Choice Intervening Variable: Participants’ Cognitive Processes Control Variables: 1.Environment 3. Experimenter 2. Equipment 4. Instrumentation Dependent Variables 1.Objective: 1.1. Reaction Time 1.2. Accuracy 2. Subjective: 2.1. Workload 2.2. Preference

4. Experimental Schedule -Oct. 15 – Meet with students to give them an introduction to the domain (submarines) and to the workload tools. (approximately one and half hours) -Oct. 22= Day 1 of experiment -Oct. 29= Day 2 of Experiment -Nov. 5= Day 3 of Experiment

5. There would be six different groups of students that would participate in the experiment at the following times. Grp. Day 1- Oct. 22Day 2- Oct. 29Day 3- Nov.5 1.4:30 4:30 4:30 2.6:00 6:00 6:00 3.7:30 7:30 7:30 4.4:30 6:00 7:30 5.6:00 7:30 4:30 6. 7:30 4:30 6:00

6. Experimental Design IntroductionGroup Module1 2 3 NumberTreatmentObservationTreatmentObservationTreatment Observation Same1A0-1B0-2C0-3 treatment for all2A0-1C0-2B0-3 Given in3B0-1A0-2C0-3 class. 4B0-1C0-2A0-3 5C0-1C0-2A0-3 6C0-1B0-2A0-3 Codes: A=CognitiveInterface B=BaselineInterface C=AlternateIndependentInterface O=Observa- tions (subjective and objective measures)

7. Trail Events: Ownship Task PICTURE Enter Y for Yes Or N for No Ownship Is Ownship Ready? Yes NO DISPLAY PICTURE Ownship Why Isn’t Ownship Ready? Select a number indicating your answer Your Response Press Return To Start Press return when you know the answer Enter Y or N And Press Return Press return to Start Press return when you know the answer Enter a Number And Press return New Trial

8. Task Load Index (NASA – TLX) Was developed at NASA-Ames Research Center A subjective multi-dimensional rating procedure Provides an overall workload score

9. Rating Scale Description: MENTAL DEMAND: How much mental and perceptual activity was required (e.g. thinking, deciding, calculating, remembering, looking, searching, etc.)? Was the task easy or demanding, simple or complex, exacting or forgiving?

10. Rating Scale Description: TEMPORAL DEMAND: How much time pressure did you feel due to the rate or pace at which the task(s) elements occurred? Was the pace slow and leisurely or rapid and frantic?

11. Rating Scale Description: OWN PERFORMANCE: How successful do you think you were in accomplishing the goals of the task(s)? How satisfied were you with your performance in accomplishing these goals?

12. Rating Scale Description: EFFORT: How hard did you have to work (mentally and physically) to accomplish your level of performance? FRUSTRATION: How insecure, discouraged, irritated, stressed and annoyed versus secure, gratified, content, relaxed and complacent did you feel during the task?

13. TLX Rating Scales Task or Mission Segment: Please rate the task or mission segment by putting one “X” on each of the six scales at the point which matches your experience. Point the mouse at the location where you wish to place the “X”. Mental Demand Low High Temporal Demand Performance Effort Frustration Low High Good Poor Low High Low High Click The Mouse When Finished

14. Preference Question “Rank the three interfaces (by letter code) in their order of quality with quality defined as how well you could perform the task within each interface.” (A=cognitively engineered, B=baseline, C=alternate independent).