Ergonomics and Information Systems RESEARCH INSTITUTE FOR COMMUNICATION, INFORMATION PROCESSING, AND ERGONOMICS FGAN A Knowledge-based Human-Machine Interface for Future Naval Combat Direction Systems A Knowledge-based Human-Machine Interface for Future Naval Combat Direction Systems Morten Grandt ∙ Helmut Distelmaier ∙ Claudius Pfendler FGAN – Research Institute for Communication, Information Processing, and Ergonomics – Ergonomics and Information Systems – Wachtberg, GE Visualisation of the Common Operational Picture NATO-RTO IST-043/RWS-006 September 14-17, 2004, Toronto

Ergonomics and Information Systems RESEARCH INSTITUTE FOR COMMUNICATION, INFORMATION PROCESSING, AND ERGONOMICS FGAN Perspectives for Future Missions of German Navy Network centric warfare  Increasing quantity & quality of information + Enhancement of threatening weapon systems  Reduction of available reaction time + Missions Operations other than war (OOTW)  Increasing Complexity Asymmetric theads Mixed Environments  Increasing Uncertainty + Crew reduction (?) = Higher demands on the human operator

Ergonomics and Information Systems RESEARCH INSTITUTE FOR COMMUNICATION, INFORMATION PROCESSING, AND ERGONOMICS FGAN HMICDS Sensors Communication Weapons Adaptive Support in CDS User interface Usage support Decision support computer-based situation analysis and action planning interaction techniques visualization techniques knowledge-based support system Decision / response selection Response execution Perception Operato r Situation Task Operator State

Ergonomics and Information Systems RESEARCH INSTITUTE FOR COMMUNICATION, INFORMATION PROCESSING, AND ERGONOMICS FGAN HMICDS Sensors Communication Weapons Adaptive Support in CDS User interface Usage support Decision support computer-based situation analysis and action planning interaction techniques visualization techniques knowledge-based support system Operato r computer-based situation analysis and action planning Decision Support Objective:Support situation evaluation and decision-making on the basis of expert knowledge and available a-priori information

Ergonomics and Information Systems RESEARCH INSTITUTE FOR COMMUNICATION, INFORMATION PROCESSING, AND ERGONOMICS FGAN CDS Sensors Communication Weapons HMI Model of human decision-making situation data Support Decision-Making by Integration of Knowledge and Reasoning Operato r User interface knowledge-based support system Decision Support ID-Proposal Situation analysis Expert knowledge Action model Action plan Describable situation knowledge Procedures (Rules) Environment (Infrastructure) Orders Rules of Engagement Experience Typical (frequently observed) behavior patterns

Ergonomics and Information Systems RESEARCH INSTITUTE FOR COMMUNICATION, INFORMATION PROCESSING, AND ERGONOMICS FGAN HH Hypothesis Development Track-data Track-attributes Check for application Non Merchant MIL Check for identity CIV NeutralUnknown FF AFSU Attributes relating to identity Rules HostileFriendly Attributes relating to application Application tendency Identity tendency Decision Support Argument storage “Track has crossed airway below … ft” “Track replies correct IFF mode …”

Ergonomics and Information Systems RESEARCH INSTITUTE FOR COMMUNICATION, INFORMATION PROCESSING, AND ERGONOMICS FGAN HMICDS Sensors Communication Weapons Adaptive Support in CDS User interface Usage support Decision support computer-based situation analysis and action planning interaction techniques visualization techniques knowledge-based support system Operato r visualization techniques Objective:Support perception and evaluation of complex, dynamic information

Ergonomics and Information Systems RESEARCH INSTITUTE FOR COMMUNICATION, INFORMATION PROCESSING, AND ERGONOMICS FGAN Visualization of Complex, Dynamic Information In nowadays systems important information is displayed in textual form. Visualization Techniques  single elements have to be integrated by the human operator  Higher utilization of cognitive resources Solution: Utilisation of human skills for pattern- recognition by means of graphical transformation of complex data „Perceiving instead of thinking“

Ergonomics and Information Systems RESEARCH INSTITUTE FOR COMMUNICATION, INFORMATION PROCESSING, AND ERGONOMICS FGAN Tactical Situation Display Usage by Toolbox:  Scrolling  Cartographic zooming  Track search  Formation editing  Identification / Classification  Display settings predefined filters, styles, etc. Visualization:  Tracks & related events and actions  A-priori information: e.g. airways, corridors, (restricted) areas etc.  Interactive ENC-chart S-57 / VMAP L1  Event-triggered Polar Displays HMI Prototype

Ergonomics and Information Systems RESEARCH INSTITUTE FOR COMMUNICATION, INFORMATION PROCESSING, AND ERGONOMICS FGAN Track Detail Display Relief of working memory:  Parameter ranges / tendencies  Predefined tolerances for non-critical values  State changes (IFF/ESM)  Values / States along Time / Distance  A priori information on demand Utilize pattern recognition:  Heterogeneous values cause emergent line characteristics  Parameter constellations (Alt/Spd)  Graphical representation of inference results HMI Prototype

Ergonomics and Information Systems RESEARCH INSTITUTE FOR COMMUNICATION, INFORMATION PROCESSING, AND ERGONOMICS FGAN Summary For future naval operations intelligent human-machine interfaces for Combat Direction Systems are needed in order to assist the operator. This assistance should comprehend processes of decision-making and human-system interaction and should be adapted to the situation, the task actually performed and the operator functional state. Intelligence has to be embedded by means of expert knowledge and a-priori information related to particular scenarios. In the context of decision support user models and databases for knowledge representation have to be developed and to be validated. New visualization techniques make use of human skills in graphical information analysis and may enhance operators’ situational awareness.