Visualisation issues in the context of Information Fusion Jean-Rémi Duquet Lockheed Martin Canada Jean-Yves Fiset Systèmes Humains-Machines Inc Hélène LHeureux École Polytechnique de Montréal

Plan Data Fusion - overview Data Fusion – human factors issues Tagci – an HMI Design method Research – adapting Tagci for data fusion applications

Data Fusion - Overview Data / Information Fusion can be seen as: 1. Knowledge Composition (e.g. Feature Extraction) 2. Evidence Aggregation 3. Decision (e.g. plot symbol as AIR HOSTILE, put on threat list)

Data Fusion Overview FLIR Shape-Matching Classifier SAR Hierarchical Classifier 80 % Merchant 20 % Unknown 70 % Destroyer 20 % Frigate 10 %Unknown Intelligence reports (Location, ID, Emitters, Freq) Surface Radar (Location) Human Analysis

Data Fusion – Human Factors Issues Use & display of fuzzified / uncertain identity statements Large tree of Identity Propositions created by aggregation process Conflicts management, recovery from errors and deception Output stability (e.g. friend /foe oscillations, multi-scan tracking) Algorithmic issues related to HUMINT, human analysis, self-intoxication Human inputs as part of fusion process (e.g. correlation, aggregation) Fusion process (self- ?) monitoring Usability / function allocation issues (SA display, cues and alerts )

Data Fusion – Human Factors Issues Test Bed Human-Machine Interface

Data Fusion – Human Factors Issues Test Bed Human-Machine Interface

HMI Methodology Requirements for DF Simple to learn and apply Smooth interface with SW engineering Allows technological uncertainty Information Requirements: obvious common ground between DF development and CE methodologies

HMI G g1 g2 g3 Tagci – An HMI Design Method Generic model of the operators task Matching process models Operators behaviour HMI design principles HMI Content and Organization Information architecture Tagci Getting on with the job

Tagci Goal Modeling, Detection Task and DF

Data Fusion An example Tagci-based display sketch Hierarchy of Military Goal(s) Area, personnel and equipment Info. Srce Info. Srce Info. Srce Info. Srce G g1g2g3 g4g5g6 Tagci-based display Goal monitoring Support for compensation

Research Agenda Fine tuning of generic tasks Built-in operator strategies Enhanced visualization primitives

Conclusion Data fusion is a complex process in itself Numerous human factors complicate HMI design HMI design must consider domain, tasks, operator, HMI design rules Tagci integrates several sources of knowledge to design HMIs for monitoring and controlling complex systems Potential for monitoring and controlling DF processs Optimizations to Tagci for DF applications are being examined