BATIC 3 S Project BATIC 3 S Building Adaptive Three-dimensional Interfaces for Critical Complex Control Systems haute école valaisanne e i g école d’ingénieur de Genève

BATIC 3 S Project Goal of the project Building a methodology and techniques for model-based development of 3D stereoscopic GUIs for critical complex control systems

BATIC 3 S Project Classic GUI development GUI development is typically HAND-CODED This is not satisfactory if we want to: Verify the interface with respect to expected functionality Scale to complex systems Test multiple different visual choices Requirements ProgrammerResult

BATIC 3 S Project Model-based GUI development We want to have a model for the GUI on which a prototype is built automatically Requirements ResultModelGeneration Multi-prototype VerificationScalability

BATIC 3 S Project Control Systems GUIs Control Systems* can be complex: number of components hierarchy spatial navigation adaptation * A computer system which automatically controls a process or mechanical device by sensing the need to vary the output challenges to GUI design }

BATIC 3 S Project The CMS Silicon Strip Tracker control system About components Hierarchically structured Requirements for an easy navigation Strict requirements for reliability Adaptation of the GUI

BATIC 3 S Project The BATIC 3 S approach - overview System model Logical model Visual model System description Database, Requirements… GUI generation GUI Model of the physical system components hierarchy communication Model of the behaviour of the GUI objects. Their visual aspect is not yet modeled. Model of the visual aspect of the GUI objects. Based on one or more repositories of GUI widgets.

BATIC 3 S Project Advantages of the approach Complexity and Verification The models can be built with a standardized methodology that is independent on the complexity of the system. System model Logical model Visual model Properties can be verified directly on the model - e.g.: are all needed actions on a component possible in its GUI representation?

BATIC 3 S Project GUI generation Advantages of the approach Multiple prototypes Separation of behaviour from visual aspects: different visual interfaces can be generated from the same logical model System model Logical model Visual model GUI Visual model Visual model GUI Easier evaluation of different interaction modes for the GUI

BATIC 3 S Project Model generation process System model Logical model Visual model GUI description Control Systems Experts Language used: CO-OPN (Concurrent Object-Oriented Petri Nets) - Formal - Based on Algebraic Data Types - Executable 3D GUI Widget repositories 2D Button Rules System Behavioural description System Physical description Engineers

BATIC 3 S Project Exploring different paradigms Requirements pose problems in terms of complexity, navigation, interaction – “Classic” 2D interface may not be the best approach – A 3D stereoscopic approach might yeld best user interaction and orientation Typical problem: lack of standard metaphores on 3D GUIs* BATIC 3 S proposes: –to use 3D object representations as GUI widgets –to navigate the system as a virtual 3D structure –to use stereoscopy to help navigation * See Berstel, Reghizzi, Roussel, San Pietro, A scalable formal method for design and automatic checking of user interfaces, Proceedings of the 23rd International Conference on Software Engineering, Pag , IEEE, 2001

BATIC 3 S Project 3D and navigation The interface is made of 3D representation of the real system objects.

BATIC 3 S Project 3D and navigation Objects are interactive and let users navigate the system and send commands Options Turn Off Reset Details

BATIC 3 S Project 3D and adaptation The GUI can be adaptive to guide the user according to the context and to the user type, to provide important information (e.g. alarms) without the need to ask for it explicitly.

BATIC 3 S Project Stereoscopy 3D stereoscopy can provide the user a realistic immersion sensation, and improve his orientation A great amount of information is conveyed through a perception which is more natural and intuitive to users The user is helped in understanding spatial relationships

BATIC 3 S Project Stereoscopy New stereo projection solutions allow for more affordable systems. Very simple concept behind this type of stereovision: prepare two images, a right eye view and a left eye view display them on the same space on a screen

BATIC 3 S Project haute école valaisanne e i g 3D stereoscopy (S. Malandain) GUI adaptation (A. Le Calvé) GUI adaptation (G. Falquet) Modeling methodology (D. Buchs) Control Systems Expertise (R. Chierici) Partners involvement BATIC 3 S 1 assistant Requested support: CHF

BATIC 3 S Project Workplan Hierarchical 3D object modelingXX Interaction & Navigation modelsXX Renderer & interaction implementationXXXX Modeling methodologyXX Toy use caseXX Model semanticsXX Tools & transformation techniquesXX Model verificationXX Classification of users and modeXX Techniques for visual adaptationXX Usability testingXXX Problem studyXX GUI testingXXX Stereoscopy Modeling Adaptation Case Study Semesters Tasks

BATIC 3 S Project Our competences Modeling (UniGe) Experience in development of system models, supported by existing tools (COOPNBuilder). Stereoscopy (EIG) Stereoscopic testbed & previous experiences in building scientific stereo visualization tools. Adaptivity (UniGe, HEV) Published works on 3D adaptive visualisation of knowledge.

BATIC 3 S Project Modeling methodology Use case prototype Prototype framework and tools Publication of papers (journals, conferences) Expected deliverables BATIC 3 S

BATIC 3 S Project Importance of the project Actuality –computer manufacturers are moving towards 3D stereo visualization systems also on personal systems (e.g. SHARP laptops). –Model-based development can effectively answer demands in terms of quality, reliability, flexibility, adaptivity. Originality –Principles for 3D GUIs are not well established yet –Critical complex control systems need solid methodologies for producing reliable, high quality interfaces

BATIC 3 S Project BATIC 3 S Thank you! haute école valaisanne e i g école d’ingénieur de Genève

BATIC 3 S Project

Model Translation System model Logical model Visual model GUI generation GUI 3D GUI Widget repositories An engine will couple the behaviour from the model and the widgets of the chosen visual paradigm, and assemble them into a GUI prototype.

BATIC 3 S Project Prototype evaluation System model Logical model Visual model GUI generation GUI The prototype is tested and the model can be refined, End userSW Engineer Test ReportRefine

BATIC 3 S Project Prototype evaluation System model Logical model Visual model GUI generation The prototype is tested and the model can be refined, or a visual paradigm can be chosen. End userSW Engineer Test Report Refine GUI Test Choose