The Holistic HMI Approach Evolution of the Human Machine Interface Jennifer Wahnschaff, Head of Instrumentation & Driver HMI, North America www.continental-corporation.com Interior Division

Holistic HMI Approach Influencing Factors + + + Distraction Efficient mobility User Experience & Trends Highly Automated Driving (HAD) Need for seamless communication Wasted time & Resources Car as moving “lounge” Change of drivers role + + How to design Confidence & Driving Experience + Take over Capability Mode awareness  Need for a holistic HMI approach Jennifer Wahnschaff © Continental Corporation, May 2014

Roadmap of HMI Evolution Holistic HMI Approach Roadmap of HMI Evolution Virtual co-pilot (car as companion) Workload balancing Safe integration of external devices Limited HMI personalization Adaptive information management Limited connectivity of services Cloud based personalization Potential information overflow Isolated Information Management & Isolated ADAS Smart Information Management & Partly Integrated ADAS Holistic Integration of Information & Assistance Systems Fully implemented multimodal approach Integration of Information & Assistance Systems Maneuver based automated driving Highly automated driving 2014 2016 2018 > 2020 Jennifer Wahnschaff © Continental Corporation, May 2014

Where is the driver looking at ? Conti system for driver monitoring Monitoring the Driver’s State Where is the driver looking at ? Conti system for driver monitoring Analysis of 3D-Head pose Centered micro camera position Infrared illumination Currently: ±30° lateral rotation In development: Extension to ±90° ≈ head position/-orientation + cabin geometrics Adaptation of Driver assistance systems and HMI features according to driver’s state Vehicle state Warning Intervention Hazard? Distraction? Innovative warning strategies Enhanced configuration of driver assistance systems Adaption of warning strategies Enhanced overall system acceptance HMI-Adaptation Driver state Environment Glance direction Jennifer Wahnschaff © Continental Corporation, May 2014

How will we interact with the vehicle in the year 2020? Holistic HMI Approach – Market Trends HMI 2020 for High-End Cars How will we interact with the vehicle in the year 2020? Output HMI: Multimodal approach HUD and Cluster complementing each other in an optimal way for priority 1 driver info, supplemented by selected warnings (sound, tactile feedback, ambient visual info) Large Secondary Display areas + speech for supporting driver info Input HMI: Multimodal approach & natural interaction Combination of touch + natural speech for complex interaction Selected mechanical controls & partly gesture for short one-step interaction Design Study - Generic ID Vision of future HMI Driver analyzer plays a key role for AR HUD, safety concepts (ADAS) and supports highly automated driving Jennifer Wahnschaff © Continental Corporation, May 2014

Example for HMI Solution Touch & Gesture Based Operation Touch based operation Capacitive touch screen laminated on display surface Touchpad solution Implementation of virtual edges to support intuitive HMI (without driver distraction) Free Air Gestures Flexible use of the HMI through the Driver for selected gestures and use cases Shift of HMI content from Secondary display to instrument cluster Automated driving mode Jennifer Wahnschaff © Continental Corporation, May 2014

Example for HMI Solution Augmented Reality Head-up Display (AR HUD) Use Case Examples Adaptive Cruise Control (ACC) Direct visualization of ADAS functionalities in the outer scenery Guidance Improvement of comprehensibility of navigation maneuvers Maneuver monitoring / indication Increase of trust in HAD  AR HUD increases driver awareness Jennifer Wahnschaff © Continental Corporation, May 2014

A Prerequisite for Automated Driving System Integration A Prerequisite for Automated Driving Closed Loop Driver & Car (HMI) Environment Vehicle Driver Car has best available backend information (Connectivity) Safety Technologies Jennifer Wahnschaff © Continental Corporation, May 2014

Link between driver & car must be closed Automated Driving Closed Loop between Driver & Car (HMI) Link between driver & car must be closed Car is aware of driver‘s state … Driver is aware of driving situation … Health Driver monitoring HALO Augmented Reality Jennifer Wahnschaff © Continental Corporation, May 2014

Result: A safe, effective and pleasurable driving experience. Holistic HMI Addresses All Aspects of the Human Machine Interface Increased safety with situation-specific warning using functional lighting Augmented reality content and “eyes on the road” with AR HUD Seamless connectivity for the driver with cloud and personal devices Interior Camera Reconfigurable panel for extended personalization Holistic HMI takes into account the environment, driver expectation, driver state and individual preferences. Result: A safe, effective and pleasurable driving experience. Multi-modal HMI approach Jennifer Wahnschaff © Continental Corporation, May 2014

Holistic HMI Addresses All Aspects of the Human Machine Interface Increased safety with situation-specific warning using functional lighting Augmented reality content and “eyes on the road” with AR HUD Seamless connectivity for the driver with cloud and personal devices Interior Camera Reconfigurable panel for extended personalization Multi-modal HMI approach Jennifer Wahnschaff © Continental Corporation, May 2014

The Interior Vision “Always On” is based on our strategy: HMI Competence Provide the expertise for superior comfort, ergonomics and ease-of-use. We inform you well Connectivity Connect the driver by wire or wireless and provide value-add services. We connect System integration Integration of components into a superior system. All at lower cost Jennifer Wahnschaff © Continental Corporation, May 2014

Holistic HMI Approach Summary & Conclusion Mobility behavior and user experience is changing New HMI solutions support the holistic HMI approach - Augmented Reality HUD - Interior Camera - Touch & Gesture based input devices Automated driving is an enabler for future driving experience Jennifer Wahnschaff © Continental Corporation, May 2014

Thank you for your attention. Jennifer Wahnschaff © Continental Corporation, May 2014