1. Haptics, Smell and Brain Interaction
The Frontiers of HCI

2. Learning Outcomes Describe how haptics are used on
Mobile devices
Medical devices
Research tools
Describe the exploration of
Olfactory detection and production
Brain wave detection

3. The Human Perceptual System
Physical Aspects of Perception
Touch (tactile/cutaneous)
Located in the skin, enables us to feel
Texture
Heat
Pain
Movement (kinesthetic/proprioceptive)
The location of your body and its appendages
The direction and speed of your movements

4. Physical Aspects of Perception
Movement (kinesthetic/proprioceptive)
We use the angles of our joints to determine the position of our limbs
We determine movement by the rate of change in the position of those joints

5. Mobile devices Phone output Vibrate – silent alert.
These can be used like earcons – different signals for different events
Does your phone have different alerts?
Can you tell the difference?

6. Mobile devices Phone input Touch screens
See previous lecture
Accelerometer - shaking actions
Inconsistent interactions, high error rates
Passive input
Gps
Altimeter
Temperature
Humidity

7. Using Haptics in Interaction Design
ImmersiveTouch™

8. Using Haptics in Interaction Design
Medical Uses
surgeon controls ‘robot’
Surgeon’s view zoomed
Small device reduces invasiveness
~~$2mill

9. Using Haptics in Interaction Design
The GuideCane (Ulrich and Borenstein, 2001)

10. Using Haptics in Interaction Design
The ActiveBelt (Tsukada and Yasumrua, 2004)
Device architecture of ActiveBelt
GPS, global positioning system; LED, light-emitting diode.

11. Using Haptics in Interaction Design
Motor Disabilities
HAL-5 (Hybrid Assistive Limb), CYBERDYNE Inc.

12. Force Feedback Displays
Manipulator Gloves
CyberGlove II
CyberGrasp
CyberForce

13. Technical Issues Concerning Haptics
Desktop Devices
SensAble PHANTOM haptic devices
PHANTOM Premium
McSig – our work with visually impaired

14. Technical Issues Concerning Haptics
Desktop Devices
Space Interface Device for Artificial Reality (SPIDAR) (Sato, 2002)
SPIDAR-8. Rubik’s Cube
SPIDAR-8. Finger attachments.
PHANTOM Premium 1.5 & 1.5 high-force haptic device

15. Olfactory - Odour/ Smell
Smell is essentially our ability to detect specific chemical particles in the air
We can detect about 4000 different smells
And the can be combined in millions different ways
Smell is very deep in our animal brain

16. Technology of Odour Input Output
Detecting particular chemicals is possible
Drug/ explosive sniffers
Detecting the range of smells in anything like human terms and extremely difficult task
Output
Manufacturing particular smells possible ‘fresh cookies’
Active generation of range of smells very difficult – too many chemicals and too supple differences

17. Smell – current research
Not sure how many different smells can be generated.
Check out the video
Yongsoon Choi, Rahul Parsani, Xavier Roman, Anshul Vikram Pandey, and Adrian David Cheok Sound perfume: building positive impression during face-to-face communication. In SIGGRAPH Asia 2012 Emerging Technologies (SA '12). ACM, New York, NY, USA, , Article 22 , 3 pages. DOI= /

18. Brain Computer Interact
Detecting the brain waves and interpreting
Inside the skull – accurate but invasive
From outside the skull – not very accurate

19. Summary Describe how haptics are used on Describe the exploration of
Mobile devices
Output – vibrate
Input accelerometers & gps
Medical devices
Keyhole surgery with remote tool guidance
Research tools
Haptic pen input and output devices – move in full 3D space
Describe the exploration of
Olfactory detection and production
Detection of specific chemicals possible
Production of a limited range of scents
Brain wave detection
Many new devices to gather brain activity from cap sensors,
still fairly limited interaction