The Frontiers of HCI Touch and Movement some from Chapter 14 Heim Odour and Brain various sources Touch and Movement Smell and Other Interaction Devices

The Human Perceptual System Physical Aspects of Perception – Touch (tactile/cutaneous) Located in the skin, enables us to feel – Texture – Heat – Pain – Movement (kinesthetic/proprioceptive) The location of your body and its appendages The direction and speed of your movements 1-2

Physical Aspects of Perception Movement (kinesthetic/proprioceptive) – We use the angles of our joints to determine the position of our limbs – We determine movement by the rate of change in the position of those joints 1-3

Mobile devices Phone output – Vibrate – silent alert. These can be used like earcons – different signals for different events Does your phone have different alerts? – Can you tell the difference? 1-4

Mobile devices Phone input – Touch screens Popular – lots of screen space but troublesome, high error rates – Accelerometer - shaking actions Inconsistent interactions, high error rates – Passive input Gps Altimeter 1-5

Touch screens One of the big interaction problems with touch screen phones is lack of haptic feedback Some haptic phones coming on market that use vibrate to give illusion of a button – But only work while finger moving. 1-6

Using Haptics in Interaction Design ImmersiveTouch™ 1-7

Using Haptics in Interaction Design Medical Uses – surgeon controls ‘robot’ – Surgeon’s view zoomed – Small device reduces invasiveness – ~~$2mill 1-8

Using Haptics in Interaction Design The GuideCane (Ulrich and Borenstein, 2001) 1-9

Using Haptics in Interaction Design The ActiveBelt (Tsukada and Yasumrua, 2004) 1-10 Device architecture of ActiveBelt GPS, global positioning system; LED, light-emitting diode.

Using Haptics in Interaction Design Motor Disabilities – HAL-5 (Hybrid Assistive Limb), CYBERDYNE Inc

Force Feedback Displays – Manipulator Gloves 1-12 CyberForce CyberGraspCyberGlove II

Technical Issues Concerning Haptics Desktop Devices – SensAble PHANTOM haptic devices 1-13 PHANTOM Premium McSig – our work with visually impaired

Technical Issues Concerning Haptics Desktop Devices – Space Interface Device for Artificial Reality (SPIDAR) (Sato, 2002) 1-14 SPIDAR-8. Finger attachments.SPIDAR-8. Rubik’s Cube PHANTOM Premium 1.5 & 1.5 high-force haptic device

Odour/ Smell Smell is essentially our ability to detect specific chemical particles in the air We can detect about 4000 different smells And the can be combined in millions different ways Smell is very deep in our animal brain 1-15

Technology of Odour Input – Detecting particular chemicals is possible Drug/ explosive sniffers – Detecting the range of smells in anything like human terms and extremely difficult task Output – Manufacturing particular smells possible ‘fresh cookies’ – Active generation of range of smells very difficult – too many chemicals and too supple differences 1-16

Brain Computer Interact Detecting the brain waves and interpreting Inside the skull – accurate but invasive From outside the skull – not very accurate 1-17