Presentation is loading. Please wait.

Presentation is loading. Please wait.

How many senses do we have? An introduction to multimodality

Published byBarnard Scott Modified over 8 years ago

Similar presentations

Presentation on theme: "How many senses do we have? An introduction to multimodality"— Presentation transcript:

1 How many senses do we have? An introduction to multimodality
Alistair D N Edwards Department of Computer Science

2 How many senses do we have?

3 Five

4 ‘Extra’ senses 1 Pain 2 Balance 3 Time 4 Temperature 5 Digestion
1 Pain 2 Balance 3 Time 4 Temperature 5 Digestion

5 Previous answers 18 Pressure 19 Empathy 20 Fear 21 Tiredness 22 Thirst
1 Sight 2 Smell 3 Taste 4 Hearing 5 Touch 6 Balance 7 Direction 8 Humour 9 Body position 10 Heat 11 Danger 12 Circadian Rhythms 13 Hunger 14 Bodily needs 15 Time 16 Pain 17 Fatigue 18 Pressure 19 Empathy 20 Fear 21 Tiredness 22 Thirst 23 Satiation

6 What is a sense?

7 What modes do we use in interaction? Which others could we use?
Objectives What modes do we use in interaction? Which others could we use? Why? How?

8 Some practical(?) possibilities
Sounds Haptics Smell

9 Sounds Speech Non-speech synthesized earcons auditory icons
sonification data mapping audification programs

10 Sounds Why do we not make more use of sounds in interfaces?

11 Haptics - definitions Term Definition Proprioceptive Relating to sensory information about the state of the body (including cutaneous, kinesthetic, and vestibular sensations). Haptic Relating to the sense of touch. Vestibular Pertaining to the perception of head position, acceleration, and deceleration Kinesthetic Meaning the feeling of motion. Relating to sensations originating in muscles, tendons and joints Cutaneous Pertaining to the skin itself or the skin as a sense organ. Includes sensation of pressure, temperature, and pain. Tactile Pertaining to the cutaneous sense but more specifically the sensation of pressure rather than temperature or pain. Force Feedback Relating to the mechanical production of information sensed by the human kinesthetic system.

12 Sensable Phantom Omni

13 Tactile images

14 Tactile images

15 Features of tactile images
Easy to produce Hard to design Inexpensive Static Mixed tactile/visual suitable for partially sighted people Relatively

16 Combining senses? Tactile Auditory speech non-speech Rotation Haptic?

17 Trisenx Scent Dome

18 DigiScents iSmell

19 Digiscents …folded in April 2001

20 smells Why do we not make more use of smells in interfaces?

21 Conclusions Why do we not make more use of other senses/channels/modes in interaction? Which ones could we practically use more? What would be the benefits?

Download ppt "How many senses do we have? An introduction to multimodality"

Similar presentations

My Five Senses Created by:.

My Five Senses Created by:.
Feedback A response resulting from some form of input as in a reflex reaction that results from a stimulus The source of our interaction with the physical.

Feedback A response resulting from some form of input as in a reflex reaction that results from a stimulus The source of our interaction with the physical.
Principles of Health Science 2012. Peripheral nervous system is made of all of the nerves. PNS consists of cranial nerves and spinal nerves.

Principles of Health Science Peripheral nervous system is made of all of the nerves. PNS consists of cranial nerves and spinal nerves.
Rebecca Dalton Rayvant Kohli Jenna Raithel Megan Saracino Irsham Zaman.

Rebecca Dalton Rayvant Kohli Jenna Raithel Megan Saracino Irsham Zaman.
The Brain Notes.

The Brain Notes.
Sponge: Set up Cornell Notes on pg. 41 Topic: 12.1 General and Special Senses Essential Question: 2.1 Atoms, Ions, and Molecules 12.1 General and Special.

Sponge: Set up Cornell Notes on pg. 41 Topic: 12.1 General and Special Senses Essential Question: 2.1 Atoms, Ions, and Molecules 12.1 General and Special.
Copyright © 2006 Pearson Education, Inc., publishing as Benjamin Cummings The Senses  Somatic senses throughout body, including internal organs  Touch,

Copyright © 2006 Pearson Education, Inc., publishing as Benjamin Cummings The Senses  Somatic senses throughout body, including internal organs  Touch,
Multimodality Alistair D N Edwards Department of Computer Science

Multimodality Alistair D N Edwards Department of Computer Science
Teleoperation Interfaces. Introduction Interface between the operator and teleoperator! Teleoperation interface is like any other HMI H(mobile)RI = TI.

Teleoperation Interfaces. Introduction Interface between the operator and teleoperator! Teleoperation interface is like any other HMI H(mobile)RI = TI.
SENSATION AND PERCEPTION. DEFINITIONS  Sensation: the process in which our sensory receptors and nervous system receive and represent stimulus energies.

SENSATION AND PERCEPTION. DEFINITIONS  Sensation: the process in which our sensory receptors and nervous system receive and represent stimulus energies.
Sensory Integration Dysfunction By Ricca Klein. Sensory Integration Normal Sensory Integration –Neurological process of organizing info from body and.

Sensory Integration Dysfunction By Ricca Klein. Sensory Integration Normal Sensory Integration –Neurological process of organizing info from body and.
Sensory Processing and the Preschool Child

Sensory Processing and the Preschool Child
How do we choose a skill to perform? What decisions do we need to make about performing a skill? Need to decide when to perform the skill Need to decide.

How do we choose a skill to perform? What decisions do we need to make about performing a skill? Need to decide when to perform the skill Need to decide.
 Can you explain an example of touch or skin related disorder?  Can you notice the differences between vestibular, kinesthetic and cutaneous sense?

 Can you explain an example of touch or skin related disorder?  Can you notice the differences between vestibular, kinesthetic and cutaneous sense?
Class Notes for the Nervous System - Section 1. Two Systems Within a System Peripheral Nervous System: PNS All the parts of the nervous system, except.

Class Notes for the Nervous System - Section 1. Two Systems Within a System Peripheral Nervous System: PNS All the parts of the nervous system, except.
Somatic and Special Senses

Somatic and Special Senses
 System located in the inner ear that allows us to make adjustments to bodily movements and postures.  Disorders of this sense can cause extreme dizziness.

 System located in the inner ear that allows us to make adjustments to bodily movements and postures.  Disorders of this sense can cause extreme dizziness.
Touch TOUCH Position, Movement, and the Skin Senses.

Touch TOUCH Position, Movement, and the Skin Senses.
Sensation: The conscious or subconscious awareness of external or internal stimuli. Perception: The conscious awareness and the interpretation of meaning.

Sensation: The conscious or subconscious awareness of external or internal stimuli. Perception: The conscious awareness and the interpretation of meaning.
Special and General Senses. Senses General Senses Temperature Pain Touch pressure Vibration proprioception Special Senses Smell Taste Balance Hearing.

Special and General Senses. Senses General Senses Temperature Pain Touch pressure Vibration proprioception Special Senses Smell Taste Balance Hearing.

Similar presentations

Ads by Google