Optically Sensing Tongue Gestures for Computer Input T. Scott Saponas University of Washington Daniel Kelly University of Washington Babak A. Parviz University of Washington Desney S. Tan Microsoft Research

Computer Input for People with Brain and Spinal Cord Injuries Sip ‘n Puff Voice Brain-Computer Interface Eye Tracking Head Tracking

What about tongues?

Tongue Based Interfaces Peng and Budinger, Wireless 5 Button Pad Ghovanloo , et al. Tongue Drive NewAbilities, Tongue Keypad

Optically Sensing Tongue Gestures for Computer Input + = ?

Optically Sensing Tongue Gestures for Computer Input + + =?

Optically Sensing Tongue Gestures for Computer Input infrared proximity sensor

Optically Sensing Tongue Gestures for Computer Input

Gesture Recognition Right Front Left Back Sliding Average Filter Swipe Tap Hold

Tongue Tetris

Tongue Tetris Left Swipe Right Swipe Tap Hold

Tongue Tetris (Video)

Hardware Proximity Sensor Amplifier ADC Microcontroller Remote Computer

Proximity Sensors

Fabrication

Four Person Experiment Free Exploration Tetris Look at visualization Tune sensors Practice gestures 5 minutes 180 moves 56 pieces placed 10 lines cleared Stimulus Response Average accuracy 92%

What’s Next?

What’s Next?

Optically Sensing Tongue Gestures for Computer Input Thanks for Listening Optically Sensing Tongue Gestures for Computer Input T. Scott Saponas University of Washington Daniel Kelly University of Washington Babak A. Parviz University of Washington Desney S. Tan Microsoft Research