1. Optically Sensing Tongue Gestures for Computer Input
T. Scott Saponas University of Washington
Daniel Kelly University of Washington
Babak A. Parviz University of Washington
Desney S. Tan Microsoft Research

2. Computer Input for People with Brain and Spinal Cord Injuries
Sip ‘n Puff
Voice
Brain-Computer
Interface
Eye Tracking
Head Tracking

3. What about tongues?

4. Tongue Based Interfaces
Peng and Budinger,
Wireless 5 Button Pad
Ghovanloo , et al. Tongue Drive
NewAbilities, Tongue Keypad

5. Optically Sensing Tongue Gestures for Computer Input+
= ?

6. Optically Sensing Tongue Gestures for Computer Input+ + =?

7. Optically Sensing Tongue Gestures for Computer Input
infrared
proximity sensor

8. Optically Sensing Tongue Gestures for Computer Input

9. Gesture Recognition Right Front Left Back Sliding Average Filter Swipe
Tap
Hold

10. Tongue Tetris

11. Tongue Tetris
Left
Swipe
Right
Swipe
Tap
Hold

12. Tongue Tetris (Video)

13. Hardware Proximity Sensor Amplifier ADC Microcontroller
Remote Computer

14. Proximity Sensors

15. Fabrication

16. Four Person Experiment
Free Exploration
Tetris
Look at visualization
Tune sensors
Practice gestures
5 minutes
180 moves
56 pieces placed
10 lines cleared
Stimulus Response
Average accuracy 92%

17. What’s Next?

18. What’s Next?

19. Optically Sensing Tongue Gestures for Computer Input
Thanks for Listening
Optically Sensing Tongue Gestures for Computer Input
T. Scott Saponas University of Washington
Daniel Kelly University of Washington
Babak A. Parviz University of Washington
Desney S. Tan Microsoft Research