1. Exploring the semantics of caress results current work Timothy Chen, Dr. Sidney Fels, Thecla Schiphorst tichen@ece.ubc.ca ssfels@ece.ubc.ca schiphorst@techbc.ca 2 3 4 goal New Media Innovation Centre http://www.newmic.com University of British Columbia Electrical & Computer Engineering motivation To develop an interaction framework based on whole-hand interaction with surfaces To develop an interaction framework based on whole-hand interaction with surfaces Users find system intuitive to control Users find system intuitive to control Whole-hand interaction very suited for task Whole-hand interaction very suited for task Physical surface facilitates repeatable actions (spatial location) Physical surface facilitates repeatable actions (spatial location) Coarse obstruction representation not a big issue Coarse obstruction representation not a big issue contributions Demonstrates an application of whole-hand interaction with a surface Demonstrates an application of whole-hand interaction with a surface Touch-interactive system using multiple-point input Touch-interactive system using multiple-point input Investigation of semantics of gestural input Investigation of semantics of gestural input Interactive art piece in virtual reality setting Interactive art piece in virtual reality setting New interface for musical expression New interface for musical expression Linux driver for MTC Express Linux driver for MTC Express Interpolation of raw data (5) Interpolation of raw data (5) Curve fitting to delineate contact area on touchpad Curve fitting to delineate contact area on touchpad Finger motion tracking (moving obstacles) Finger motion tracking (moving obstacles) future work Study real-world tasks that involve whole-hand interaction Study real-world tasks that involve whole-hand interaction Develop useful application concepts Develop useful application concepts Provide a formalization of whole-hand input for interactive systems Provide a formalization of whole-hand input for interactive systems 5 mtc express Tactex Controls, Inc. Tactex Controls, Inc. Multiple-point sensing (72) Multiple-point sensing (72) Pressure-sensitive Pressure-sensitive Up to 200Hz sampling rate (compressed data) Up to 200Hz sampling rate (compressed data) Technical University of British Columbia Interactive Arts system Dynamic particle field Dynamic particle field Metaphor: hands in running stream Metaphor: hands in running stream Deployed in CAVE— cylindrical flow field envelops user (1) Deployed in CAVE— cylindrical flow field envelops user (1) Input from MTC Express (2) controls shape and size of obstructions (3) Input from MTC Express (2) controls shape and size of obstructions (3) Obstructions disrupt particle flow (4) Obstructions disrupt particle flow (4) Music feedback Music feedback The sense of touch, like sight and hearing, can convey a tremendous amount of information The sense of touch, like sight and hearing, can convey a tremendous amount of information There are many techniques to deliver and record audio and imagery, but not much for touch There are many techniques to deliver and record audio and imagery, but not much for touch 1 Human Communication Technologies Lab http://hct.ece.ubc.ca