2. New Interaction Techniques Department of Computer Sciences University of Tampere, Finland Grigori Evreinov www.cs.uta.fi/~grse Data Input through Friction and Vibration Data Input through Friction and Vibration September – December, 2003

3. TAUCHI MMIG G. Evreinov p 01_23 11.11.2003 data input through friction & vibration how many buttons do you need???? http://www.gkos.net/ Smartquill of British Telecom http://oud.refdag.nl/weet/981013weetfo07.html Fossil Wrist PDA with Palm OS http://www.fossil.com/ http://www.spbsoftwarehouse.com/products/fsk/

4. TAUCHI MMIG G. Evreinov p 02_23 11.11.2003 Body Coupled FingeRing: Wireless Wearable Keyboard [Fukumoto & Tonomura, CHI’97] data input through friction & vibration Samsung Scurry wearable keyboard http://www.futurelooks.com http://www.futurelooks.com

5. www.n-scribe.com/ TAUCHI MMIG G. Evreinov p 03_23 11.11.2003 ANOTO pen http://www.anoto.com http://www.anoto.com VPen TM http://www.otmtech.com/vpen3.asp XWpen http://www.research.microsoft.com/users/lyn/ http://www.research.microsoft.com/users/lyn/ SmartQuill http://www.neoambiental.com.br/html/terceir omilenio/html/texto_terc_tecnologia04.htm http://www.neoambiental.com.br/html/terceir omilenio/html/texto_terc_tecnologia04.htm data input through friction & vibration

6. TAUCHI MMIG G. Evreinov p 04_23 11.11.2003 ANOTO Pen the digital pen writes on ordinary paper printed with a special pattern that is almost invisible to the naked eye the dots have a nominal spacing of 0.3 mm (0.01 inch) a minute portion of the total pattern uniquely defines its position in the full pattern http://www.anotofunctionality.com/navigate.asp data input through friction & vibration

7. TAUCHI MMIG G. Evreinov p 05_23 11.11.2003 chessboard grating Optical Translation Measurement OTM™ OTM™ sensor measures the relative motion of surfaces placed adjacent to its aperture it includes a laser diode, detectors and optics integrated into a small transistor-style package the grating reflected beam serves as a local oscillator, which interferes with the reflected surface light for coherent homodyne detection by the detector relief profile of the chessboard grating http://www.otmtech.com/otm.asp http://www.otmtech.com/otm.asp data input through friction & vibration

8. TAUCHI MMIG G. Evreinov p 06_23 11.11.2003 InkLink TM binaural technology the InkLink™ Data Clip continuously listens for communications from the InkLink pen while it tracks the natural movement of the hand http://www.jdjstore.com/jdjstore/inhansys.html data input through friction & vibration

9. TAUCHI MMIG G. Evreinov p 07_23 11.11.2003 a pair of ear-microphones output signals were examined to detect the side of teeth-chattering, right or left [Hashimoto, Yonezawa and Itoh, 5 th Int. Conf. ICCHP’96] data input through friction & vibration

10. homogenous texture with definite angle of ribs TAUCHI MMIG G. Evreinov p 08_23 11.11.2003 II discrete textured input as a prototype of command mode for menu pointing task continuous variable textures with definite decrement of roughness data input through friction & vibration

11. TAUCHI MMIG G. Evreinov p 09_23 11.11.2003 potential of diverse effects depends on pressuring force and speed of relative motion between end effector and surface when the size of the end of the pen is commensurable to the ribs, increasing applied force will increase the magnitude of recorded roughness if vibratory signals take place during fingers manipulations along of texture they can be recorded through piezoelectric transducer data input through friction & vibration

12. TAUCHI MMIG G. Evreinov p 10_23 11.11.2003 diverse textures can produce different sound patterns by strengthening primary feedback during finger manipulation along of textured surfaces these signals and their combinations could be used to input commands or add new functions to keyboard, mouse, joystick or another controls texture recognition has various interesting applications which include both medical and more autonomous mobile robotics ScrollStrip http://www.synaptics.com/products/index.cfmhttp://www.synaptics.com/products/index.cfm data input through friction & vibration

13. 18 common materials were explored through a sensing “finger” with an piezoelectric microphone, covered by a rugged material a system for tactile texture detection achieved more than 93% of recognition Mayol-Cuevas et al, 1998 TAUCHI MMIG G. Evreinov p 11_23 11.11.2003 Mayol-Cuevas, W.W., Juárez-Guerrero, J. & Muñoz-Gutiérrez, S. The first approach to tactile texture recognition http://ganso5.fi-b.unam.mx/ligasdoc/TCTSMC98.PS.gz data input through friction & vibration

14. x.wav input device and the experimental setup TAUCHI MMIG G. Evreinov p 12_23 11.11.2003 data input through friction & vibration

15. TAUCHI MMIG G. Evreinov p 13_23 11.11.2003 data input through friction & vibration spectrums of vibration patterns during a linear motion across four textures

16. TAUCHI MMIG G. Evreinov p 14_23 11.11.2003 Unistroke and Graffiti alphabet characters were used to simulate gestures with definite structure (uninterrupted hand motion) data input through friction & vibration the goal of our experiment was to evaluate spatial-temporary segmentation of vibration patterns formed by handwriting segmented textured layout (modulator) and miniature microphone (M294) performed spatial-temporal coding of pen position

17. TAUCHI MMIG G. Evreinov p 15_23 11.11.2003 data input through friction & vibration A B C D E F G H I J K L M Unistroke adapted combined continuous N O P Q R S T U V W X Y Z Unistroke adapted combined continuous

18. vibratory patterns of the adapted unistrokes and combined continuous gestures (B, G, W) TAUCHI MMIG G. Evreinov p 16_23 11.11.2003 data input through friction & vibration......

19. TAUCHI MMIG G. Evreinov p 17_23 11.11.2003 the proposed method has a potential for development new interaction techniques for wearable computers 52 sound patterns during input of continuous gestures coding the characters of English alphabet were registered and had a recognizable structure diverse textures were assembled and explored to shape vibration patterns when pen rubs over textured layout spectral averaging over the frequency range was found to be effective tools for segmentation of vibration patterns received on the textured layout data input through friction & vibration

20. h.wav SoundPen TAUCHI MMIG G. Evreinov p 18_23 11.11.2003 data input through friction & vibration

21. assume, Freq. N = 400 Hz, then at average speed of the pen motion V f = 25 mm/s d = V f / Freq. N, i.e., d = 0.06 mm if  = 65  then d V = d N / cos  d V = 0.14 mm d H = d N / sin  d H = 0.066 mm correspondingly Freq. V  180 Hz Freq. H  380 Hz thus, if we shall provide texture with given polarization, vibratory patterns will have recognizable structure d  Freq. V Freq. H Freq. N TAUCHI MMIG G. Evreinov p 19_23 11.11.2003 data input through friction & vibration

22. vibratory patterns of the characters TAUCHI MMIG G. Evreinov p 20_23 11.11.2003 a.wav d.wav h.wav b.wav o.wav f.wav data input through friction & vibration

23. TAUCHI MMIG G. Evreinov p 21_23 11.11.2003 western script has several handwriting styles for elementary school-aged children loops and other groups can provide systematic steps for letter analysis and are often used for learning of the recognition system for designing of diverse gestures, we have selected seven segments, which are most often used in handwriting sheets for learning to write characters in cursive data input through friction & vibration

24. vibratory patterns of handwriting elements for cursive performance TAUCHI MMIG G. Evreinov p 22_23 11.11.2003 _.wav data input through friction & vibration

25. TAUCHI MMIG G. Evreinov p 23_23 11.11.2003 this method was not intended for text entry, but has a potential for human-computer interaction through special gestures along textured surface while the size of the end of the pen was commensurable to the ribs, sound patterns during input of handwriting characters were registered and had recognizable structure the ribbed polarized textures similar to the diffraction grid were proposed and explored to shape sound patterns when pen rubs over these surfaces the vertical and horizontal components of the vibration frequency had difference in two times data input through friction & vibration

26. TAUCHI MMIG G. Evreinov p 00_00 11.11.2003 data input through friction & vibration