2. Cyclic input of characters through a single digital button without visual feedback Yang Xiaoqing xiaoqing.yang@uta.fi New Interaction Techniques Dept. of Computer and Information Sciences University of Tampere 25.02.2003

3. Introduction to the problem Introduction to the problem Spatial-temporal mapping & perceptive features Spatial-temporal mapping & perceptive features Control by the sonification of spatial patterns Control by the sonification of spatial patterns Mobile Mobile People with special needs People with special needs

4. Background and previous research Traditional seven-segment display element is used as a layout for symbol imaging. Commercial systems and equipments are on sale, but most are used for displaying numbers. Traditional seven-segment display element is used as a layout for symbol imaging. Commercial systems and equipments are on sale, but most are used for displaying numbers. If each of the segments is lighted accordingly to a single user action a temporal sequence can be useful for imaging in cyclic input techniques. If each of the segments is lighted accordingly to a single user action a temporal sequence can be useful for imaging in cyclic input techniques.

5. Objectives in general To study the features of user perception of spatial-temporal mapping through sonification of spatial patterns To study the features of user perception of spatial-temporal mapping through sonification of spatial patterns

6. Spatial Model Cyclic Synthesis Cyclic Synthesis

7. Sound Model Cyclic Synthesis Cyclic Synthesis Soun d Time soundgraph action soun d Soun d F 0 musical interval F max

8. Schedule Design the method & Preliminary tests Early March (2 weeks) Usability testing Mid March Data analysis Mid March (1 week) Project report /draft Early April Revising & Final paper Early April (3 days)

9. Research methods Research methods Conceptual modeling for spatial-temporal structures and relationships. Conceptual modeling for spatial-temporal structures and relationships. Constructive research to design and simulate the temporal components and relationships. Constructive research to design and simulate the temporal components and relationships. Usability evaluation of user activity under different time conditions and communication with computer without visual feedback. Usability evaluation of user activity under different time conditions and communication with computer without visual feedback. Empirical research of the rhythmic musical sequences coordinated to spatial seven- segment layout. Empirical research of the rhythmic musical sequences coordinated to spatial seven- segment layout.

10. Experimental setup Snapshot of the program during testing Snapshot of the program during testing

11. Experimental setup Snapshot of the program with opened frame of the tools

12. Preliminary results From previous investigation, t From previous investigation, the duration of the cycle in this case depends on the speed on which the user can act. Even if the user had experience s/he could not predict what next symbol will be presented. Therefore the first segment is the most difficult, at least, during the test. Even if the user had experience s/he could not predict what next symbol will be presented. Therefore the first segment is the most difficult, at least, during the test.

13. Forecasted results The new techniques for an evaluation of user behavior concerning temporal features of feedback cues. The new techniques for an evaluation of user behavior concerning temporal features of feedback cues. Dynamics for user performance evaluated through: Dynamics for user performance evaluated through: reaction time per spatial pattern /symbol; reaction time per spatial pattern /symbol; a number of errors a number of errors Sound parameters for sonification the array of spatial patterns Sound parameters for sonification the array of spatial patterns Conceptual model for a simple spatial-temporal structure Conceptual model for a simple spatial-temporal structure

14. Prospective scientific issues & possible applications The temporal space for human-computer interaction: The temporal space for human-computer interaction:  perception features of temporal events;  influence of modality onto the time perception Event modality & spatial-temporal mapping Event modality & spatial-temporal mapping Synthesis and visualization of temporal objects Synthesis and visualization of temporal objects

15. References Kirsh D.: Complementary Strategies: Why we use our hands when we think. In Proc. of the 17th Annual Conference of the Cognitive Science Society. Hillsdale, NJ, Lawrence Erlbaum (1995). Kirsh D.: Complementary Strategies: Why we use our hands when we think. In Proc. of the 17th Annual Conference of the Cognitive Science Society. Hillsdale, NJ, Lawrence Erlbaum (1995). Lauruska, V.: Computerized Control and Communication System for Handicapped. In: Klaus, J., Auff, E., Kremser, W., Zagler, W.L. (Eds.): Proc. 5th Int. Conference ICCHP’96, (Linz, Austria). Verlag R. Oldenburg, Wien Munchen (1996) 515-520 Lauruska, V.: Computerized Control and Communication System for Handicapped. In: Klaus, J., Auff, E., Kremser, W., Zagler, W.L. (Eds.): Proc. 5th Int. Conference ICCHP’96, (Linz, Austria). Verlag R. Oldenburg, Wien Munchen (1996) 515-520 Keytools TM Product information available at: http://www.keytools.com/input/ability.htm Keytools TM Product information available at: http://www.keytools.com/input/ability.htm http://www.keytools.com/input/ability.htm Mind Controlled Switch, information available at: http://www.mctos.com/htm/mctos.htm Mind Controlled Switch, information available at: http://www.mctos.com/htm/mctos.htmhttp://www.mctos.com/htm/mctos.htm Evreinov, G., Raisamo, R. Cyclic Input of Characters through a Single Button Manipulation In Proc. of the 8 th Int. Conf. on Computers Helping People with Special Needs. ICCHP 2002, Linz, Austria, 15-20 July. J.Klaus, K.Miesenberger, W. L. Zagler (Eds.), LNCS Vol. 2398, Springer-Verlag Berlin Heidelberg, 2002, pp. 259-266. Evreinov, G., Raisamo, R. Cyclic Input of Characters through a Single Button Manipulation In Proc. of the 8 th Int. Conf. on Computers Helping People with Special Needs. ICCHP 2002, Linz, Austria, 15-20 July. J.Klaus, K.Miesenberger, W. L. Zagler (Eds.), LNCS Vol. 2398, Springer-Verlag Berlin Heidelberg, 2002, pp. 259-266. Mizobuchi, S., Wanobe, E. How long is a “long” key press? In Proceedings of INTERACT’01, Michitake Hirose (Ed.), IOS Press, IFIP, 2001, pp.735-736. Mizobuchi, S., Wanobe, E. How long is a “long” key press? In Proceedings of INTERACT’01, Michitake Hirose (Ed.), IOS Press, IFIP, 2001, pp.735-736. Fabre, J., Howard, S. and Smith, R. Designing time at the user interface. Behaviour & Information Technology, 2000, Vol. 19(6), 451-463. Fabre, J., Howard, S. and Smith, R. Designing time at the user interface. Behaviour & Information Technology, 2000, Vol. 19(6), 451-463. Hanappe, P. Design and implementation of an integrated environment for music composition and synthesis. PhD Theses, 1999, available at: http://www.ircam.fr/equipes/repmus/Rapports/PeterHanappe99/ Hanappe, P. Design and implementation of an integrated environment for music composition and synthesis. PhD Theses, 1999, available at: http://www.ircam.fr/equipes/repmus/Rapports/PeterHanappe99/