Cyclic input of characters through a single digital button without visual feedback Yang Xiaoqing New Interaction Techniques Dept. of Computer and Information Sciences University of Tampere

Introduction to the problem Introduction to the problem Spatial-temporal mapping & perceptive features Spatial-temporal mapping & perceptive features Control by the sonification of spatial patterns Control by the sonification of spatial patterns Mobile Mobile People with special needs People with special needs

Background and previous research Traditional seven-segment display element is used as a layout for symbol imaging. Commercial systems and equipments are on sale, but most are used for displaying numbers. Traditional seven-segment display element is used as a layout for symbol imaging. Commercial systems and equipments are on sale, but most are used for displaying numbers. If each of the segments is lighted accordingly to a single user action a temporal sequence can be useful for imaging in cyclic input techniques. If each of the segments is lighted accordingly to a single user action a temporal sequence can be useful for imaging in cyclic input techniques.

Objectives in general To study the features of user perception of spatial-temporal mapping through sonification of spatial patterns To study the features of user perception of spatial-temporal mapping through sonification of spatial patterns

Spatial Model Cyclic Synthesis Cyclic Synthesis

Sound Model Cyclic Synthesis Cyclic Synthesis Soun d Time soundgraph action soun d Soun d F 0 musical interval F max

Schedule Design the method & Preliminary tests Early March (2 weeks) Usability testing Mid March Data analysis Mid March (1 week) Project report /draft Early April Revising & Final paper Early April (3 days)

Research methods Research methods Conceptual modeling for spatial-temporal structures and relationships. Conceptual modeling for spatial-temporal structures and relationships. Constructive research to design and simulate the temporal components and relationships. Constructive research to design and simulate the temporal components and relationships. Usability evaluation of user activity under different time conditions and communication with computer without visual feedback. Usability evaluation of user activity under different time conditions and communication with computer without visual feedback. Empirical research of the rhythmic musical sequences coordinated to spatial seven- segment layout. Empirical research of the rhythmic musical sequences coordinated to spatial seven- segment layout.

Experimental setup Snapshot of the program during testing Snapshot of the program during testing

Experimental setup Snapshot of the program with opened frame of the tools

Preliminary results From previous investigation, t From previous investigation, the duration of the cycle in this case depends on the speed on which the user can act. Even if the user had experience s/he could not predict what next symbol will be presented. Therefore the first segment is the most difficult, at least, during the test. Even if the user had experience s/he could not predict what next symbol will be presented. Therefore the first segment is the most difficult, at least, during the test.

Forecasted results The new techniques for an evaluation of user behavior concerning temporal features of feedback cues. The new techniques for an evaluation of user behavior concerning temporal features of feedback cues. Dynamics for user performance evaluated through: Dynamics for user performance evaluated through: reaction time per spatial pattern /symbol; reaction time per spatial pattern /symbol; a number of errors a number of errors Sound parameters for sonification the array of spatial patterns Sound parameters for sonification the array of spatial patterns Conceptual model for a simple spatial-temporal structure Conceptual model for a simple spatial-temporal structure

Prospective scientific issues & possible applications The temporal space for human-computer interaction: The temporal space for human-computer interaction:  perception features of temporal events;  influence of modality onto the time perception Event modality & spatial-temporal mapping Event modality & spatial-temporal mapping Synthesis and visualization of temporal objects Synthesis and visualization of temporal objects

References Kirsh D.: Complementary Strategies: Why we use our hands when we think. In Proc. of the 17th Annual Conference of the Cognitive Science Society. Hillsdale, NJ, Lawrence Erlbaum (1995). Kirsh D.: Complementary Strategies: Why we use our hands when we think. In Proc. of the 17th Annual Conference of the Cognitive Science Society. Hillsdale, NJ, Lawrence Erlbaum (1995). Lauruska, V.: Computerized Control and Communication System for Handicapped. In: Klaus, J., Auff, E., Kremser, W., Zagler, W.L. (Eds.): Proc. 5th Int. Conference ICCHP’96, (Linz, Austria). Verlag R. Oldenburg, Wien Munchen (1996) Lauruska, V.: Computerized Control and Communication System for Handicapped. In: Klaus, J., Auff, E., Kremser, W., Zagler, W.L. (Eds.): Proc. 5th Int. Conference ICCHP’96, (Linz, Austria). Verlag R. Oldenburg, Wien Munchen (1996) Keytools TM Product information available at: Keytools TM Product information available at: Mind Controlled Switch, information available at: Mind Controlled Switch, information available at: Evreinov, G., Raisamo, R. Cyclic Input of Characters through a Single Button Manipulation In Proc. of the 8 th Int. Conf. on Computers Helping People with Special Needs. ICCHP 2002, Linz, Austria, July. J.Klaus, K.Miesenberger, W. L. Zagler (Eds.), LNCS Vol. 2398, Springer-Verlag Berlin Heidelberg, 2002, pp Evreinov, G., Raisamo, R. Cyclic Input of Characters through a Single Button Manipulation In Proc. of the 8 th Int. Conf. on Computers Helping People with Special Needs. ICCHP 2002, Linz, Austria, July. J.Klaus, K.Miesenberger, W. L. Zagler (Eds.), LNCS Vol. 2398, Springer-Verlag Berlin Heidelberg, 2002, pp Mizobuchi, S., Wanobe, E. How long is a “long” key press? In Proceedings of INTERACT’01, Michitake Hirose (Ed.), IOS Press, IFIP, 2001, pp Mizobuchi, S., Wanobe, E. How long is a “long” key press? In Proceedings of INTERACT’01, Michitake Hirose (Ed.), IOS Press, IFIP, 2001, pp Fabre, J., Howard, S. and Smith, R. Designing time at the user interface. Behaviour & Information Technology, 2000, Vol. 19(6), Fabre, J., Howard, S. and Smith, R. Designing time at the user interface. Behaviour & Information Technology, 2000, Vol. 19(6), Hanappe, P. Design and implementation of an integrated environment for music composition and synthesis. PhD Theses, 1999, available at: Hanappe, P. Design and implementation of an integrated environment for music composition and synthesis. PhD Theses, 1999, available at: