1. New Interaction Techniques Department of Computer Sciences University of Tampere, Finland September – December, 2003 Grigori Evreinov www.cs.uta.fi/~grse/ Text Entry

2. “ Alphabet - an ordered set of sound signs - named after first two letters in the Greek: alpha-beta [alef-bet] a set of graphem-phoneme correspondences which allow a graphic shape to serve as a sound sign or phonogram in an ideal alphabet there is one and only one letter or symbol for each important sound in the language ” thus, alphabet wasn’t intended to write fast as possible, but it should provide the high degree of reading comprehension of the message semantics “ Unifon means one sound and indicates one sound per symbol in many writing systems there is only one sound per symbol in English there are over 14 sounds per symbol the English writing system has 106 symbols for 40 or so sounds the problem is that the same symbol can refer to more than one sound ” http://66.41.60.21/Why 20English is Absurd.htm TAUCHI MMIG G. Evreinov 01_21 21.11.2003 Text Entry

3. a typing speed with conventional QWERTY keyboard is about 200-300- 500 characters per minute or ~40-60-150 wpm this technique requires two healthy hands and 27 reliable keys mobile devices like phones, remote control or PDA operate with a smaller number of physical keys most often 12 and use special combinatorial methods for text entry this is primarily one-hand technique and requires 1-12 keys a single-switch user can type with a rate around 3-22 char/m (1-4.5 wpm) too few keys slows typing by requiring multiple keystrokes to make some characters and too many keys slows typing by making it harder to coordinate hands, to remember non-periodical long layout to find a specific key visual feedback decreases cognitive loading but sometimes visual feedback is impossible TAUCHI MMIG G. Evreinov 02_21 21.11.2003 Text Entry

4. TAUCHI MMIG G. Evreinov 03_21 21.11.2003 the relation between the minimum necessary Keystroke Saving Rate (KSR, %), typing speed (characters per second /char/s) and selection time (t, in s) that is, which KSR will be necessary to increase text entry speed for given typing speed k and time t used for making the selection process adapted from [14] Zagler, W.I. Matching Typing Persons and Intelligent Interfaces. Text Entry t, s 5.0 2.0 1.0 0.5 0.2 0.1 0.1 0.2 0.5 1.0 2.0 5.0 10.0 k, char/s 1% 4% 20% 50% 80% 96% 6.0 12 30 60 120 300 600 k, char/m 1.2 2.4 6.0 12 24 60 120 k, wpm

5. TAUCHI MMIG G. Evreinov 04_21 21.11.2003 Text Entry ~30 40-50 <60 18-25 <25 _?_ 30-37 <50 ~9? _?_ _?_ 40-150 wpm Key typing

6. TAUCHI MMIG G. Evreinov 05_21 21.11.2003 Text Entry http://deafandblind.com/phone5.htm MessagEase LetterWise Prefix-based disambiguation QWERTY Twiddler 1.293 by 9+1(1.2) method 1.248 by 10+1(1.2) method Key typing

7. TAUCHI MMIG G. Evreinov 06_21 21.11.2003 Text Entry Key typing requires that the user have - to imagine the word (cognitive model) - to divide the word into a sequence of characters according key- typing convention and alphabet knowledge - to locate the keys on keyboard sequentially or simultaneously (two- hand typing) according layout knowledge and fingers motion experience, - to press the key(s) - to compare the result to cognitive model of the word based on secondary feedback, visual or speech signals if segmentation process is disturbed due to distraction or have been changed, this process will require an additional time if layout is changed (has several layers, due to special entry technique), this process will require an additional time, to switch the layers and to perceive special signals which content information about number of active layer and permission to continue text entry

8. TAUCHI MMIG G. Evreinov 07_21 21.11.2003 Text Entry how to increase Key typing speed? - word entering – select the word from the list (topic or category, http://www.enkidu.net/ ) or/and using linguistic analysis, prediction, auto-completion http://www.enkidu.net/ - decreasing number of characters per word – abbreviation (SMS, FASTY, short-hand) & abbreviation expansion [19, 20] - to construct sentences and phrases based on special symbols and symbol-to-text transformation rules - to change alphabet’s length – alphabet compression or extension - decreasing key layout (8-12 keys) – characters’ construction (SymbolCreator), chords, sequential function selection - to substitute physical keys by software keyboard and add gestures [20] - a substitution of secondary feedback signals by simplified primary ones, to augment clarity for pointing key positions through special unified matrixes and/or finger technique - to increase number of characters per one stroke: tap-stroke technique

9. TAUCHI MMIG G. Evreinov 08_21 21.11.2003 Text Entry Stylus entry data varies and depends on the source (prognosis, expert-user etc.)

10. TAUCHI MMIG G. Evreinov 09_21 21.11.2003 Text Entry http://www.unifon.org/trouble-with-spelling1.html http://victorian.fortunecity.com/vangogh/555/Spell/uu-18ways.html /u:/ the sound in moon and guru how many ways does the traditional orthography spell the vowel sound in rule? in traditional English orthography the same sound can be spelled by 14 different ways Note that the first 4 spelling patterns account for about 75% of the dictionary spellings

11. TAUCHI MMIG G. Evreinov 10_21 21.11.2003 Text Entry from Anguish Languish *, homonyms, & phonetic charades … to Alphabet Compression * http://wordways.com/anguish.htmhttp://wordways.com/anguish.htm Here is a little fairy story told in other words... Heresy ladle furry starry toiling udder warts... Yule fined fore hansom stories, Gneiss lorn, flours, likened waul; Weave gaits, muse, mote, stares, bawl rheum, Hie sealing inn the Haul. most examples of Anguish Languish rewrite standard texts using homonyms You'll find four handsome stories, Nice lawn, flowers, lichened wall; We've gates, mews, moat, stairs, ballroom, High ceiling in the Hall.

12. phonetically similar consonants and possible substitutions a b c d e f g h i j k l m n o p q r s t u v w x y z TAUCHI MMIG G. Evreinov 11_21 21.11.2003 Text Entry Alphabet compression phonetically similar consonants and possible substitutions a b c d e f g h i j k l m n o p q r s t u v w x y z p s / k t v j ch q z w ks i s / g English letter frequencies * a b c d e f g h i j k l m n o p q r s t u v w x y z 73 9 30 44 130 28 16 35 74 2 3 35 25 78 74 27 3 77 63 93 27 13 16 5 19 1 * http://library.thinkquest.org/28005/flashed/thelab/cryptograms/frequency.shtml http://library.thinkquest.org/28005/flashed/thelab/cryptograms/frequency.shtml a b c d e f g h i j k l m n o p q r s t u v w x y z a p s / k t e f g h i g k l m n o p k r s t u f u ks i s / g ch => h a e f g h i k l m n o p r s t u

13. TAUCHI MMIG G. Evreinov 12_21 21.11.2003 Text Entry Alphabet compression konferense signifikant artikle komputer interaktion proseetings approah komparison softuare applikation operation theori moteling efaluation usapiliti performanse measure parameter sekuense presentation sooming kuestion tiskussion mofement tisaplet (3) trasking tefise (device) feetpak (3) keipoart (2) eksperienset stimulus analisis resising hierarhi pattern frekuensi apiliti partisipant kustomisation konfentional prosessor hannel strukture ualititi alternatife pointer generator importanse sentense kommunikator fintous windows eksplorer graphiks simpoliks harakter feature integratet intifitual tefelopment training kalipration tunamikal elektrote tehnikue taktile autitori monitor position uelositi rantomiset goistisk regektion atgustment kognitife strategi statistiks portaple proseture koortinatet sirkular maksimiset empirikal infestigation lineariti template personal rekognition tefise (device) fintous windows trauing drawing

14. TAUCHI MMIG G. Evreinov 13_21 21.11.2003 Text Entry Usability testing for txtEntry_16keys

15. Clear Data TAUCHI MMIG G. Evreinov p 14_23 23.09.2003 TWords16.txt /phrases GridData1: test words/chars entered text /chars time per char, ms GridData2: char per word /phrase num. of entered words num. of strokes /clicks per word /phrase time per word/phrase, s lblTestSymbol txtText1 On-screen Keyboard (16) Break test Test initialization Ctrl+K=>move keys SetSigns SetCharacters BackSp Statistics() Rtime, ms s (st.dev), ms Errors wpm TestTime, s lblSave_Click() GridData2_Click() to save column GridData1_Click() to save column txtPersonData comments… fraData WordsLoading SetTest lblOpen_Click() SetData Trial start Timer1 Timer2 Text Entry Wait SaveTools txtEntry_16keys

16. TAUCHI MMIG G. Evreinov p 15_23 23.09.2003 Text <> “” define the Length of the Text return into the TextBox play wave “Empty” the last Char = Linefeed remove two last chars in the TextBox put cursor at the end of the text play wave “Back Space” remove the last char in the TextBox put cursor at the end of the text play wave “Back Space” Yes No Yes No Exit Private Sub BackSp() Text Entry the last Char = space No Yes previous Char = “.”, “,” or “?” No Yes

17. touch screen or similar input TAUCHI MMIG G. Evreinov 16_21 21.11.2003 Text Entry Tap-stroke: two characters per one stroke the first selection the second selection stylus or finger vowels 32% + space 18% ~ 50% D Ä U A Ö I _ E O

18. TAUCHI MMIG G. Evreinov 17_21 21.11.2003 Text Entry Tap-stroke: two characters per one stroke

19. TAUCHI MMIG G. Evreinov 18_21 21.11.2003 Text Entry Tap-stroke: two characters per one stroke Private Sub Spot1_MouseDown() Private Sub Form_Activate() Private Sub Form_KeyDown() Private Sub Form_Load() Private Sub ResetSpots() Private Sub SetData() bStroke (bChar) StrokeUp2 'outside of the spot, bChar2 StrokeUp3 'outside of the BigSpot, bChar2 ResetSpots StrokeUp1 'within a BigSpot, bChar2 Private Sub SpotActivate() bChar1 = bStroke bStroke = bStroke & bChar2 Private Sub Spot1_MouseUp() Timer1 tmrDelay Private Sub SetTest()

20. TAUCHI MMIG G. Evreinov p 19_21 21.11.2003 References [1] Letters & Words Frequencies, http://deafandblind.com/word_frequency.htmhttp://deafandblind.com/word_frequency.htm [2] Frequency of Occurrence of Letters in English, http://www.santacruzpl.org/readyref/files/g- l/ltfrqeng.shtml (from Fletcher Pratt, Secret and Urgent: the Story of Codes and Ciphers Blue Ribbon Books, 1939, p. 252. )http://www.santacruzpl.org/readyref/files/g- l/ltfrqeng.shtml [3] Letter Frequency Analysis, http://library.thinkquest.org/28005/flashed/thelab/cryptograms/frequency.shtml http://library.thinkquest.org/28005/flashed/thelab/cryptograms/frequency.shtml [4] http://www.sta.cuhk.edu.hk/courses/STA0301/l-freq.pdfhttp://www.sta.cuhk.edu.hk/courses/STA0301/l-freq.pdf [5] http://www.math.unl.edu/~jorr/gilbhatch/letter_frequency_applet.htmlhttp://www.math.unl.edu/~jorr/gilbhatch/letter_frequency_applet.html [6] Letter Frequencies, http://rinkworks.com/words/letterfreq.shtmlhttp://rinkworks.com/words/letterfreq.shtml [7] Relative Frequencies of Letters in General English Plain text, http://www.central.edu/homepages/LintonT/classes/spring01/cryptography/letterfreq.html http://www.central.edu/homepages/LintonT/classes/spring01/cryptography/letterfreq.html [8] Letter and Word Frequency Analysis, http://paul.oniony.com/sections/information/frequencyanalysis.htmlhttp://paul.oniony.com/sections/information/frequencyanalysis.html the next refs are available at: http://www.yorku.ca/mack/http://www.yorku.ca/mack/ [9] Soukoreff, R. W. & MacKenzie, I. S. (1995). Theoretical upper and lower bounds on typing speed using a stylus and soft keyboard. Behaviour & Information Technology, 14, 370-379. [10] MacKenzie, I. S. (2002). KSPC (keystrokes per character) as a characteristic of text entry techniques. Proc. of the Fourth Int. Symposium on Human Computer Interaction with Mobile Devices, pp. 195-210. Heidelberg, Germany: Springer-Verlag. Text Entry

21. TAUCHI MMIG G. Evreinov p 20_21 21.11.2003 [11] Silfverberg, M., MacKenzie, I. S., & Korhonen, P. (2000). Predicting text entry speed on mobile phones. Proc. of the ACM Conf. on Human Factors in Comput. Systems - CHI 2000, pp. 9-16. New York: ACM. [12] MacKenzie, I. S., & Soukoreff, R. W. (2002). Text entry for mobile computing: Models and methods, theory and practice. Human-Computer Interaction, 17, 147-198. [13] MacKenzie, I. S., Kober, H., Smith, D., Jones, T., Skepner, E. (2001). LetterWise: Prefix-based disambiguation for mobile text input. Proceedings of the ACM Symposium on User Interface Software and Technology - UIST 2001, pp. 111-120. New York: ACM. [14] MacKenzie, I. S., Zhang, S. X., & Soukoreff, R. W. (1999). Text entry using soft keyboards. Behaviour & Information Technology, 18, 235-244. [15] Zagler, W.L. (2002), Matching Typing Persons and Intelligent Interfaces. In J.Klaus, K.Miesenberger, W. L. Zagler (Eds.), Proc. of the 8 th Int. Conf. on Computers Helping People with Special Needs. ICCHP 2002 Linz, Austria, LNCS Vol. 2398, Springer-Verlag Berlin Heidelberg, pp. 241-242. [16] Shieber, S.M., Baker, E. Abbreviated Text Input. IUI’03, January 12–15, 2003, Miami, Florida, USA. ACM. http://www.eecs.harvard.edu/~shieber/Biblio/Papers/abbrev-iui-poster.pdfhttp://www.eecs.harvard.edu/~shieber/Biblio/Papers/abbrev-iui-poster.pdf [17] Magnuson, T., Hunnicutt, S. Grammatical support for sentence and phrase construction for symbol users. AAATE2003. SentencePhraseConstruction_198-final.pdf (References) [18] Toshiyuki Masui. An Efficient Text Input Method for Pen-based Computers. Proc. of the ACM Conference on Human Factors in Computing Systems (CHI’98) (April 1998), ACM press, pp. 328–335. Text Entry

22. TAUCHI MMIG G. Evreinov p 21_21 21.11.2003 [19] Zagler, W.L., Beck, C., Seisenbacher, G. FASTY – Faster and easier text generation for disabled people. AAATE2003, FASTY_221-final.pdf (References) [20] Zhai, Sh., Kristensson, Per-Ola. Shorthand Writing on Stylus Keyboard. http://www.almaden.ibm.com/u/zhai/papers/SharkFinal.pdf http://www.almaden.ibm.com/u/zhai/papers/SharkFinal.pdf [21] Geissler, J. Gedrics: the next generation of icons. Proceedings of the 5th International Conference on Human–Computer Interaction (INTERACT’95), Lillehammer, Norway, June 27–29, 1995, pp. 73–78. [22] K. Perlin. Quikwriting: Continuous stylus-based text entry. In Proc. of UIST '98. ACM, November 1998. http://citeseer.nj.nec.com/perlin98quikwriting.html http://citeseer.nj.nec.com/perlin98quikwriting.html [23] D.Venolia and F.Neiburg. T-cube: A fast, self-disclosing pen-based alphabet. In Proc. of CHI ’94, pages 265–270. SIGCHI, ACM, 1994. [26] Aoki, P. M., Hurst, A. and Woodruff, A. (2001). Tap Tips: Lightweight Discovery of Touchscreen Targets. CHI 2001, Seattle. Text Entry