1. Special Access Technology Chapter 7 On-screen Keyboards Kristen Eklund & Jolene Hyppa Martin

2. Introduction Later chapters focus on individual areas of on-screen keyboard use Later chapters focus on individual areas of on-screen keyboard use Our chapter introduces many terms relating to this topic Our chapter introduces many terms relating to this topic Uses terms standardized by the Common Terminology for Switch Controlled Software (ACE Centre, 1990) Uses terms standardized by the Common Terminology for Switch Controlled Software (ACE Centre, 1990) These terms are shown initially in yellow These terms are shown initially in yellow

3. Introduction On-screen keyboards On-screen keyboards Any keyboard displayed on a computer screen Any keyboard displayed on a computer screen Accessed using pointing devices or switches Accessed using pointing devices or switches Not just the “qwerty” keyboard Not just the “qwerty” keyboard Floating palettes for drawing programs Floating palettes for drawing programs Shortcut menus Shortcut menus Toolbars Toolbars Pull-down menus Pull-down menus Clip art menus Clip art menus Specialized pop-up menus Specialized pop-up menus “qwerty” keyboard displayed on the screen “qwerty” keyboard displayed on the screen And much, much more! And much, much more!

4. Introduction The items presented for selection by an on-screen keyboard are called a selection set The items presented for selection by an on-screen keyboard are called a selection set Items are also referred to as: Items are also referred to as: Cell Cell Key Key Button Button Selection set is also referred to as: Selection set is also referred to as: Grid Grid Setup Setup Window Window Layout Layout When a scanning program is used, a highlighter indicates which item is currently available for selection When a scanning program is used, a highlighter indicates which item is currently available for selection

5. Selection sets Items Highlighting Prompts

6. Introduction Items in selection sets may be text or graphics or both Items in selection sets may be text or graphics or both Items can be selected by: Items can be selected by: Point and click Point and click Dwell Dwell Scanning and switch use Scanning and switch use Goal is to enable user to use standard programs such as: Goal is to enable user to use standard programs such as: Word processor Word processor Database Database Spreadsheet Spreadsheet Drawing programs Drawing programs Games Games Email Email Web browser Web browser

7. Who might use an on-screen keyboard? Early writers Early writers People who have difficulty using a keyboard People who have difficulty using a keyboard Limited ROM Limited ROM Poor fine and/or gross motor control, but able to use head pointing device (CP) Poor fine and/or gross motor control, but able to use head pointing device (CP) Good head control, but poor limb control (SCI) Good head control, but poor limb control (SCI) Combination of physical and other problems Combination of physical and other problems Impairments resulting in ability to use only one or two switches Impairments resulting in ability to use only one or two switches Individuals with specific reading or writing difficulty Individuals with specific reading or writing difficulty Helped by visual and/or spoken prompts Helped by visual and/or spoken prompts Word prediction Word prediction

8. Selection Set Design & Layout Arranging the items in the selection set is an important consideration Arranging the items in the selection set is an important consideration Goal is to choose the best arrangement for client Goal is to choose the best arrangement for client Most programs offer many selection set options Most programs offer many selection set options Many of those that don’t can be changed by using selection set editor program Many of those that don’t can be changed by using selection set editor program

9. Selection Set Design & Layout Some options include: Some options include: QWERTY keyboard layout QWERTY keyboard layout Suitable for those familiar with this layout Suitable for those familiar with this layout Good for those who need access to all the keys on a standard keyboard Good for those who need access to all the keys on a standard keyboard Confusing for young users & beginners Confusing for young users & beginners Unlike actual keyboard, little or no speed advantage of this layout in an onscreen format Unlike actual keyboard, little or no speed advantage of this layout in an onscreen format Alphabetic layout Alphabetic layout Better for young users and beginners Better for young users and beginners Always faster than “qwerty” for those familiar with alphabet, but not “qwerty” Always faster than “qwerty” for those familiar with alphabet, but not “qwerty” Frequency of use layout Frequency of use layout Easier & faster Easier & faster Good for those with learning difficulties Good for those with learning difficulties

10. Selection Set Design & Layout Word selection sets Word selection sets Phrase selection sets Phrase selection sets Graphics Graphics Pictures Pictures Symbols Symbols All of these options may include synthetic or digitized speech prompts or other visual/auditory prompts to assist with selection All of these options may include synthetic or digitized speech prompts or other visual/auditory prompts to assist with selection

11. Selection Set Appearance Things to consider: Things to consider: Size Size Larger items may be necessary, but that decreases total item options Larger items may be necessary, but that decreases total item options Item spacing Item spacing Items placed further apart may be selected with better accuracy Items placed further apart may be selected with better accuracy Shape Shape Items arranged in a single line Items arranged in a single line Items arranged in a grid Items arranged in a grid Items arranged in a flip chart Items arranged in a flip chart Items arranged in a custom design Items arranged in a custom design

12. Selection Set Appearance Frame Style Frame Style Square Square Round Round Button Button Changing frame can be helpful to differentiate type or function of items Changing frame can be helpful to differentiate type or function of items Color Color Aid in visual discrimination Aid in visual discrimination

13. Selection Set Appearance Text Font Text Font Lower case is preferred for young children Lower case is preferred for young children Simple upper/lower case for most adults Simple upper/lower case for most adults Rachel’s example in clinic class Rachel’s example in clinic class Highlighting and Prompting Highlighting and Prompting Visual Visual Customized foreground/background color or graphic changes Customized foreground/background color or graphic changes Avoid low contrast color combinations Avoid low contrast color combinations Auditory Auditory Helpful for those with visual, learning or perceptual difficulties Helpful for those with visual, learning or perceptual difficulties Bells, beeps other sounds Bells, beeps other sounds Digitized or synthetic speech Digitized or synthetic speech Speech MUST be synchronized Speech MUST be synchronized

14. Selection Three methods of selection Three methods of selection Pressing the mouse button Pressing the mouse button Switch Switch Dwell (wait time) Dwell (wait time) Feedback of selection may be auditory (beep) or visual (flash on screen) Feedback of selection may be auditory (beep) or visual (flash on screen) Selected by “pressing for action” or “releasing for action” Selected by “pressing for action” or “releasing for action”

15. Keyboard Actions Send text Send text Word processing Word processing Send graphics Send graphics Insert pictures or symbols Insert pictures or symbols Cursor keys and control key combinations Cursor keys and control key combinations e.g., bg Hello there bg (start and end of line) e.g., bg Hello there bg (start and end of line) e.g., bP is a print signal e.g., bP is a print signal Sticky keys Sticky keys Control + letter (e.g., control + c = copy) Control + letter (e.g., control + c = copy)

16. Acceleration Features Prediction Prediction Most frequently or recently used words Most frequently or recently used words Reduces number of selections while increasing the speed of writing Reduces number of selections while increasing the speed of writing Abbreviation Expansion Abbreviation Expansion Short abbreviation stands for longer word Short abbreviation stands for longer word Smart Punctuation Smart Punctuation Automatically adds spaces after punctuation marks and capitalizes the first letter Automatically adds spaces after punctuation marks and capitalizes the first letter Scrolling word lists Scrolling word lists Lists of words beginning with each letter Lists of words beginning with each letter

17. Computer/Program Control These features improve speed and increase ease of use These features improve speed and increase ease of use Automatic startup Automatic startup Save/load user settings Save/load user settings Open set automatically with application Open set automatically with application Open application Open application Switch applications Switch applications

18. Speech/Sound Actions Two types of speech Two types of speech 1- digitized (recorded speech or sound) 1- digitized (recorded speech or sound) 2- synthetic (computer generated) 2- synthetic (computer generated) Most programs have speech control to change voice, pitch, volume, etc. of speech Most programs have speech control to change voice, pitch, volume, etc. of speech

19. Selection Sets Selection set editor Selection set editor Program for creating and changing settings Program for creating and changing settings Instant editing Instant editing Changed automatically without editor program Changed automatically without editor program Editor accessible by user Editor accessible by user Special access to program to edit sets Special access to program to edit sets Import text file to selection set Import text file to selection set Load file and creates word-bank selection Load file and creates word-bank selection Selection sets supplied and available Selection sets supplied and available Ready-made selection sets Ready-made selection sets

20. Problems with Selection (mouse or pointing device) Difficulty hitting small items on the screen Difficulty hitting small items on the screen Accidentally selects items next to the intended selection Accidentally selects items next to the intended selection Can move the mouse, but can not operate the mouse buttons Can move the mouse, but can not operate the mouse buttons Difficulty seeing the mouse pointer on the screen Difficulty seeing the mouse pointer on the screen Writing is slow Writing is slow

21. Solutions to These Problems Practice Practice Slow mouse speed Slow mouse speed Increase spacing between items on the screen Increase spacing between items on the screen Use another switch Use another switch Use dwell select Use dwell select Increase the size, shape, or color of the mouse pointer Increase the size, shape, or color of the mouse pointer Onscreen highlights Onscreen highlights Use acceleration tools, use frequency of use layout Use acceleration tools, use frequency of use layout

22. Learning to Use On-Screen Keyboards Make it simple and fun Make it simple and fun Start with large targets and gradually fade to smaller targets Start with large targets and gradually fade to smaller targets Sample Programs for Learning Sample Programs for Learning Living Books Living Books Kid Pix (drawing programs) Kid Pix (drawing programs)

23. Programs Using On-Screen Keyboards Most are suitable for the computer-literate Most are suitable for the computer-literate Many are expensive Many are expensive EZ Keys for Windows ($1,000) EZ Keys for Windows ($1,000) Each specialize in specific areas Each specialize in specific areas (e.g., graphics, speech, writing, classroom) (e.g., graphics, speech, writing, classroom)

24. Other Programs Wivik Wivik Program designed for independent access without focus on speech output Program designed for independent access without focus on speech output EZ Keys EZ Keys Designed for users with communication impairment because of speech output Designed for users with communication impairment because of speech output Discover Discover Windows and Macintosh compatible Windows and Macintosh compatible

25. Programs for the Classroom Advantages of Programs designed for classroom use include: Advantages of Programs designed for classroom use include: Low cost Low cost Text and graphics Text and graphics Restrict access to certain users Restrict access to certain users Ready-made selection sets Ready-made selection sets Programs for Classroom Use: Programs for Classroom Use: 1- Clicker Inexpensive, compatible with all computer systems, designed for classroom use 2- Windows Switch and Point Inexpensive, effective, flexible