1. Handhelds in the Automobile: The Denali Navigation System Human Computer Interaction Institute School of Computer Science Carnegie Mellon University Brad A. Myers bam@cs.cmu.edu http://www.cs.cmu.edu/~pebbles Brad A. Myers bam@cs.cmu.edu http://www.cs.cmu.edu/~pebbles

2. Brad Myers 2 Talk for General Motors – 4/02/04 General Idea l How can a handheld augment the operation of an automobile? l Not just using a PDA while in a car l PDA augments and interoperates with car l Not for driving l Examples: l Setting functions, controls l Specifying destination for navigation systems l How can a handheld augment the operation of an automobile? l Not just using a PDA while in a car l PDA augments and interoperates with car l Not for driving l Examples: l Setting functions, controls l Specifying destination for navigation systems

3. Brad Myers 3 Talk for General Motors – 4/02/04 Pebbles Project l This research is part of the Pebbles project l Overall goal: investigate use of handhelds at the same time as PCs and other computerized devices l “Multi-Machine User Interfaces” l Assumption: handhelds will frequently be in close interactive communication with each other and other computers l Wireless and wired technologies l This research is part of the Pebbles project l Overall goal: investigate use of handhelds at the same time as PCs and other computerized devices l “Multi-Machine User Interfaces” l Assumption: handhelds will frequently be in close interactive communication with each other and other computers l Wireless and wired technologies

4. Brad Myers 4 Talk for General Motors – 4/02/04 Other Domains for Pebbles l Also created applications to study use of PDAs in: l Classrooms l Offices l Meeting rooms l Command Post of the Future l Homes l For the Handicapped l Also created applications to study use of PDAs in: l Classrooms l Offices l Meeting rooms l Command Post of the Future l Homes l For the Handicapped

5. Brad Myers 5 Talk for General Motors – 4/02/04 Personal Universal Controller l Two-way communication l Appliance describes its functions l Personal Universal Controller then: l Automatically creates user interface l Controls the appliance l Displays feedback about appliance status l Two-way communication l Appliance describes its functions l Personal Universal Controller then: l Automatically creates user interface l Controls the appliance l Displays feedback about appliance status Specifications Control Feedback

6. Brad Myers 6 Talk for General Motors – 4/02/04 Current PUC Specification Language l XML l Full documentation for the specification language and protocol l Has been used to specify many appliances l Stereo, MP3 player, camera, VCR, room lights, elevator, etc. l XML l Full documentation for the specification language and protocol l Has been used to specify many appliances l Stereo, MP3 player, camera, VCR, room lights, elevator, etc.

7. Brad Myers 7 Talk for General Motors – 4/02/04 Previously Reported l Modeling the GMC Yukon Denali SUV l Has a sophisticated Driver Information Console system l Three-zone HVAC system l LCD screen-based navigation system l Modeling the GMC Yukon Denali SUV l Has a sophisticated Driver Information Console system l Three-zone HVAC system l LCD screen-based navigation system

8. Brad Myers 8 Talk for General Motors – 4/02/04 Simulator l Navigation System l 50+ screens covering most navigation features l Limited direct interaction with the map (e.g. scrolling) l Based on interacting with real device l Navigation System l 50+ screens covering most navigation features l Limited direct interaction with the map (e.g. scrolling) l Based on interacting with real device

9. Brad Myers 9 Talk for General Motors – 4/02/04 Navigation Simulator, cont.

10. Brad Myers 10 Talk for General Motors – 4/02/04 New Work l More parts of the Navigation Simulator l Audio functions l Various settings l Specification of the Navigation System’s functions in XML l Exercises advanced features of PUC specification language l Automatic generation of (parts of) Navigation System on PocketPCs l More parts of the Navigation Simulator l Audio functions l Various settings l Specification of the Navigation System’s functions in XML l Exercises advanced features of PUC specification language l Automatic generation of (parts of) Navigation System on PocketPCs

11. Brad Myers 11 Talk for General Motors – 4/02/04 Future Work l Future Work on Simulator l Simulate XM radio l Conduct a comparison user study l Similar to our previous comparison study l Measure time/errors for users using both the physical unit and handheld remote control l Automatic generation with user consistency l Future Work on Simulator l Simulate XM radio l Conduct a comparison user study l Similar to our previous comparison study l Measure time/errors for users using both the physical unit and handheld remote control l Automatic generation with user consistency

12. Text Input Using EdgeWrite Human Computer Interaction Institute School of Computer Science Carnegie Mellon University Brad A. Myers bam@cs.cmu.edu http://www.cs.cmu.edu/~pebbles Brad A. Myers bam@cs.cmu.edu http://www.cs.cmu.edu/~pebbles

13. Brad Myers 13 Talk for General Motors – 4/02/04 Input while physically unstable l GM has sponsored research and patent on a new text entry technique called EdgeWrite™ l First aimed at people with motor impairments l Unable to make Graffiti or Jot gestures l Physical edges provide physical stability l Instability might be a property of the environment, not just the person l e.g., on a bus, while walking, or in a car l GM has sponsored research and patent on a new text entry technique called EdgeWrite™ l First aimed at people with motor impairments l Unable to make Graffiti or Jot gestures l Physical edges provide physical stability l Instability might be a property of the environment, not just the person l e.g., on a bus, while walking, or in a car

14. Brad Myers 14 Talk for General Motors – 4/02/04 Stylus EdgeWrite™ l Move along plastic edges inside square hole l Recognition based on order corners are hit l OK if the path is jittery l No need for: l Shift or caps lock l Separate areas for numbers and letters l Move along plastic edges inside square hole l Recognition based on order corners are hit l OK if the path is jittery l No need for: l Shift or caps lock l Separate areas for numbers and letters

15. Brad Myers 15 Talk for General Motors – 4/02/04 Character Chart l Three subsets: l Alphanumerics (e.g., abc, 123) l Punctuation (e.g., !?#$*) l Extended characters (e.g., ®¶Øç) l 144 characters with 306 forms l Three subsets: l Alphanumerics (e.g., abc, 123) l Punctuation (e.g., !?#$*) l Extended characters (e.g., ®¶Øç) l 144 characters with 306 forms

16. Brad Myers 16 Talk for General Motors – 4/02/04 Stylus EdgeWrite™ Results l After 15 minutes of practice, able-bodied novices: l 18% more accurate than Graffiti l About the same in speed (~7 WPM with each) l Note: Tasks included numbers and punctuation l Motor-impaired users were vastly more accurate l 22/72 in Graffiti, 68/72 in EdgeWrite (Parkinson’s) l After 15 minutes of practice, able-bodied novices: l 18% more accurate than Graffiti l About the same in speed (~7 WPM with each) l Note: Tasks included numbers and punctuation l Motor-impaired users were vastly more accurate l 22/72 in Graffiti, 68/72 in EdgeWrite (Parkinson’s)

17. Brad Myers 17 Talk for General Motors – 4/02/04 Joystick EdgeWrite™ l Could be useful for game consoles, mobile phones, or on power wheelchairs l Compared EdgeWrite to Date Stamp and Selection Keyboard l Tested with unmodified COTS joystick l Could be useful for game consoles, mobile phones, or on power wheelchairs l Compared EdgeWrite to Date Stamp and Selection Keyboard l Tested with unmodified COTS joystick

18. Brad Myers 18 Talk for General Motors – 4/02/04 Touchpad EdgeWrite™ l Use elevated edges around a Synaptics touchpad l May be easier for people with motor impairments l Maybe mount on the steering wheel or arm-rest? l Use elevated edges around a Synaptics touchpad l May be easier for people with motor impairments l Maybe mount on the steering wheel or arm-rest?

19. Brad Myers 19 Talk for General Motors – 4/02/04 Touchpad Pilot Study l Two factors l Output visible l Touchpad visible l Touchpad visibility a complete non- factor! l Not seeing output doesn’t degrade performance very much l Two factors l Output visible l Touchpad visible l Touchpad visibility a complete non- factor! l Not seeing output doesn’t degrade performance very much One subject: 22.61 WPM (maximum)

20. Brad Myers 20 Talk for General Motors – 4/02/04 Using Joystick on Wheelchair l Custom hardware and software to interface to commercial joystick l Informally evaluated with 7 disabled power-wheelchair users l 6 with Cerebral Palsy, 1 with Multiple Sclerosis l Compared to on-screen keyboard and using EdgeWrite on a touchpad l Custom hardware and software to interface to commercial joystick l Informally evaluated with 7 disabled power-wheelchair users l 6 with Cerebral Palsy, 1 with Multiple Sclerosis l Compared to on-screen keyboard and using EdgeWrite on a touchpad New!

21. Brad Myers 21 Talk for General Motors – 4/02/04 Results l Touchpad worked better than wheelchair joystick

22. Brad Myers 22 Talk for General Motors – 4/02/04 EdgeWrite.com l Download EdgeWrite software l Find abridged and full character charts l Find publications l Order plastic templates l See http://www.edgewrite.com/ or http://www.cs.cmu.edu/~edgewrite/ l Same web site l Download EdgeWrite software l Find abridged and full character charts l Find publications l Order plastic templates l See http://www.edgewrite.com/ or http://www.cs.cmu.edu/~edgewrite/ l Same web site

23. Brad Myers 23 Talk for General Motors – 4/02/04 Future EdgeWrite™ work l Mouse/text disambiguation on touchpad l Keyboard/mouse replacement for people with disabilities l Custom (non-commercial) joystick implementation l Cell phone implementation l More user tests! l Mouse/text disambiguation on touchpad l Keyboard/mouse replacement for people with disabilities l Custom (non-commercial) joystick implementation l Cell phone implementation l More user tests!

24. Human Computer Interaction Institute School of Computer Science Carnegie Mellon University Brad A. Myers bam@cs.cmu.edu http://www.cs.cmu.edu/~pebbles Brad A. Myers bam@cs.cmu.edu http://www.cs.cmu.edu/~pebbles