Handhelds and Collaborative Command and Control Brad Myers Human Computer Interaction Institute Carnegie Mellon University February 23, 2001

Technology Demonstration Coordinated Maps and Tables on Handheld –Customized display for handheld Interaction with shared display using handhelds Coordination with Laser Pointer –Low effectiveness of laser pointer alone

Research Issues For Future Work Multiple form factors for mobile devices Fluid Private Public Data Sharing Synchronization for Effective Communication Handhelds and Other Modalities

Multiple form factors for mobile devices Appropriate size and input depends on context –Seated, standing –Command Post, Field Size of display, input techniques, etc. May use same application on different devices –How can user interface be “consistent” yet appropriate? –Automatic design of control panels for equipment May use multiple devices simultaneously –“Multi-Machine User Interfaces” (MMUIs)

Fluid Private Public Data Sharing Moving information among large public displays and private displays –Private drill down of public information –Public reporting and summaries of private notes Custom and legacy applications May need to reformat information –Not just copy of the screen –Drill down to see different details –Reformat based on properties of private displays

Synchronization for Effective Communication Level of synchronization –Keep data consistent But what about explorations? –Keep selections coordinated –Keep Annotations and edits coordinated –Keep scrolling and focus coordinated –Etc. (may be application-specific) Synchronization across different display types (tables, maps, etc) –Scroll to same place? –Showing disconnected selections?

Handhelds and Other Modalities Coordinating multiple modalities, including handhelds Speech, Laser Pointing, free-space gestures, etc. Exploring the most natural and effective role for handheld devices Multi-Machine User Interfaces will be commonplace in the wireless communication world