1. Informal PUIs: No Recognition Required James Landay Jason Hong Scott Klemmer James Lin Mark Newman

2. 2 Mar 25 2001 WIMPy User Interfaces Windows, Icons, Menus, Pointer ­Hitting limitations of this kind of interface WIMP designed for limited audience ­Full use of eyes ­Literate ­Full use of hands WIMP designed for limited situations ­Fixed location (often offices) ­Sitting down ­Single person

3. 3 Mar 25 2001 Perceptual User Interfaces PUIs leverage our innate perceptual, motor, and cognitive abilities ­Speech recognition, computer vision, sketching, handwriting Sketching is one part of this bigger push PUIs more useful for different audiences and wider range of situations ­Mobile workers or Home ­Speech => Hands-free ­Location Tracking => Physical motion

4. 4 Mar 25 2001 PUIs and Recognition Key question: ­When should perceptual input be recognized? Immediate recognition can interfere with creativity and communications

5. 5 Mar 25 2001 Communication and Creativity Informal visual representation ­communicates “unfinished” ­encourages creativity ­faster to create ­higher level comments Formal visual representation ­communicates “finished” ­inhibits creativity (detailed) ­slower to create ­lower-level comments

6. 6 Mar 25 2001 Informal User Interfaces Historic bias towards formal user interfaces ­Computation over creativity and communication ­Structured input to simplify computation Position: ­Recognition interferes with creativity and communication due to errors and perception ­Recognition should be minimized or deferred for these kinds of apps

7. 7 Mar 25 2001 Informal User Interfaces Sketching Speech Handwriting

8. 8 Mar 25 2001 Informal User Interfaces Sketching Speech Handwriting

9. 9 Mar 25 2001 Slide Landay (1996)

10. 10 Mar 25 2001 Slide Gross and Do (UIST96)

11. 11 Mar 25 2001 Slide Lin, Newman, Hong, Landay (CHI2000)

12. 12 Mar 25 2001 DENIM Video

13. 13 Mar 25 2001 Informal User Interfaces Sketching Speech Handwriting

14. 14 Mar 25 2001 Slide Stifelman, Arons, Schmandt (CHI2001)

15. 15 Mar 25 2001 SUEDE: Informal Prototyping for Speech-based UIs Supports design practice ­example scripts ­Wizard of Oz ­error simulation ­iterative design Informal user interface ­no speech recognition or synthesis ­need not be programming expert ­fast & fluid design Read my important email

16. 16 Mar 25 2001 Slide Klemmer et al (UIST2000)

17. 17 Mar 25 2001 SUEDE Video

18. 18 Mar 25 2001 Informal User Interfaces Sketching Speech Handwriting

19. 19 Mar 25 2001 NotePals: Informal Handwriting Capture Davis et al (CHI99)

20. 20 Mar 25 2001 NotePals: Informal Handwriting Capture

21. 21 Mar 25 2001 Takeaway Ideas Perceptual user interfaces useful for more audiences and more places Informal User Interfaces valuable for PUIs ­Minimize or defer recognition ­Creative or communications-oriented tasks Informal User Interfaces can be applied to a range of perceptual input ­Sketching ­Speech ­Handwriting

22. Informal PUIs: No Recognition Required James Landay Jason Hong Scott Klemmer James Lin Mark Newman

23. 23 Mar 25 2001 Backup Slides

24. 24 Mar 25 2001 Backup Slides Igarashi, Edwards, LaMarca, and Mynatt (AVI2000)