1. Iterative Design and Evaluation of Event Architecture for Pen-and-Paper Interfaces HCI Group Stanford University Ron B. Yeh Andreas Paepcke Scott R. Klemmer UIST 2008 (User Interface Software and Technology )

2. Outline Introduction The PaperToolkit Architecture Evaluation by Deployment and Code Analysis Design Implications and Toolkit Iteration Conclusion and Future Work 2

3. Introduction Augmented paper interaction – Graphical UI architectures – Previous GUI design tools – Paper application Two approaches – Traditionally engaged in with pen and paper – Pen as a command-specification device 3

4. Introduction Device – Tiny camera mounted inside the pen – Pre-printed with a dot-pattern Three contributions – More flexible architecture than prior systems – The usage of PaperToolkit – User-centered toolkit design 4

5. The PaperToolkit Architecture 5

6. 6

7. 7

8. Hardware – Pen (Coordination, XML socket) JAVA SE 6 (242 classes) ANOTO Paper UI (JAVA EPS, iText PDF libraries) Handwriting (MS Tablet PC recognizer, Wobbrock’s $1 recognizer) 8

9. The PaperToolkit Architecture 9

10. 10

11. Evaluation by Deployment and Code Analysis User: 69 programmers @ undergraduate HCI class Duration: 6 weeks Experience: None in building paper interfaces 11

12. Evaluation by Deployment and Code Analysis 12

13. Evaluation by Deployment and Code Analysis 13

14. Evaluation by Deployment and Code Analysis 14 Composing Ink Operations for Gesture Recognition

15. Evaluation by Deployment and Code Analysis 15

16. Evaluation by Deployment and Code Analysis 16 Creating Interfaces by Example Modification

17. Evaluation by Deployment and Code Analysis 17 Usage Frequency Reveals Opportunities for Design

18. Evaluation by Deployment and Code Analysis 18 Using Debug Output to Understand Event Flow

19. Evaluation by Deployment and Code Analysis 19 Multiple Coordinate Systems and Representations

20. Design Implications and Toolkit Iteration Feedback in Mobile and Collaborative Environments Unifying Real-time and Batched Event Handling Debugging with Save and Replay Simulating Printed UIs with Off-the-Shelf Notebooks Enhancing Debugging with Visualizations Interaction Language of Paper Interfaces 20

21. Design Implications and Toolkit Iteration 21

22. Design Implications and Toolkit Iteration 22

23. Conclusion and Future Work Event-driven approach Impact & opportunity Future – Non-programmers – Visualization helps learning – Automatic updates 23

24. 24