1. Natural Human-Computer Interaction 自然人机交互：改变人机交互方式 Jian Wang Microsoft Research Asia December 27, 2003 Xia Men

2. Outline Challenges Computing and interaction Driving forces of natural user interface Case discussion Pen computing

3. Random Thoughts Analog originals  Digital originals Single Device  Multiple devices Optional  Essential GUI  Next mainstream UI

4. Challenges ``non-digital way of doing things'' like paper and pencils PCs still create non-digital document Such as printed document Keyboard/mouse confine people to desktop Mobile interaction

5. From Desktop to Anywhere Desktop Computer on every desktop Internet + mobility A workplace for any time and any where on any device

6. Killer Apps Evolution PC with KB/Mouse Word processing Electronic spreadsheet Browser Today (button, pen, camera…) Information access, PIM, instant message, e-mail Note-taking (help to capture your ideas), reading and annotation Collaboration / RTC Web services

7. Interaction and Devices Small Large Display size Phone Tablet PC Desktop PC Mobility Instant communication and information access Quick authoring and information access High volume authoring and information consumption Large Small Desktop PC Tablet PCPhone……

8. Driving forces Computing (GPU) Display Wireless connection Storage Sensors ……

9. Case Discussion Tablet PC uPen

10. Tablet PC Approach Combine the simplicity of paper with power of a PC The rich features of a notepad with the simplicity of a pen Wireless Display Sensor…

11. uPen Approach New interaction device Digital pen Digital everything Digital printed document New data type Ink as ink Sensor

12. Summary Computer (???) goes from desktop to mobile and collaborative scenarios(???) Is GUI ready for this change? Non-digital way of doing things(???)

13. National Medal of Technology, 2000 IEEE, John Von Neumann Medal Award, 1999 ACM, A. M. Turing Award, 1997 Invention That Changed World