1. Ubiquitous Computing Computers everywhere

2. Agenda Amy: 3D Interaction Project Presentation New concept video http://www.nttdocomo.co.jp/english/corporate/mobilelife/index.html http://www.docomo-usa.com/vision2010/index.html Ubiquitous Computing Amar: Context-aware computing CSCW (if we have any time left)

3. Part 4 Presentation 15 minutes each (including questions) Load slides onto swiki Motivation Requirements learning from users Design learning from prototyping possible demo Evaluation Conclusions Q&A

4. Ubiquitous Computing (Ubicomp) Move beyond desktop machine Computing is embedded everywhere in the environment A new paradigm?? “off the desktop”, “out of the box”, pervasive, invisible, wearable, calm, anytime/anywhere/any place, …

5. Ubicomp Notions Computing capabilities, any time, any place “Invisible” resources Machines sense users’ presence and act accordingly

6. Marc Weiser: The father of ubicomp Chief Technologist Xerox PARC Began Ubiquitous Computing Project in 1988 1991 Scientific American article got the ball rolling http://www.ubiq.com/hypertext/weiser/SciAmDraft3.html

7. Not an interface problem? “The most profound technologies are those that disappear” “embodied virtuality” HCI: new focus on unobtrusiveness, invisibility How do we make technology “vanish”?

8. What makes technology disappear? Psychological effect of learning Distribution of technology Physical invisibility Location and scale Context awareness/automated functions

9. Ubicomp is... Related to: mobile computing wearable computing augmented reality In contrast with: virtual reality

10. How to achieve ubiquity? Instrument the person Vs. Instrument the physical surroundings How to connect between spaces? How to connect to people?

11. Device scales Inch PDAs Blackberry Voice Recorders smart phones OQO 5.5” 3.1”

12. Device scales Foot notebooks tablets digital paper Ultra mobile PC

13. Device scales Yard electronic whiteboards plasma displays smart bulletin boards

14. Another take on scales Based on ownership and location body desk room building

15. HCI Themes in Ubicomp Some of the themes: Natural interaction Context-aware computing Automated capture and access Everyday computing

16. Natural Interaction How do input and output change? Different form factors, more devices Input Towards implicit information Feeds context-aware computing (later) Output Towards distributed, peripheral and ambient displays

17. Natural / implicit input Integrate into human life Pen input Gesture Speech Perceptual UI Tangible UI http://tangible.media.mit.edu/

18. Distributed Displays The Everywhere Display Project at IBM Dynamic Shader Lamps – virtual painting on real objects http://www.cs.unc.edu/~raskar/Shaderlamps/

19. Ambient Displays The Information Percolator http://www-2.cs.cmu.edu/~hudson/bubbles/ Ambient Orb http://www.ambientdevices.com/

20. Peripheral Displays Kimura Digital Family Portrait

21. What is Context? Any information that can be used to characterize the situation of an entity Who, what, where, when Why is it important? information, usually implicit, that applications do not have access to It’s input that you don’t get in a GUI

22. Example: Location services Outdoor Global Positioning Satellites (GPS) wireless/cellular networks Indoor active badges, electronic tags vision motion detectors, keyboard activity

23. How to Use Context To present relevant information to someone Mobile tour guide To perform an action automatically Print to nearest printer To show an action that user can choose Want to phone the number in this email?

24. Motivating Capture Scenarios in Weiser’s Scientific American article: Sal doesn't remember Mary, but she does vaguely remember the meeting. She quickly starts a search for meetings in the past two weeks with more than 6 people not previously in meetings with her, and finds the one. Sal looks out her windows at her neighborhood. Sunlight and a fence are visible through one, and through others she sees electronic trails that have been kept for her of neighbors coming and going during the early morning.

25. Automated capture and access Use of computers to preserve records of the live experience for future use (Abowd & Mynatt 2000) Points of consideration: capture needs to be natural user access is important details of an experience are recorded as streams of information

26. Capture & access applications Compelling applications Design records Evidence based care Everyday communication Family memories Annotations Fusion, indexing, summarization

27. Example: Personal Audio Loop

28. Designing for Everyday Activities No clear beginning or end Closure vs. flexibility and simplicity Interruption is expected Design for resumption Concurrent activities Monitoring for opportunity Time is important discriminator Interpret events Associative models needed Reacquire information from multiple pts of view

29. Technical Challenges Connectivity – almost constant How to gracefully handle changes? Sensing How to gather useful info? (i.e. location?) Integration and analysis of data How to recognize activity and recover when incorrect? How to function at acceptable speeds? Scale – both in information and size of displays

30. Challenge of Evaluation Bleeding edge technology Novelty Unanticipated uses Quantitative metrics Variety of social implications/issues

31. Social issues Privacy – who has access to data? How do we make users aware of what technology is present? Differing perspectives and opinions Jane likes that the environment is aware she is present, but John doesn’t…

32. Conclusions Just scratched the surface Scale … hard to imagine Real life interaction … noisy, erroneous Continuous interaction … time sensitive Evaluation

33. Computer-Supported Cooperative Work (CSCW) Thinking about groups, collaboration, and communication

34. CSCW Computer Supported Cooperative Work HCI connotationsCSCW individual use psychology

35. CSCW Study how people work together as a group and how technology affects this Support the social processes of work, whether co-located or distributed Support the social processes of a group of people communicating or collaborating in any situation

36. Examples Awareness of people in your family, community, workplace... Mobile communication Online discussions, blogs Sharing photos, stories, experiences Recommender systems Playing games

37. Groupware Software specifically designed to support group working or playing with cooperative requirements in mind NOT just tools for communication Groupware can be classified by when and where the participants are working the function it performs for cooperative work Specific and difficult problems with groupware implementation

38. The Time/Space Matrix Classify groupware by: when the participants are working, at the same time or not where the participants are working, at the same place or not Common names for axes: time: synchronous/asynchronous place: co-located/remote different time same time same place different place

39. Time/Space Matrix Examples Time Place Synchronous Co-located Asynchronous Remote Face-to-face E-meeting room Post-it note Argument. tool Phone call Video window,wall Letter Email

40. A More-fleshed Out Taxonomy A typical space/time matrix (after Baecker, Grudin, Buxton, & Greenberg, 1995, p.742)

41. Styles of Systems Computer-mediated communication Meeting and decision support systems Shared applications and tools

42. Computer-mediated Communication (CMC) Aids Examples Email, Chats, virtual worlds Desktop videoconferencing -- Examples: CUSee-Me MS NetMeeting SGI InPerson

43. Food for thought… Why aren’t videophones more popular? How and when do you use Instant Messaging? How does this differ from email? What communication technology do you still want?

44. Groupware Challenges - Grudin Who does work vs. who gets benefit Critical mass prisoner’s dilemma Infrequent features Managing acceptance Evaluation is longer, more complicated, less precise Groupware and Social Dynamics: Eight Challenges for Developers By Jonathan Grudin (now at Microsoft) http://www.ics.uci.edu/~grudin/Papers/CACM94/cacm94.html

45. Evaluation Evaluating the usability and utility of CSCW tools is quite challenging Need more participants Logistically difficult Apples - oranges Often use field studies and ethnographic evaluations to assist

46. Recommendations Add group features to existing apps Benefit all group members Start with niches were application is highly needed Consider evaluation and adoption early Expect and plan for development and evaluation to take longer