1. Co-Interpreting Sensor Networks Phoebe Sengers Culturally Embedded Computing Group Cornell Information Science and Science & Technology Studies How can we design ubiquitous systems to integrate with our everyday lives and experiences?

2. 1. A vision of ubicomp

4. Proactive Computing

5. What happens to intuitions, moods, whims, idiosyncrasies, … in a world where computers sense and act for us? Who is in charge? And how should we design to get good answers to these questions?

6. 2. Inspiration from AI

7. Genghis

8. Intelligence without representation 1.You don't need to know what's going on to act "smart." 2.Focus design on the dynamics of what's going on in the real world, not on what the computer "knows" or "doesn't know." 3.Design with the human in the loop.

9. 3. What does this mean for ubicomp?

10. Genghis meets ubicomp

11. It's not about intelligence

12. 4. It's about co-interpretation.

13. Proactive computing

14. Co-interpretation

15. Our approach Design ‘smart’ devices to only be smart in the presence of a human Privacy-preserving sensing (“shy” sensing; proxy measures; activity inferencing?) Fault-tolerant user modeling Provoke user interpretation / reflection / activity

16. 5. Home Health Phoebe Sengers, Joseph "Jofish" Kaye – Cornell Bill Gaver, Michael Golembewski – Royal College of Art

17. Goal Provide a sense of a home's well-being without intrusive sensing Develop a concrete alternative to "smart homes" as being for task completion/efficiency

18. Concept

19. Why horoscopes?

20. System Structure homesensorssensor datametricshoroscope generation output

21. Target users : Fru’s House Fru describes herself as “Mrs. Average” She owns a large suburban style house in north London. She used to own a catering business, but now acts mostly as a housewife, except for some ‘business deals’ of an undisclosed nature.

22. A Very Full House A the moment, Fru shares the home with : Her husband (Zach)… An adult son (David)… A hip-hop producer on the dole (Ricky)… An aspiring glamour model (Wendy)… And four Italian exchange students.

23. An Extremely Social Environment Because of the large numbers of people who live and interact in this home, it tends to be an extremely social environment. Because of the large numbers of people who live and hang around at Fru’s, privacy and solitude are at a minimum. Still, Fru insists on at least one hour alone with Zach each day in the living room.

24. Possible Metrics Cheerful - How happy is the house? Tired - Are people getting enough rest? Social - Are people socializing in the house? Private - Are people getting enough alone time? Busy - Are people doing lots of things at home? Ordered - Is Fru’s house care routine up to par? Disordered - Is the house a shambles? Productive - Are people getting things done in their lives? Empty - Is the house less full than usual? Transitive - Are there lots of changes taking place in the home?

25. Sensor : Love Seat A sensor inside of the love seat in Fru’s room tell swhen it is being used. Zach has pleasant conversation with Fru while sitting in the love seat some mornings… a sign of cheerfulness in the home? Zach and Fru using the love seat in the afternoon could mean that they can’t have their alone time in the living room - a possible sign of disorder?

26. Attic Water Tank We monitor the water tank in the attic to look at the activity levels of the people in the house… Is the pattern of water use different than it usually is? The house might be a bit chaotic… Is more than the usual amount of water being used? The house might have even more people than usual in it… Are fewer showers than normal being taken? The house might be more empty than usual…

27. Output: horoscopes Database of 70,000 horoscope sentences Classified semi-automatically into emotional categories… for Fru and Zac's house

28. Example: "Busy house" horoscope sentences Soon, you will push aside those matters that have kept you busy lately and there'll be more chance to follow your own preferences. You can make a residential move; however, it will be hectic. Things will be hectic on the home front. Learn to concentrate to keep up with the hectic pace. Your household will be hectic and unsettled today. Today keep yourself busy with correspondence paperwork and phone calls jump to it. You're in a particularly busy phase, and the best you can do is to take care of yourself. Changes and busy activities in your home will cause fatigue. Your spiritual life has been sadly empty, probably because you've been so busy with mundane tasks. You're simply brimming with fantastic ideas, which makes you a popular figure. Life will seem far less hectic when your home is in order.

29. Plans The system is currently fully constructed. We plan to deploy in Fru's home in the next 2 months. Next generation: Multiple households? New output "genre" (e.g. Your Household News)? True language generation?