1. Component-Based Software Engineering Oxygen Paul Krause

2. Lecture 10 - Oxygen Contents  Introduction to the Oxygen Project  Technological themes  User technologies  Conclusions

3. Beyond Objects, Beyond Components  Ubiquitous Computing Embedded devices Embedded devices Mobile devices Mobile devices Ad-hoc, dynamically changing networks Ad-hoc, dynamically changing networks  Ambient Intelligence Sensitive and responsive Sensitive and responsive As effective away as at home As effective away as at home “Social” user interfaces “Social” user interfaces

4. OXYGEN & HYDROGEN PERVASIVE, HUMAN-CENTRED COMPUTING MIT LABORATORY FOR COMPUTER SCIENCE MIT ARTIFICIAL INTELLIGENCE LABORATORY PHILIPS RESEARCH

5. Oxygen Partnership  Massachusetts Institute of Technology Laboratory for Computer Science Laboratory for Computer Science Artificial Intelligence Laboratory Artificial Intelligence Laboratory  Acer (Taiwan)  Delta Electronics (Taiwan)  Hewlett Packard (USA)  Nippon Telephone and Telegraph Inc. (Japan)  Nokia Research Centre (Finland)  Philips Research (Netherlands)

6. Pervasive, Human-Centred Computing

7.  Computation will be pervasive (“like Oxygen in the air we breath”) In hand-held and personal devices In hand-held and personal devices In our homes, offices, cars… In our homes, offices, cars…  Each device will adopt our “information personality” when we interact with it  We will interact with them using speech, gestures, facial expressions

8. Requirements for Pervasive Computing  Must be accessible anywhere  Must adapt to change In user requirements In user requirements In operating conditions In operating conditions  Must never shut down or reboot Individual components may come and go, but Oxygen must be available all the time Individual components may come and go, but Oxygen must be available all the time

9. Addressing Human Needs  Speech and Vision technologies to enable us to communicate with Oxygen  Individualised access and collaboration technologies  Devices embedded in home, office and cars to sense and affect our needs  Hand-held devices to empower us to compute and communicate wherever we are

10. Technological themes  Distribution and mobility People, resources and services People, resources and services  Semantic content What we mean, not what we say What we mean, not what we say  Adaptation and change To enable us to act in a dynamic world To enable us to act in a dynamic world  Information personalities Privacy, security and form of interactions Privacy, security and form of interactions

11. Semantic content  Time flies like and arrow  Fruit flies like a banana

12. Necessary Information  Information personality Uses whole lifestyle to identify information needs Uses whole lifestyle to identify information needs  Adaptation and change Information and advice will be tailored to context Information and advice will be tailored to context

13. Devices and Networks  Universally accessible devices E21s, embedded in the environment E21s, embedded in the environment H21s, Hand-held devices H21s, Hand-held devices  Adapt automatically, or  Modified explicitly To address specific user preferences

14. Stationary Devices  Linked to local sensors and actuators Monitor and change room temperature Monitor and change room temperature Check and close doors Check and close doors Redirect e-mail Redirect e-mail  Can act for us, even when we’re thousands of miles away

15. But?  How do we: Register sensors with all and only the relevant listeners Register sensors with all and only the relevant listeners Ensure actuators do not receive conflicting requests Ensure actuators do not receive conflicting requests Safeguard the networks against attacks from viruses, attempts to access secure information, … Safeguard the networks against attacks from viruses, attempts to access secure information, …

16. Hand-held devices Multiple modes of Communication Configurable to a range of communication protocols Serve as: cellular phones radios GPS television PDA May offload communication and computation to nearby E21s

17. Networks  Support dynamically changing configurations of devices  Able to identify devices and services by how we intend to use them  Enable us to access information and services securely and privately  Enable dynamic creation of “collaborative regions” - local; building-wide; district-wide

18. User Technologies  Speech and Vision  Knowledge Access  Automation  Collaboration

19. Speech and Vision  Main modes of interaction will be spoken language and visual cues  Use of vision to augment speech understanding Facial expressions Facial expressions Lip movements Lip movements Gaze Gaze  Graceful switching between different domains

20. Knowledge Access  Individualised Knowledge Access  Universal access to information Content-based searches/manipulations of data Content-based searches/manipulations of data Information stored in different formats: text; graphics; video clips … Information stored in different formats: text; graphics; video clips …  Searches must return small amount of most relevant information

21. Automation  Processes for automating and tuning repetitive information and control tasks must be Natural Natural Easy-to-use Easy-to-use Customisable Customisable Adaptive Adaptive  E.g. set up the house for your arrival home  Set up equipment for a serious operation

22. Collaboration  Enable people to engage in group activities Secure “collaborative regions” Secure “collaborative regions”  Trace group actions Annotated trail of issues, decisions, documents, conversations … Annotated trail of issues, decisions, documents, conversations …  All entities in the traces linked in a semantic web

23. (Their) Conclusions The Oxygen technologies will lead to:  Profound leap in human productivity  Anywhere, anytime, people will be able to Automate routine tasks Automate routine tasks Access knowledge Access knowledge Collaborate with others Collaborate with others  Significant amplification of human capabilities throughout the world