1. MeMoML Master project MeMoML for the MeModules project 23.12.2005 Seminar: tangible user interfaces University of Fribourg David Bächler david.baechler@unifr.ch

2. 223.12.2005MeMoML: david.baechler@unifr.ch Content MeModules project  Description  Goals State of the art  Markup languages for TUIs MeMoML project  MeMoML  MeMoEngine  MeMoML-GUI  Schema

3. 323.12.2005MeMoML: david.baechler@unifr.ch MeModules project MeModules  tangible links between the human memory and reachable information Collaboration EIA (www.eif.ch) - UniFrwww.eif.ch  Co-financed by the Hasler foundation 2 + 1 years from January 1 st on

4. 423.12.2005MeMoML: david.baechler@unifr.ch Lost in the “InfoSpace” effect: Information overload in our daily life

5. 523.12.2005MeMoML: david.baechler@unifr.ch Lost in the “InfoSpace” effect: Information overload in our daily life

6. 623.12.2005MeMoML: david.baechler@unifr.ch MeModules project Designing and implementing a system for creating and managing tangible shortcuts to multimedia information Change the traditional way of communication with computers  GUI  TUI associative memory physical reminder real association

7. 723.12.2005MeMoML: david.baechler@unifr.ch MeModules project Two main goals  Easy interaction with devices in the everyday life  Information categorization in order to improve information access and retrieval Secondary goal  Collaboration of academic university (UniFr) and university of applied sciences (EIA)

8. 823.12.2005MeMoML: david.baechler@unifr.ch State of the art of TUI MLs Markup languages for tangible user interfaces Why MLs?  Heterogeneous environment  All devices must be formally described  Multitude of particular accesses to devices  Standardized access to devices

9. 923.12.2005MeMoML: david.baechler@unifr.ch State of the art of TUI MLs Not a lot of existing work in the field of meta- or markup-languages for tangible user interfaces Very new area

10. 1023.12.2005MeMoML: david.baechler@unifr.ch State of the art of TUI MLs TUIML  high-level description language for TUIs  Small part of the TUIMS project TUIMS  Laying the Foundations for a Tangible User Interface Management System  http://www.eecs.tufts.edu/~oshaer/TUIMS.pdf http://www.eecs.tufts.edu/~oshaer/TUIMS.pdf  http://www.cs.tufts.edu/tech_reports/reports/2005- 2/report.pdf (2004-2005 ongoing work) http://www.cs.tufts.edu/tech_reports/reports/2005- 2/report.pdf

11. 1123.12.2005MeMoML: david.baechler@unifr.ch State of the art of TUI MLs UserML  User Modeling Markup Language (UserML) for Ubiquitous Computing  Based on XML  A User Model Editor transforms UserML into XForms with XSLT  http://www.dfki.de/~krueger/PDF/UM2003. pdf (published 2003) http://www.dfki.de/~krueger/PDF/UM2003. pdf

12. 1223.12.2005MeMoML: david.baechler@unifr.ch UserML Example partial user model which uses categories from the ontology ”UserOL” userproperty.timepressure low-medium-high high "http://www.u2m.org/UserOL/"... </UserData

13. 1323.12.2005MeMoML: david.baechler@unifr.ch State of the art of TUI MLs MRIML  Mixed Reality Interface Markup Language  Interface markup language for defining cross- platform user interfaces  Contained in the VR and AR framework A Framework for Realizing Multi-Modal VR and AR User Interfaces  Frauenhofer Institut  http://www.fit.fraunhofer.de/gebiete/mixed- reality/publications/broll05.pdf (published 2005) http://www.fit.fraunhofer.de/gebiete/mixed- reality/publications/broll05.pdf

14. 1423.12.2005MeMoML: david.baechler@unifr.ch MRIML Example Description of a button pushButton 0.0 0.0 0.0 false …

15. 1523.12.2005MeMoML: david.baechler@unifr.ch State of the art of TUI MLs PML  Physical Markup Language « for communicating a description of physical environments and the objects within them, their relationships to you, each other and the space »  Philips  http://www.research.philips.com/technologies/syst _softw/pml/downloads/pml.pdf http://www.research.philips.com/technologies/syst _softw/pml/downloads/pml.pdf  http://www.research.philips.com/technologies/syst _softw/pml/ http://www.research.philips.com/technologies/syst _softw/pml/

16. 1623.12.2005MeMoML: david.baechler@unifr.ch State of the art of TUI MLs TouchMe  Diploma project of Andy Gonzalez at EIA (2005)  Communication with RFID tags Causes actions at computer (e.g. Open browser, show photos, play music)  Started work towards categorization of objects and actions  But the main goal was to have a running application  MeMoML will continue the categrozation and formalization

17. 1723.12.2005MeMoML: david.baechler@unifr.ch MeMoML MeModules Markup Language Every tangible link described via a predefined scenario  physical objects  communication processes  targeted actions flexible, device-independent and easy-to-use language for describing scenarios

18. 1823.12.2005MeMoML: david.baechler@unifr.ch MeMoML Objects  Source with Attributes (simple, complex)  Target with Attributes (simple, complex) Communications  Cable, Wireless Actions  Send, Read, Play

19. 1923.12.2005MeMoML: david.baechler@unifr.ch MeMoML Example 

20. 2023.12.2005MeMoML: david.baechler@unifr.ch MeMoEngine identify objects ensure communication processes execute actions, described in the scenario (with MeMoML)

21. 2123.12.2005MeMoML: david.baechler@unifr.ch MeMoEngine Physical level  PC with several devices attached Configuration file for all devices  formal description of the device  location information (path)  communication capabilities CD player, beamer, video player, …

22. 2223.12.2005MeMoML: david.baechler@unifr.ch MeMoEngine Example 

23. 2323.12.2005MeMoML: david.baechler@unifr.ch MeMoEngine Functioning of the MeMoEngine 1. Configuration 2. Use of MeMoML 3. Create scenario + + = slideshow holidaymusicpictures

24. 2423.12.2005MeMoML: david.baechler@unifr.ch MeMoML-GUI facilitate the interaction with the MeMoML language  The MeMoML code is created “behind the scene” Result: the person receives the pictures of the slideshow send Business card Seashell + Pictures

25. 2523.12.2005MeMoML: david.baechler@unifr.ch Schema

26. 2623.12.2005MeMoML: david.baechler@unifr.ch Schema

27. 2723.12.2005MeMoML: david.baechler@unifr.ch

28. 2823.12.2005MeMoML: david.baechler@unifr.ch

29. 2923.12.2005MeMoML: david.baechler@unifr.ch

30. 3023.12.2005MeMoML: david.baechler@unifr.ch

31. 3123.12.2005MeMoML: david.baechler@unifr.ch

32. 3223.12.2005MeMoML: david.baechler@unifr.ch

33. 3323.12.2005MeMoML: david.baechler@unifr.ch Further information Omar Abou Khaled (Supervisor EIA)  omar.aboukhaled@hefr.ch Elena Mugellini (Assistant EIA)  elena.mugellini@hefr.ch Denis Lalanne (Unifr)  denis.lalanne@unifr.ch Questions? Website: MeModules homepage (coming soon)