1. Team: Thomas Bartoschek, Gerald Pape, Jim Jones, Christian Kray, Tomi Kauppinen Gestural Interaction with Spatiotemporal Linked Open Data PiLOD. Amsterdam, The Netherlands. jim.jones@uni-muenster.de

2. Name: Jim Jones Gestural Interaction with Spatiotemporal Linked Open Data 2 Our goal: To make any public information about the university available in machine-readable formats for easy access and reuse. - Publications; - Cafeteria menus; - … http://lodum.de

3. Name: Jim Jones Gestural Interaction with Spatiotemporal Linked Open Data 3 LIFE is a two-year project funded by the German Research Foundation (DFG). - Meta Search: Institute for Urban History; - Semantic Annotation and Georeferencing for Historic Maps … http://lodum.de/life/

4. Name: Jim Jones Agenda Motivation Application Dataset Creation Gesture-based Approach Approach Evaluation Conclusion Future Work Gestural Interaction with Spatiotemporal Linked Open Data 4

5. Name: Jim Jones Gestural Interaction with Spatiotemporal Linked Open Data 5

6. Name: Jim Jones Gestural Interaction with Spatiotemporal Linked Open Data 6

7. Name: Jim Jones Deforestation decreasing... 2004: 27.423 km² 2012: 4.571 km² (Awesome!) Gestural Interaction with Spatiotemporal Linked Open Data 7 Known Issues  Data produced queued for analysis (Huge amounts)  Hard to visualize  Hard to correlate the produced data with external variables.

8. Name: Jim Jones Motivation Gestural Interaction with Spatiotemporal Linked Open Data 8 How to efficiently correlate the deforestation phenomena with external variables? How to effectively communicate it to the population?

9. Name: Jim Jones Triangle of Sustainability ● Wissenschaft Interaktiv 2012 (Interactive Science) ● Awarded with €10k for developing the project ● 4 weeks for development! Gestural Interaction with Spatiotemporal Linked Open Data 9 Linked Open Data!

10. Name: Jim Jones Why Linked Data? (In 1 minute) Gestural Interaction with Spatiotemporal Linked Open Data 10

11. Name: Jim Jones The Web Gestural Interaction with Spatiotemporal Linked Open Data 11 Awesome Discoverability! But just for humans :(

12. Name: Jim Jones Semantics Gestural Interaction with Spatiotemporal Linked Open Data 12 ? The forbidden fruit Xxx xxxx x xxxx xxx xxxx Xxx xxxxxxx xx x x xxxxxxxx. Cheers, -God ● What is the article about? ● Who is the author? ● What is inside the picture? ● Where, when and by whom was the picture taken? ●...

13. Name: Jim Jones Direct benefits of Linked Open Data Gestural Interaction with Spatiotemporal Linked Open Data 13 Attaches meaning to data Allows efficient thematic searches (e.g. person, company, city, book, etc.) Links different kinds of datasets making the WORLD a single big repository! Private data and public data can be mixed, enabling companies and individuals to make better decisions and generate innovations. My Repository

14. Name: Jim Jones Gestural Interaction with Spatiotemporal Linked Open Data 14 Where to get the data?

15. Name: Jim Jones Creating Dataset... Gestural Interaction with Spatiotemporal Linked Open Data 15 “todos têm direito a receber dos órgãos públicos informações de seu interesse particular, ou de interesse coletivo ou geral, que serão prestadas no prazo da lei, sob pena de responsabilidade, ressalvadas aquelas cujo sigilo seja imprescindível à segurança da sociedade e do Estado”. Lei Nº 12.527, November 18th, 2011 http://www.planalto.gov.br/ccivil_03/_Ato2011-2014/2011/Lei/L12527.htm

16. Name: Jim Jones Creating Dataset... Gestural Interaction with Spatiotemporal Linked Open Data 16 Deforestation Soybeans Crops Cattle GDP Population Brazilian Municipalities' Area Downloads data from IBGE Servers Creates Triples Linked Brazilian Rainforest Dataset

17. Name: Jim Jones Dataset Vocabularies Time and Space Core Vocabulary (TISC) http://observedchange.com/tisc/ns-20110511/ Open Linked Amazon Vocabulary (OLA) http://observedchange.com/amazon/ns/ Gestural Interaction with Spatiotemporal Linked Open Data 17 Spatiotemporal Dataset ● Aggregated in grid cells of 25km x 25km ● Time-series 2004 - 2009

18. Name: Jim Jones Motivation (Recap...) Gestural Interaction with Spatiotemporal Linked Open Data 18 How to efficiently correlate the deforestation phenomena with external variables? How to effectively communicate it to the population? Gestural Interaction with Virtual Globes!

19. Name: Jim Jones Gestural Interaction with Spatiotemporal Linked Open Data 19 Enviroment Economy Society Correlated with Deforestation Data!

20. Name: Jim Jones Gestural Interaction with Spatiotemporal Linked Open Data 20

21. Name: Jim Jones Gestures Gestural Interaction with Spatiotemporal Linked Open Data 21 pan zoom in / out time travel

22. Name: Jim Jones Video ( +1 minute) http://www.youtube.com/watch?v=Jjzj84R1Tgc Gestural Interaction with Spatiotemporal Linked Open Data 22

23. Name: Jim Jones Evaluating the Approach Gestural Interaction with Spatiotemporal Linked Open Data 23

24. Name: Jim Jones Evaluation Procedure and Material 5- 8 Minutes usage Questionnaire with 28 questions in two groups: 1 group: demographic information e.g. gender, age, primary hand, familiarity with gesture control interfaces 2 group: Task Load (NASA TLX – Task Load Index). Rating how well gestures and map actions fit together, from 0 to 20. e.g. In which scale you define the mental or physical workload for the gestures? No reward! Gestural Interaction with Spatiotemporal Linked Open Data 24

25. Name: Jim Jones Test Group Participants: 43 28 male 15 female Youngest : 10 Oldest: 59 Left handed: 7 Right handed: 36 Familiarity with gesture-based interfaces: Familiar: 19 Unfamiliar: 24 Gestural Interaction with Spatiotemporal Linked Open Data 25

26. Name: Jim Jones Results Gestural Interaction with Spatiotemporal Linked Open Data 26

27. Name: Jim Jones Observations Most participants reported the gestures as mentally challenging in the first minutes Older people found the system very accessible, particularly when compared with their first time using a mouse. User recognition gets considerably affected when bystanders are ‘seen’ by the Kinect sensor. Gestural Interaction with Spatiotemporal Linked Open Data 27

28. Name: Jim Jones Software Gestural Interaction with Spatiotemporal Linked Open Data 28 Virtual Globe (UI) LOD Processing Gestures (Kinect) https://github.com/giatschool/triangle-of-sustainability

29. Name: Jim Jones Hardware Gestural Interaction with Spatiotemporal Linked Open Data 29

30. Name: Jim Jones Try it yourself! Gestural Interaction with Spatiotemporal Linked Open Data 30 NASA World Wind SDK Tutorial Getting started with the Java API and LOD application examples. http://ifgi.uni-muenster.de/worldwind-tutorial/ Linked Brazilian Amazon Rainforest Data Getting familiar to the LBARD dataset. http://linkedscience.org/tutorials/exploring-the-linked-brazilian-amazon-rainforest- data/http://linkedscience.org/tutorials/exploring-the-linked-brazilian-amazon-rainforest- data/

31. Name: Jim Jones Triangle on Tour! SBPC Science Fair Recife (August, 2013) KIT-Alumini Club Seminar Recife (September,2013) GeoCamp Campos do Jordao (November, 2013) Ecogerma Belém (November, 2013) Gestural Interaction with Spatiotemporal Linked Open Data 31

32. Name: Jim Jones Conclusion The triangle provides an attractive and easy to use solution for displaying spatiotemporal LOD. It has a high acceptance in class-rooms (Already presented in many German schools) Participants were able to learn how to use 3 gestures without excessive workload. Linked Data offers a good bases for efficiently connecting deforestation data with external variables. Gestural Interaction with Spatiotemporal Linked Open Data 32

33. Name: Jim Jones Future Work Improve registration gestures Inefficient when more than one person is in front of the sensor Try different Kinect frameworks. Enable registration by children (short people) Minimum arm length problem. Gestural Interaction with Spatiotemporal Linked Open Data 33

34. Name: Jim Jones Gestural Interaction with Spatiotemporal Linked Open Data 34

35. Name: Jim Jones Gestural Interaction with Spatiotemporal Linked Open Data 35 Muito obrigado. Danke Schön. Kiitos. Dziękuję bardzo. Thank you!

36. Name: Jim Jones Gestural Interaction with Spatiotemporal Linked Open Data 36 Comments? Questions?