1. Mark Weal Auld Linky and the AKT - EQUATOR Bridge

2. Auld Linky Auld Linky (Leaky) is a contextual structure (link) server Serves FOHM structures Uses XML representations of linkbases Query via pattern matching Results are filtered by context

3. FOHM Navigational Structure

4. Context Context objects can be attached at any point on the FOHM structure They are simple lists of key/value pairs A Context Object can also be attached to a query

5. SRCDEST Link

6. SRCDEST Link

7. SRCDEST Link

8. SRCDEST Link

9. Applications : Glasgow Servlet Generates a dynamic document about the History of Glasgow Based on user interests (e.g. Government, Culture) Inspired by the beginning of Vee’s trip to Glasgow

10. Applications : Glasgow Servlet 132 Tour (list) 13 text 2 LoD (list) 1 text 2 LoD (list) 13 text 2 LoD (list)

11. Applications : Glasgow Servlet 132 Tour (list) 13 text 2 LoD (list) 1 text 2 LoD (list) 13 text 2 LoD (list)

12. Applications : Glasgow Servlet 132 Tour (list) 13 text 2 LoD (list) 1 text 2 LoD (list) 13 text 2 LoD (list)

13. Applications : Glasgow Servlet 132 Tour (list) 1 text 2 LoD (list) 13 text LoD (list)

14. Applications : Glasgow Servlet 132 Tour (list) 1 text 2 LoD (list) 13 text LoD (list)

15. Applications : City Project Linky is being used to store the information behind the City Project Using three structures : –Explanations –Transitions –Tours Use Glasgow’s Recer to recommend transitions (goal driven vs. narrative smoothing)

16. Applications : City Project

17. Problem is that the story structure is static The narrative is determined by a fixed tour of alternative fragments Tells the same story in different ways Narrative needs to be more dynamic Telling different stories in different ways Applications : Short Story Engine

18. CGI based Hypertext Story Engine Constructs short stories for the reader on the fly It maintains a user profile, in the form of a context, that it uses to find the next appropriate story fragment Readers move through the story with their context being modified by what they read. Thus we enable some form of narrative structure over otherwise loosely coupled story fragments

19. Short Story Structures

20. SRCDEST Story Fragment Link SRCDEST Story Fragment Link SRCDEST Story Fragment Link SRCDEST Story Fragment Link SRCDEST Story Fragment Link SRCDEST Story Fragment Link

21. SRCDEST Story Fragment Link SRCDEST Story Fragment Link SRCDEST Story Fragment Link SRCDEST Story Fragment Link SRCDEST Story Fragment Link SRCDEST Story Fragment Link

22. SRCDEST Story Fragment Link SRCDEST Story Fragment Link SRCDEST Story Fragment Link SRCDEST Story Fragment Link SRCDEST Story Fragment Link SRCDEST Story Fragment Link

23. SRCDEST Story Fragment Link SRCDEST Story Fragment Link SRCDEST Story Fragment Link

24. On the Bridge Dave in Hawaii

25. Southampton Aberdeen Edinburgh Open University Sheffield

26. The Knowledge Lifecycle

27. Why the synergy? Philosophically - Knowledge representation is part of the digital world & knowledge capture crosses the physical- digital divide Practically - Equator activities have metadata and knowledge requirements, e.g. –recording a trail –capturing data from Cliff’s devices –annotation –expressing context –modelling users’ interests –interoperability of system components AKT is conducting Technology Integration Experiments

28. The O-Word There is a role for ontologies, for –Interoperability Ontologies provide shared vocabularies necessary for common understanding (of content, events, services, profiles, …) –Inference Ontologies can include axioms/rules, which enable inference AKT has expertise in all aspects of ontologies and the tools for working with them

29. Bridge construction Dave and Wendy are members of both projects, Richard Beales is jointly supervised PhD student Monthly joint ‘Equaktor’ research discussions plus additional meetings for projects on the bridge Has resulted in three research activities: –Artequakt –Knowledgeable Devices –CoAKTing Also cofunded visit by Ted Nelson

30. ARTEQUAKT ARTiste, EQUator, AKT Artiste – European project on an integrated art analysis and navigation environment Advanced Knowledge Technologies – IRC on building and maintaining knowledge

31. ARTEQUAKT Artiste provides a large store of images and associated metadata AKT meta-data mines the web and dynamically fills ontologies of information about the images Equator processes those ontologies, creating dynamic narratives about the paintings (initially we are working on artists’ biographies)

32. What is a Narrative? Fabula Story Narrative

33. What is a Narrative? Fabula Story Narrative Story Narrative

34. What is a Narrative? Fabula Story Narrative Story Narrative

35. What is a Narrative? Fabula Story Narrative Story Narrative TemplateOntology Implementation Narrative HTML

36. Templates Specified as XML FOHM structures Story fragments are stored as queries into the ontology Some have original stored sentences, others need to have sentences constructed using NL techniques Each story ‘section’ (e.g. Introduction) has several forms according to the information in the ontology

38. 1 Level of Detail (LoD) 2 1 2 1 LoD 212 Intro paragraph : DOB + place Sequence

39. 1 Level of Detail (LoD) 2 1 2 1 LoD 212 Intro paragraph : DOB + place Rembrandt Harmenszoon van Rijn was born on July 15, 1606, in Leiden, the Netherlands. His father was a miller who wanted the boy to follow a learned profession, but Rembrandt left the University of Leiden to study painting. Paragraph with DOB and Place Best option is to have one paragraph that contains both pieces of information Sequence

40. 1 Level of Detail (LoD) 2 Sequence 1 2 1 LoD 212 Intro paragraph : DOB + place Otherwise need a sequence of two fragments. This first one deals with date of birth

41. 1 Level of Detail (LoD) 2 Sequence 1 2 1 LoD 212 Intro paragraph : DOB + place The greatest artist of the Dutch school, Rembrandt Harmenszoon van Rijn, was born on July 15, 1606. Paragraph with DOB Otherwise need a sequence of two fragments. This first one deals with date of birth Best option here is to have a paragraph containing the date of birth

42. 1 Level of Detail (LoD) 2 Sequence 1 2 1 LoD 212 Intro paragraph : DOB + place Constructed sentence: Rembrandt was born on July 15, 1606. DOB Otherwise need a sequence of two fragments. This first one deals with date of birth Otherwise need to construct the sentence out of raw facts

43. 1 Level of Detail (LoD) 2 1 2 1 LoD 212 Intro paragraph : DOB + place Otherwise need a sequence of two fragments. This second one deals with place of birth Sequence

44. 1 Level of Detail (LoD) 2 1 2 1 LoD 212 Intro paragraph : DOB + place Otherwise need a sequence of two fragments. This second one deals with place of birth Best option here is to have a paragraph containing the place of birth He was born in Leiden, the Netherlands and went on to become a giant in the history of art. Paragraph with Place Sequence

45. 1 Level of Detail (LoD) 2 1 2 1 LoD 212 Intro paragraph : DOB + place Otherwise need a sequence of two fragments. This second one deals with place of birth Otherwise need to construct the sentence out of raw facts Constructed sentence: Rembrandt was born in Leiden, the Netherlands. Place Sequence

46. 1 Level of Detail (LoD) 2 1 2 1 LoD 212 Intro paragraph : DOB + place Now when we query the template with a profile saying what information we have, the parts of the template that are impossible to build are culled… Sequence

47. 1 Level of Detail (LoD) 2 1 2 1 LoD 212 Intro paragraph : DOB + place Now when we query the template with a profile saying what information we have, the parts of the template that are impossible to build are culled… Sequence

48. 1 Level of Detail (LoD) 2 1 2 1 LoD 212 Intro paragraph : DOB + place Now when we query the template with a profile saying what information we have, the parts of the template that are impossible to build are culled… Sequence

49. Level of Detail (LoD) 2 1 2 LoD 21 Intro paragraph : DOB + place Now when we query the template with a profile saying what information we have, the parts of the template that are impossible to build are culled…resulting in a finished sequence of sentences: Sequence

50. Level of Detail (LoD) 2 1 2 LoD 21 Intro paragraph : DOB + place Now when we query the template with a profile saying what information we have, the parts of the template that are impossible to build are culled…resulting in a finished sequence of sentences: Sequence Constructed sentence: Rembrandt was born on July 15, 1606. He was born in Leiden, the Netherlands and went on to become a giant in the history of art.

51. Knowledgeable devices Metadata meets devices –Devices to capture metadata, e.g. physical location, RFID tags, Cliff’s body device of the day, capturing annotations –Metadata is live and continuous Inference meets devices –Knowledge transferred when devices communicate –But distributed inference is an open issue

52. CoAKTing Bring knowledge technologies into computer mediated collaboration between smart spaces (physical and virtual) Extends knowledgeable devices into virtual environments Builds on continuous metadata work, e.g. link streams Grew out of early plans to exploit CVW on bridge

53. CoAKTing Originally conceived as joint AKT Equator project, CoAKTing is funded as 2 year AKT e- Science (led by DDeR) Southampton + Edinburgh (AIAI) + Open University (Knowledge Management Institute) + BT Exact In e-Science terms this is ‘next generation Access Grid’

55. Coartequaktoring Conclusion Early collaborations do appear to be mutually beneficial There is a problem staffing the bridge as both teams have plenty to do! Activity based in Southampton - in time we plan to feed skills through to the wider Equator project Equator medical devices e-Science activity could be a useful route to channel this CoAKTing will bring in other AKT partners

56. Web Site Details of all Southampton’s Equator work is available on our Equator website Details of the CityMack, Narrative and ArtEquAkt projects Contact Details Publications Presentations On-line Demos Auld Linky downloads www.equator.ecs.soton.ac.uk