1. US-Korea Joint Workshop on Digital Libraries1 Paul Gorman, MD Lois Delcambre, PhD David Maier, PhD www.cse.ogi.edu/footprints

2. US-Korea Joint Workshop on Digital Libraries2 Bundles in the wild……….. Observational team: Paul Gorman Joan Ash Mary Lavelle Jason Lyman …………..Bundles in captivity Computer science team: Lois Delcambre Dave Maier Shawn Bowers Longxing Deng Mathew Weaver

3. US-Korea Joint Workshop on Digital Libraries3 Let’s take a trip to the ICU

4. US-Korea Joint Workshop on Digital Libraries4 (Wild) Bundles

5. US-Korea Joint Workshop on Digital Libraries5 (Wild) Bundles manage information for diverse, complex tasks contain selected, collected, structured, annotated are often used in settings with: –high uncertainty –low predictability –potentially grave outcomes –time & attention are highly constrained

6. US-Korea Joint Workshop on Digital Libraries6 (Wild) Bundles There is benefit in creating (active processing of information) There is benefit in reusing (trigger memory) There is benefit in sharing (establish collective, situated awareness)

7. US-Korea Joint Workshop on Digital Libraries7 Given…. bundles are everywhere! access to bundles provides access to important information information in bundles is often copied from other information sources we can keep copied/referenced information linked through the use of marks

8. US-Korea Joint Workshop on Digital Libraries8 SLIMPad demo

9. US-Korea Joint Workshop on Digital Libraries9 Research: Use “Digital Duct Tape” 1992 bird sightings at National Park 1995 migration patterns of two particular species (painstakingly identified species for bird sightings) study 2000 you need a survey of all species - for a biodiversity study the classification of the species of the bird sightings are gone!

10. US-Korea Joint Workshop on Digital Libraries10 Goal: Reuse Human Attention The original bird sightings Two species identified (pink & black)

11. US-Korea Joint Workshop on Digital Libraries11 Goal: Reuse Human Attention Black bird sightings Pink bird sightings Other species

12. US-Korea Joint Workshop on Digital Libraries12 When you can’t modify the base data: use superimposed information Two species identified (pink & black) pink birds black birds

13. US-Korea Joint Workshop on Digital Libraries13 Superimposed Information SuperimposedLayer BaseLayer Information Source 1 Information Source 2 Information Source n … marks

14. US-Korea Joint Workshop on Digital Libraries14 Current Activities developing the architecture for SLIM extending the bundle/scrap model testing and optimizing the metamodel & mappings beginning a NSF project with US Forest Service to provide access to forest information building a tool that might support a medical task

15. US-Korea Joint Workshop on Digital Libraries15 end of talk

16. US-Korea Joint Workshop on Digital Libraries16 (CS Team) Plans  “Schema” for bundles: through templates that predefine certain bundles and labels, and possibly predefine scraps. less restrictive than trad. schema.  Sharing: a bundle that belongs to multiple pads, a pad with multiple simultaneous users, and interchange of pads and bundles between users.  “Scoping” of base layers and marks over those layers. There are several general issues for modeling and management of superimposed information that have emerged from this work and other efforts.

17. US-Korea Joint Workshop on Digital Libraries17 (CS Team) Plans (cont.)  Distribution: more than a single mark manager. Is there a single space of marks or must applications keep track of which manager handles a particular mark?  Mark Maintenance:when base layer changes  New Kinds of Sources and Marks: beyond XML, PDF, MS Word, MS Excel, MS PowerPoint and HTML. We are also interested in marks into a “base” layer that is actually superimposed information for another application.  Application Interface: try a more query-like API. Also, consider an API generator Superimposed Information Mapping/Conversion: applying and extending our metamodel.

18. US-Korea Joint Workshop on Digital Libraries18 www.cse.ogi.edu/footprints demos - including the QTVR of the ICU (with toys) and SLIMPad personnel project description papers –“Bundles in the Wild: Tools for Managing Information to Maintain Situation Awareness” –“Bundles in Captivity: An Application of Superimposed Information” –papers discussing superimposed information

19. US-Korea Joint Workshop on Digital Libraries19 (Wild) Bundles

20. US-Korea Joint Workshop on Digital Libraries20 (Wild) Bundles

21. US-Korea Joint Workshop on Digital Libraries21 (Wild) Bundles

22. US-Korea Joint Workshop on Digital Libraries22 The superimposed and base layers with marks Superimposed Layer Base Layer Information Source 1 Information Source 2 Information Source n … marks

23. US-Korea Joint Workshop on Digital Libraries23 The architecture for managing SLIMPad’s superimposed information. Superimposed Information Management SLIMPad Java Objects (ActiveX) SLIMPad API (ActiveX) TRIM Store (Java) RDF Triples creates and maintains

24. US-Korea Joint Workshop on Digital Libraries24 (Captive) Bundles SLIMPad - a scratchpad application to create bundles but….with referenced information connected to the underlying source data helping us explore architectural issues for building superimposed applications motivating definition of a metamodel to represent information with mappings to transform inspired by the observational work (but not focused on a specific medical task)

25. US-Korea Joint Workshop on Digital Libraries25 The SLIMPad Architecture XML Viewer user MS Power Point MS Excel IE Explorer XML Documents PPT Files Excel Spreadsheets Web Pages Superimposed Information Management Mark Management Generic Technology PDF Viewer PDF files SLIMPad

26. US-Korea Joint Workshop on Digital Libraries26 Topic Map Example PaintingPainter by painter Influenced by “Captive”“Paul Klee” by painter influenced by “Francisco de Goya” “1914” by painter mentioned biographyreferenced http://... biography http://... critiqued mentioned http://...

27. US-Korea Joint Workshop on Digital Libraries27 Generic Representation of Information Topic Map Topic Map Defintions Topic Map Instances XML DTD XML Document Metamodel Superimposed Layer Basic Set of Abstractions Model Constructs and Relationships Schema-Level Data Instance-Level Data

28. US-Korea Joint Workshop on Digital Libraries28 Portion of Structured-Map Model as RDF (instanceOf, “TopicType”, Construct) (instanceOf, “TopicInstance”, Construct) (instanceOf, “ttypename”, Connector) (domain, “ttypename”, TopicType) (range, “ttypename”, String) (domainMult, “ttypename”, “*”) (rangeMult, “ttypename”, “1”) (instanceOf, “topic_instOf”, Conformance) (domain, “topic_instOf”, TopicInstance) (range, “topic_instOf”, TopicType) (domainMult, “topic_instOf”, “*”) (rangeMult, “topic_instOf”, “1”) TopicType ttypename : String TopicInstance * 1 > topic_instOf

29. US-Korea Joint Workshop on Digital Libraries29 (instanceOf, “painting_tt”, TopicType) (ttypename, “painting_tt”, “painting”) (instanceOf, “painter_tt”, TopicType) (ttypename, “painter_tt”, “painter”) (instanceOf, “byPainter_rt”, TopicRelType) (relType, “byPainter_rt”, “by painter”) (topicType1, “byPainter_rt”, painting_tt) (topicType2, “byPainter_rt”, painter_tt) (instanceOf, “biography_at”, AnchorType) (anchorRole, “biography_at”, “biography”) (topicType, “biography_at”, painter_tt) Representing Schema Topic Types (schema): painting, painter Topic Rel Types (schema): by painter Anchor Types (schema): biography paintingpainter by painter biography

30. US-Korea Joint Workshop on Digital Libraries30 Representing Instance (instanceOf, “painter1”, TopicInstance) (title, “painter1”, “Paul Klee”) (topicInsID, “painter1”, “5”) (topic_instOf, “painter1”, painter_tt) (instanceOf, “painting1”, TopicInstance) (title, “painting1”, “Captive”) (topicInsID, “painting1”, “19”) (topic_instOf, “painting1”, painting_tt) (instanceOf, “byPainter1”, TopicRelInst) (rel_instOf, “byPainter1”, byPainter_rt) (topicIns1, “byPainter1”, painting1) (topicIns2, “byPainter1”, painter1) (instanceOf, “biography1”, AnchorInst) (anchor_instOf, “biography1”, biography_at) (address, “biography1”, a1) (instanceOf, “a1”, Address) (markID, “a1”, “URLMarkManager@954308545”) Topic Instances (instance): Paul Klee, Captive Topic Relationship (instance): a by painter relationship Anchor (instance): a biography anchor Address (instance): mark to url

31. US-Korea Joint Workshop on Digital Libraries31 Three Basic Types of Mappings Model 1 Schema 1 Instances 1 SourceTarget Mapped Converted Mapped Converted Mapped Converted Inter-Model Inter-Schema Model-to- Schema Model 2 Schema 1 Instances 1 Model 1 Schema 1 Instances 1 Model 1 Schema 1 Instances 1 Model 1 Schema 2 Instances 1 Model 2 Schema 2 Instances