1. Distance university of Hagen, Germany Chair of Multimedia and Internet Applications Univ.-Prof. Dr.-Ing. Matthias Hemmje. Authors: Paul Landwich Tobias Vogel Claus-Peter Klas Matthias Hemmje Supporting Patent Retrieval in the Context of Innovation Processes by means of Information Visualization

2. Outline Motivation – Distributed Patent Searching Phases – A Real World Patent Searching Scenario – Challenges Selection from State of the Art in Visual IR Selected Information Visualization Techniques Towards Integrated Scenarios Outlook

3. Patent Search Scenario

4. DPMA and DEPATISnet

5. http://depatisnet.dpma.de

6. Search

7. Form-based Query Construction

8. Result Overview in Tables

9. Patents and Languages

10. Detail Inspection, Meta-Data

11. Detail Inspection, Content

12. Only initial page as.pdf file

13. Original patent document locked, but free of charge

14. Download of complete patent

15. Advanced Query Construction

16. Clusters and Control

17. Query refinement? Dialogue Control?

18. Relevance Feedback?

19. Results - old, new, duplicates?

20. Cross-Referencing and Background?

21. Cognitive Aspects of IR Author, Decide, or Act Problem- solve Forage for Data Search for Schema Instantiate Schema Overview Zoom Details-on- demand Browse Search query Reorder Cluster Class Average Promote Detect pattern Abstract Instantiate USER Extract Compose Task Read fact Read comparison Read pattern Manipulate Create Delete [Car99]

22. Human Computer Interaction Aspects [Hem99]

23. Architectural Aspects [Car99]

24. Challenges Distributed patent collections Query Construction Result Integration and Presentation Visual Support w.r.t. Information Behaviours Dialogue and Context Management Selection and Configuration of Visualization Methods supporting External Cognition Tight Cognitive Coupling of IVIS Techniques in IR User Interfaces

25. Information Visualization „As if they say half your brain is your eyes why not use this half?“ [InXi] The visual presentation, perception and handling of information were considered for a long time [Lar87] as an efficient communication method for informational situations - 25 - 9.11.2007IRFS 2007 Vienna

26. Information Visualization in IR (I) Result presentation in GUIDO [Kor91] - 26 - IRFS 2007 Vienna9.11.2007

27. Information Visualization in IR (II) Result presentation in VIBE [Kor91] - 27 - IRFS 2007 Vienna9.11.2007

28. Information Visualization in IR (I) Query construction and reformulation in InfoCrystal [Spo93] - 28 - IRFS 2007 Vienna9.11.2007

29. IRFS 2007 Vienna9.11.2007 Cross-Referencing in Butterfly [Mac95] IVIS Techniques for Document Collections (I)

30. IRFS 2007 Vienna9.11.2007 Focus+Context Technique Based on Hyperbolic Geometry [Lam95] in Hyperbolic Tree Browsers IVIS Techniques for Document Collections (II)

31. IRFS 2007 Vienna9.11.2007 Visualizing Collections in Beads 2-D [Cha94] IVIS Techniques for Document Collections (III)

32. IRFS 2007 Vienna9.11.2007 Result presentation in Categorical and hierarchical axes [Shn00] IVIS Techniques for Document Collections (IV)

33. IRFS 2007 Vienna9.11.2007 Result presentation in VisMeB [Mue03] IVIS Techniques for Document Collections (IV)

34. Work/Apllicatoin Context management - 34 - IRFS 2007 Vienna9.11.2007 DLESE [Dav06] Contextualizing Information (I)

35. Search History Context - 35 - IRFS 2007 Vienna9.11.2007 West Group [Kom06] Contextualizing Information (II)

36. Animation for interaction in IR dialogue context (e.g. relevance feedback)‏ - 36 - IRFS 2007 Vienna9.11.2007 XRF-Interface [Har06] Contextualizing Information (III)

37. Interactive IR User Interfaces with Tight Coupling of IVIS Techniques Supporting a Distributed Search Context - 37 - IRFS 2007 Vienna9.11.2007 Daffodil [Kla05] Contextualizing Information (IV)

38. Interactive Information Behaviours

39. IRFS 2007 Vienna9.11.2007 Goal: Supporting Cognitive Coupling of IR and Visual UI Information Context

40. IRFS 2007 Vienna9.11.2007 Problem Knowledge Informations deficit Stored knowledge Information need Presented knowledge Represented knowledge Query CognitionAdjustmentDiscovery Core IR-Engine Cognitive-oriented Access User Interface Level 1. State (concrete)‏ 2. State (uncertain)‏ 3. State (fuzzy)‏ Approach: Cognitive Enhanced Model of Information Access Human [Lan07]

41. External Cognition Support by Visual Coupling of Interaction Context IRFS 2007 Vienna9.11.2007

42. Outlook Aiming at systems providing integrated tools for effective and efficient IR with context support Adaptation to the patent domain Adding of visual mappings to all phases Enhancing interactive information behaviours through supporting external cognition

43. References (I) [Car99] STUART K. CARD, JOCK D. MACKINLAY, BEN SHNEIDERMAN Readings in Information Visualization. San Francisco: Morgan Kaufmann (1999) [Cha94] MATHEW CHALMERS: Design Perspectives in Visualising Complex Information. In Böcker, H.-D., Hemmje, M. (eds.): Arbeitspapiere der GMD Nr. 909, Gesellschaft für Mathematik und Datenverarbeitung, Sankt Augustin (1994) [Dav06]LYNNE DAVIS Designing a search user interface for a digital library. J. Am. Soc. Inf. Sci.Technol., 57(6):788–791, 2006. [Har06]DAVID J. HARPER AND DIANE KELLY Contextual relevance feedback. In IIiX: Proceedings of the 1st international conference on Information interaction in context, pages 129–137, New York, NY, USA, 2006. ACM Press. [Hem99] MATTHIAS HEMMJE Unterstützung von Information-Retrieval-Dialogen mit Informationssystemen durch interaktive Informationsvisualisierung. Dissertation. Darmstadt: TU Darmstadt (1999). [Kla05]CLAUS-PETER KLAS, SASCHA KRIEWEL, ANDRÉ SCHAEFER, AND GUDRUN FISCHER Das Daffodilsystem - Strategische Literaturrecherche in digitale Bibliotheken. In 4.ter HIER Workshop. UVK, 2005. - 43 - 9.11.2007IRFS 2007 Vienna

44. - 44 - IRFS 2007 Vienna9.11.2007 [Kom06]ANITA KOMLODI, DAGOBERT SOERGEL, AND GARY MARCHIONINI Search histories for user support in user interfaces. J. Am. Soc. Inf. Sci. Technol., 57(6):803–807, 2006. [Kor91] ROBERT R. KORFHAGE : To See or Not to See: Is that the Query. In: Proceedings of SIGIR '91, The Fourteenth Annual International ACM-SIGIR Conference on Research and Development in Information Retrieval, New York: ACM Press (1991). [InX]http://www.inxight.com/ [Lam95]JOHN LAMPING, RAMANA RAO, AND PETER PIROLLI A focus+context technique based on hyperbolic geometry for visualizing large hierarchies. In CHI ’95: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 401–408, New York, 1995. ACM Press/Addison-Wesley Publishing Co. [Lan07]PAUL LANDWICH, NORBERT FUHR AND MATTHIAS HEMMJE Ansatz zu einem konzeptionellen Modell für interaktive Information-Retrieval-Systeme mit Unterstützung von Informationsvisualisierung, In Open Innovation, pages 327- 332, Köln, 2007 References (II)

45. - 45 - IRFS 2007 Vienna9.11.2007 [Lar87]JILL H. LARKIN AND HERBERT A. SIMON Why a diagram is (sometimes) worth ten thousand words. Cognitive Science, 11:65– 100, 1987. [Mac95] JOCK D. MACKINLAY, RAMANA RAO, STUART K. CARD: An Organic User Interface for Searching Citation Links. Proceedings of SIGCHI '95, Conference on Human Factors in Computing Systems, New York: ACM Press (1995) [Mue03]F. MÜLLER, P. KLEIN, T. LIMBACH, AND H. REITERER. Visualization and interaction techniques of the visual metadata browser vismeb. In I-Know, 2003. [Shn00]BEN SHNEIDERMAN, DAVID FELDMAN, ANNE ROSE AND XAVIER FERRÉ GRAU Visualizing digital library search results with categorical and hierarchical axes. In Proceedings of the fifth ACM conference on Digital libraries, pages 57–66, New York, NY, USA, 2000. ACM Press. [Spo93]ANSELM SPOERRI Infocrystal A visual tool for information retrieval & management. In Bharat K. Bhargava, Timothy W. Finin, and Yelena Yesha, editors, In Proceedings of the Second International Conference on Information and Knowledge Management, pages 11–20, Washington DC, USA, November 1 - 5 1993. ACM. References (III)