1. HT MASH MAH AH SH MH Multi-model Adaptive Spatial Hypermedia Luis Francisco-Revilla Department of Computer Science Texas A&M University

2. 4 How effectively does the system function? 3 How was MASH instantiated? 5 What were the lessons learned? 1 What is Multi-model Adaptive Spatial Hypermedia? 2 What were the challenges in creating MASH?

3. 1 What is Multi-model Adaptive Spatial Hypermedia? 3 How was MASH instantiated? 2 What were the challenges in creating MASH? 4 How effectively does the system function? 5 What were the lessons learned?

4. 1 Spatial Hypermedia Multi-model Adaptive Spatial Hypermedia Multi-model Adaptive Hypermedia Adaptive Hypermedia Map-based Hypermedia MASH

5. 1 Spatial Hypermedia Multi-model Adaptive Spatial Hypermedia Multi-model Adaptive Hypermedia Adaptive Hypermedia Map-based Hypermedia MASH

6. 1 Hypermedia often provides a rigid presentation of the information Problem “Sometimes I want the link and sometimes I don’t” “I think these two objects might be related” HT MASH MAH AH SH MH

7. 1 Adaptive Hypermedia Personalize presentations Adapt presentation to multiple aspects Hypermedia Multi model Adaptive Hypermedia Adaptive Hypermedia User Model HT MASH MAH AH SH MH Task Model Situation Model Risk Model

8. 1 Multiple Independent Models Complexity and scalability Easier knowledge engineering Portability and reutilization Amortization of costs Privacy and distribution Control over personal models Not Very So-so Not So-so Very NotSo-soVery NotSo-soVery NotSo-soVery NotSo-soVery HT MASH MAH AH SH MH

9. 1 Spatial Hypermedia There was a need to know the context Due to their heavy use, maps became the primary interface Hypermedia Spatial Hypermedia Map based Hypermedia Aquanet VKB HT MASH MAH AH SH MH

10. 1 Spatial Hypermedia Objects are not restricted to represent documents (e.g. objects may represent chunks of information within a document) Navigational Hypertext Spatial Hypertext HT MASH MAH AHMH SH

11. 1 Spatial Hypermedia Navigational Hypertext Spatial Hypertext HT MASH MAH AHMH SH Objects are not restricted to represent documents (e.g. objects may represent chunks of information within a document)

12. 1 Spatial Hypermedia Navigational Hypertext Spatial Hypertext SH HT MASH MAH AHMH Objects are not restricted to represent documents (e.g. objects may represent chunks of information within a document)

13. 1 Spatial Hypermedia Users can interact with the information and see the effects of altering its structure Reflect “perceptually” vs. reflect “cognitively” HT MASH MAH AH SH MH

14. 1 MASH Spatial Hypermedia HT MAH AH SH MH Communication is via perceivable structures Systems use spatial parsers in order to develop a shared understanding of these structures User Back-end Processes

15. 1 Spatial Hypermedia HT MASH MAH AH SH MH In Web-based Spatial Hypermedia and Presentation Oriented Spatial Hypermedia, Readers and Authors are not the same person anymore

16. Spatial Hypermedia Multi-model Adaptive Spatial Hypermedia Multi-model Adaptive Hypermedia Adaptive Hypermedia Map-based Hypermedia 1 MASH

17. Spatial Hypermedia Multi-model Adaptive Spatial Hypermedia Multi-model Adaptive Hypermedia Adaptive Hypermedia Map-based Hypermedia 1 MASH

18. Spatial Hypermedia Multi-model Adaptive Spatial Hypermedia Multi-model Adaptive Hypermedia Adaptive Hypermedia Map-based Hypermedia 1 MASH

19. 4 3 5 1 2

20. 2 1543

21. Adaptation in Spatial Hypermedia Content Relational Spatial 3 2 1 4 5 6 3 2 1 6 1 2 APPROACH Suggestions Conflicts Classification

22. Suggestions Object Model 1 Bold, Increase size Models provide suggestions of how to adapt the information presentation Classification Conflicts Suggestions 2 APPROACH

23. Suggestions Object Model 1 Bold, Increase size Models provide suggestions of how to adapt the information presentation Classification Suggestions Conflicts 2 APPROACH

24. Methods and Techniques Object Model 1 Emphasize Since Adaptive Hypermedia, high-level methods are translated to low-level techniques Classification Suggestions Conflicts 2 APPROACH

25. Methods and Techniques Object Model 1 Emphasize Emphasize = Bold, Increase size In Spatial Hypermedia the number of techniques increases Since Adaptive Hypermedia, high-level methods are translated to low-level techniques Classification Suggestions Conflicts 2 APPROACH

26. Methods and Techniques Object Model 1 Emphasize Emphasize = Change border color, Increase border width In Spatial Hypermedia the number of techniques increases Since Adaptive Hypermedia, high-level methods are translated to low-level techniques Classification Suggestions Conflicts 2 APPROACH Object

27. Methods and Techniques Object Model 1 Emphasize Emphasize = Change background color, Increase font size In Spatial Hypermedia the number of techniques increases Since Adaptive Hypermedia, high-level methods are translated to low-level techniques Classification Suggestions Conflicts 2 APPROACH Object

28. Methods and Techniques Object Model 1 Emphasize by 1.5; 0.80 confidence In Spatial Hypermedia the number of techniques increases Since Adaptive Hypermedia, high-level methods are translated to low-level techniques Suggestions specify the adaptation method, its strength and the model’s confidence in the suggestion Classification Suggestions Conflicts 2 APPROACH Emphasize = Change background color, Increase font size Object

29. Conflict Management Model 2 Prevent from viewing Object Model 1 Emphasize Conflicts occur when multiple adaptations cannot be simultaneously represented ? Classification Suggestions Conflicts 2 APPROACH

30. Conflict Management Model 2 Prevent from viewing Object Model 1 Emphasize ? Managing conflicts is more than resolving conflicts Manage conflicts: Prevention Detection Resolution Classification Suggestions Conflicts Conflicts occur when multiple adaptations cannot be simultaneously represented 2 APPROACH

31. Conflict Prevention Augment medium expressiveness Dynamically map high-level methods low-level techniques Embrace ambiguity Model 1 Emphasize Model 2 Emphasize  Increase font size De-emphasize  Fade out De-emphasize Classification Suggestions Conflicts 2 APPROACH

32. Conflict Detection Conflict propagation Scope of conflicts Spatial parser Suggestion 1 Suggestion 2 It does not look like a list anymore! Classification Suggestions Conflicts Since the communication is via perceptible structures, when the structures break the communication breaks 2 APPROACH

33. Conflict Detection Conflict propagation Scope of conflicts Spatial parser Suggestion 1 Suggestion 2 Classification Suggestions Conflicts Since the communication is via perceptible structures, when the structures break the communication breaks 2 APPROACH Suggestion 1 Suggestion 2 New conflicts can be created

34. Conflict Resolution Merge suggestions Strategies: Weighted average Suggestion strength Suggestion confidence Model confidence Heuristic best Object Model 1: emphasize Model 2: de-emphasize Object average suggestions Classification Suggestions Conflicts 2 APPROACH

35. Determine mapping from adaptation methods to techniques Balancing author and reader control Specify mapping and resolution strategies Conflict Resolution emphasize Object emphasize Object emphasize Classification Suggestions Conflicts 2 APPROACH

36. Classification Suggestions Conflicts 2 APPROACH

37. 4 5 1 2 3

38. 5421 3

39. 3 SYSTEM WARP Multi-model Adaptive Spatial Hypermedia Executes in a Web-browser Novel features Transclusion links Personal readings Annotations Behaviors Process WARP

40. 3 SYSTEM Demo 1 WARP Behaviors Process Relationships: Explicit, Implicit, Transclusion Behaviors Online News Collections Commercial Web-page Transclusion, Import and Export

41. 3 SYSTEM Behaviors User actions and system adaptations can affect existing spatial structures Spatial parser identifies structures Behaviors can preserve spatial relationships WARP Process Behaviors

42. 3 SYSTEM Adaptation Process (1) Objects prior to adaptation WARP Behaviors Process Platform Parser Analyzer Transformer M1M1 M2M2 MnMn Models

43. 3 SYSTEM Adaptation Process (2) Inference of implicit structures WARP Behaviors Process Platform Parser Analyzer Transformer M1M1 M2M2 MnMn Models

44. 3 SYSTEM Adaptation Process (3) Context inference and conflict prevention WARP Behaviors Process Platform Parser Analyzer Transformer M1M1 M2M2 MnMn Models

45. 3 SYSTEM Adaptation Process (4) Suggestion of adaptations WARP Behaviors Process Platform Parser Analyzer Transformer M1M1 M2M2 MnMn Models

46. 3 SYSTEM Adaptation Process (5) Transformation and adaptations WARP Behaviors Process Platform Parser Analyzer Transformer M1M1 M2M2 MnMn Models

47. 3 SYSTEM Adaptation Process (6) Extended conflict detection WARP Behaviors Process Platform Parser Analyzer Transformer M1M1 M2M2 MnMn Models Conflict?

48. Platform Parser Analyzer Transformer 3 SYSTEM Adaptation Process (7) Alternative creation WARP Behaviors Process M1M1 M2M2 MnMn Models Alternatives

49. 3 SYSTEM Adaptation Process (8) Evaluation of alternatives WARP Behaviors Process Platform Parser Analyzer Transformer M1M1 M2M2 MnMn Models OK?

50. 3 SYSTEM Adaptation Process (9) Final adaptation WARP Behaviors Process Platform Parser Analyzer Transformer M1M1 M2M2 MnMn Models

51. WARP Behaviors Process 3 SYSTEM

52. 5 1 2 3 4

53. 5213 4

54. Objectives Comparative study Non-adaptive spatial hypermedia Multi-model adaptive spatial hypermedia Investigate the effects of adaptation in the process of reading spatial hypermedia Usability of the system 4 EVALUATION Qualitative Quantitative Experiment 3 2 1

55. Population 16 participants 18-40 years old From Texas A&M University and Bryan/College Station community Varying degrees of expertise (8 beginner, 8 advanced) Experiment Qualitative Quantitative 4 EVALUATION

56. Task Web designers for a non- profit organization Must author a Web page using a text editor in 90 minutes Requirements and evaluation metrics for the Web page Spatial hypertext about HTML as information support Experiment Qualitative Quantitative 4 EVALUATION

57. Evaluation Procedure 2:30 hours Interview10 minutes Completing the questionnaire about use of the system10 minutes Authoring Web page90 minutes Completing the HTML and XHTML questionnaire20 minutes Completing the computer and Web expertise questionnaire5 minutes Training in software tools (WARP and authoring environment)15 minutes ActivityTime Experiment Qualitative Quantitative 4 EVALUATION

58. Initial Interface (not adapted) Experiment Qualitative Quantitative 4 EVALUATION

59. Demo 2 Experiment Qualitative Quantitative Adaptation of the experiment’s interface 4 EVALUATION

60. User Model Initialization Experiment Qualitative Quantitative 4 EVALUATION

61. Initial interface (adapted for beginner) Experiment Qualitative Quantitative 4 EVALUATION

62. Initial Interface (adapted for advanced) Experiment Qualitative Quantitative 4 EVALUATION

63. Document Design Content Kennedy and Musciano “HTML & XHTML: The Definitive Guide” O’Reilley’s, 2002 Layout Encapsulate topics and subtopics Visually reflect the structure of the information Limited dynamic behaviors Adaptive behaviors Multiple visual cues – size, font size, glow, alpha blur, zooming Experiment Qualitative Quantitative 4 EVALUATION

64. Qualitative Results Gathered from observations, questionnaires, interviews and comments Emergent reading strategies Changes in reading behavior Experiment Quantitative Qualitative Results Spatial layouts Moving and rearranging Collections and bookmarks Informed link traversals Adaptation and reading 4 EVALUATION 5 3 1 4 2

65. Spatial Layouts Easy navigation of large information spaces Effective concept encapsulation Reflect information structure “I really like that I can see all of the chapters” Experiment Qualitative Results Quantitative 4 EVALUATION

66. Moving and Rearranging …to indicate what is being read or what has been read..to indicate “what is more important” …in order to “see both and compare” …“for reference” Experiment Qualitative Results Quantitative 4 EVALUATION

67. Collections and Bookmarks Maximizing sub-collections to bookmark sections Minimizing collections as “I’m done with that!” Experiment Qualitative Results Quantitative 4 EVALUATION

68. Informed Link Traversal Informed link traversal Browsing before committing to maximizing collections “You are not clicking on a bunch of links that may or may not have what you are looking for” Experiment Qualitative Results Quantitative 4 EVALUATION

69. Adaptation and Reading The adaptation changed the way people read Implementation guidelines: Using multiple visual cues Allow readers to maintain control of the process “What red glow?” Experiment Qualitative Results Quantitative 4 EVALUATION

70. Quantitative Results Assessments of the quality of the Web pages in regards to: Content Presentation Overall Scores computed according to pre-established metrics (provided to the users) Experiment Qualitative Results Quantitative Results 4 EVALUATION

71. ANOVA Significantly better for the Adaptive case Advanced users generated significantly better Web pages Possible interaction Overallp = 0.040 Contentp = 0.038 Presentationp = 0.142 Non-adaptive vs. Adaptive Overallp < 0.001 Contentp < 0.001 Presentationp < 0.001 Novice vs. Advanced Overallp = 0.103 Contentp = 0.109 Presentationp = 0.147 Expertise-Adaptation Interaction Experiment Qualitative Results Quantitative Results 4 EVALUATION

72. Expertise and Overall Scores Expertise vs. overall scores in the non-adaptive case Expertise = HTML knowledge * (1 + Previous knowledge) Experiment Qualitative Results Quantitative Results 4 EVALUATION

73. Expertise and Overall Scores Experiment Qualitative Results Quantitative Results Expertise vs. overall scores in the adaptive case 4 EVALUATION Expertise = HTML knowledge * (1 + Previous knowledge)

74. Expertise and Overall Scores Some clustering No significant correlation between expertise and score Experiment Qualitative Results Quantitative Results 4 EVALUATION Expertise = HTML knowledge * (1 + Previous knowledge)

75. Expertise and Overall Scores Experiment Qualitative Results Quantitative Results 4 EVALUATION Some clustering No significant correlation between expertise and score Expertise = HTML knowledge * (1 + Previous knowledge)

76. Experiment Qualitative Results Quantitative Results Expertise and Overall Scores 4 EVALUATION Some clustering No significant correlation between expertise and score Expertise = HTML knowledge * (1 + Previous knowledge)

77. Experiment Qualitative Results Quantitative Results Expertise and Overall Scores 4 EVALUATION Some clustering No significant correlation between expertise and score Expertise = HTML knowledge * (1 + Previous knowledge)

78. Experiment Qualitative Results Quantitative Results 4 EVALUATION

79. 4 1 2 3 5

80. 4213 5

81. Future work Lessons learned 5 CONCLUSIONS Conclusions Spatial Hypermedia supports the navigation of very large information spaces Adaptive Spatial Hypermedia enhances the users’ ability to find the right information Adaptation in Spatial Hypermedia is more elaborate than in Navigational Hypermedia Adaptation affects the process of reading in Spatial Hypermedia The use multiple independent models in the adaptation process is feasible and facilitates aspects such as authoring, reuse and distribution 5 3 1 2 4

82. Lessons learned Future work Future Work CSCW implications Mixed media and dynamic presentations Interface for back-end systems: Software engineering Interface for digital libraries and search engines 5 CONCLUSIONS Use machine learning in order to learn how to adjust automatically the adaptation parameters

83. Lessons learned Future work Broader Interests 5 CONCLUSIONS Adaptive visualization for content data analysis Accessibility issues Cross-cultural communication issues 3 1 2

84. Questions? www.csdl.tamu.edu/~l0f0954/research/WARP_research.html (in continuous development)