1. Accessing News Video Libraries through Dynamic Information Extraction, Summarization, and Visualization Mike Christel Carnegie Mellon University, USA June 28, 2001 Digital Video Library

2. © Copyright 2001 Carnegie Mellon University Informedia Project Information Sponsors NSF Digital Libraries Initiative NSF National Science, Mathematics, Engineering, and Technology Education Digital Library Program Images in later slides ©1999-2001, Cable News Network. More information on project sponsors is at the Carnegie Mellon University Informedia Project web site: http://www.informedia.cs.cmu.edu/

3. © Copyright 2001 Carnegie Mellon University Informedia Video Surrogates Purpose of Video Surrogate: Represent contents of video clip through text, imagery, audio and/or video in a format that can be interpreted in significantly less time than the associated video clip. Example Surrogates: Thumbnail image Short text title Set of thumbnail images (aka filmstrip or storyboard) Abstract Transcript Storyboard plus text Video skim

4. © Copyright 2001 Carnegie Mellon University Query-based Thumbnail Surrogates

5. Informedia Storyboard Interface © Copyright 2001 Carnegie Mellon University

6. Informedia Storyboard Plus Text Surrogate © Copyright 2001 Carnegie Mellon University

7. Informedia Video Playback Interface © Copyright 2001 Carnegie Mellon University

8. The Need for Visualization Strategies As digital video library grew, so did result sets Linear traversal of result pages sorted by relevance/date/size/etc. not sufficient: needed overview capability Prior work offered many solutions: Visualization By Example (VIBE) for matching entity relationships Scatter plots for low dimensionality relationships, e.g., timelines Dynamic query sliders for direct manipulation of plots Colored maps for geographic relationships (demonstration of Informedia system follows…)

9. Informedia Timeline Scatter Plot Interface © Copyright 2001 Carnegie Mellon University

10. Informedia Map Interface

11. © Copyright 2001 Carnegie Mellon University What’s Next…

12. © Copyright 2001 Carnegie Mellon University Visualization Schemes with Image Overlays

13. © Copyright 2001 Carnegie Mellon University Questions for Further Investigation How do you reduce 2,000,000 images to manageable set(s)? What are good strategies for dealing with uncertain data, e.g., errorful speech and image processing? How can the temporal dimension for motion video be better represented/summarized? How should evaluation for information visualizations be conducted? How should fast, scaleable interfaces supporting direct manipulation be delivered over the web? http://www.informedia.cs.cmu.edu