Accessing News Video Libraries through Dynamic Information Extraction, Summarization, and Visualization Mike Christel Carnegie Mellon University, USA June.

Slides:

Advertisements

Similar presentations

Pseudo-Relevance Feedback For Multimedia Retrieval By Rong Yan, Alexander G. and Rong Jin Mwangi S. Kariuki

Advertisements

Perri Applegate, Ph.D. Tulsa Public Schools

3.02E Designing and Development of Multimedia Titles 3.02 Demonstrate interactive multimedia presentations.

Introduction to metadata for IDAH fellows Jenn Riley Metadata Librarian Digital Library Program.

Information Retrieval in Practice

Evaluating Visual and Statistical Exploration of Scientific Literature Networks Robert Gove 1,3, Cody Dunne 1,3, Ben Shneiderman 1,3, Judith Klavans 2,

1 CS 430: Information Discovery Lecture 22 Non-Textual Materials 2.

1 CS 502: Computing Methods for Digital Libraries Lecture 20 Multimedia digital libraries.

Supervised by Prof. LYU, Rung Tsong Michael Department of Computer Science & Engineering The Chinese University of Hong Kong Prepared by: Chan Pik Wah,

1 CS 430 / INFO 430 Information Retrieval Lecture 22 Metadata 4.

T.Sharon 1 Internet Resources Discovery (IRD) Video IR.

Presentation Outline  Project Aims  Introduction of Digital Video Library  Introduction of Our Work  Considerations and Approach  Design and Implementation.

1 Discussion Class 10 Informedia. 2 Discussion Classes Format: Question Ask a member of the class to answer. Provide opportunity for others to comment.

LYU 0102 : XML for Interoperable Digital Video Library Recent years, rapid increase in the usage of multimedia information, Recent years, rapid increase.

Design and Implementation of a Wireless Handheld Multimodal Digital Video Library Client System Sam K. S. Sze Henry K. P. Choi Feb Group Meeting.

Introduction to Multimedia and MSEC Michael Christel Alex Hauptmann Rong Jin (TA)

Carnegie Mellon © Copyright 2000 Michael G. Christel and Alexander G. Hauptmann 1 Informedia 03/12/97.

Outline of Presentation Introduction of digital video libraries Introduction of the CMU Informedia Project Informedia: user perspective Informedia:

Digital Video Library Experience in Large Scale Content Management VIEW Technologies Symposium – CUHK – August 2002 Howard Wactlar Carnegie Mellon University,

DASHBOARDS Dashboard provides the managers with exactly the information they need in the correct format at the correct time. BI systems are the foundation.

Section 2.1 Compare the Internet and the Web Identify Web browser components Compare Web sites and Web pages Describe types of Web sites Section 2.2 Identify.

Result presentation. Search Interface Input and output functionality – helping the user to formulate complex queries – presenting the results in an intelligent.

1 Lessons Learned From Building a Terabyte Digital Video Library Presented by Jia Yao Multimedia Communications and Visualization Laboratory Department.

Learning Unit Documents and Examples. Learning Units - basic building block of a course For iGETT a Learning Unit consists of –Three parts Instructor.

What is Multimedia?. Today’s objectives Define multimedia Work with XHTML Work with CSS.

MADGIC is… MAPS and ATLASES DATA: NUMERIC and GEOSPATIAL (for use with special software) GOVERNMENT INFORMATION (parliamentary and other official reports,

Centre for HCI Design INTERACT 2003 Tutorial Multimedia & the Web  Planning thematic threads through several media  Presentation layout: sequential or.

MADGIC is… MAPS and ATLASES DATA (NUMERIC and GEOSPATIAL) for use with special software GOVERNMENT INFORMATION (parliamentary and other official reports,

1 CS 430 / INFO 430 Information Retrieval Lecture 23 Non-Textual Materials 2.

Finding Better Answers in Video Using Pseudo Relevance Feedback Informedia Project Carnegie Mellon University Carnegie Mellon Question Answering from Errorful.

Robots as Characters. Mannequin Summit

Data Visualization Data Visualization. Business Analytics (BA) Overview.

Advanced Scientific Visualization

CIRCA Training Program CIRCA Operations Training Program.

1 CS 430: Information Discovery Lecture 22 Non-Textual Materials: Informedia.

V Material obtained from summer workshop in Guildford County, July-2014.

Directions for Hypertext Research: Exploring the Design Space for Interactive Scholarly Communication John J. Leggett & Frank M. Shipman Department of.

Digital Communications THE IMPACT OF DIGITAL COMMUNICATIONS ON MUSIC EDUCATION TODAY.

Chapter 5: Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization DECISION SUPPORT SYSTEMS AND BUSINESS.

Adobe Certified Associate Objectives 1 Setting Project Requirements.

Why book trailers? By June Henson Librarian, Downing Middle School.

Jacob Mortensen 2/8/13. Visual design is the look of the Web page and the colors and graphics used. VISUAL DESIGN.

Poster Available Internships In-field Research Through this project students will acquire the reading and writing skills necessary to access, gather, process,

Google Image Search, Code, Fusion Tables Audrey and Chris.

Digital Libraries1 David Rashty. Digital Libraries2 “A library is an arsenal of liberty” Anonymous.

Multimedia System Dave Chung 9/94. Technology Trends Multimedia workstations with audio and video processing capability Multimedia workstations with audio.

MMDB-9 J. Teuhola Standardization: MPEG-7 “Multimedia Content Description Interface” Standard for describing multimedia content (metadata).

Digital Video Library Network Supervisor: Prof. Michael Lyu Student: Ma Chak Kei, Jacky.

Appendix A Becoming an Adobe Certified Associate.

TchgLrngSummary.ppt 1 - pre Individualized Distance Learning Capability Goal is to support analysis and design and project development courses in.

1 CS 430 / INFO 430 Information Retrieval Lecture 17 Metadata 4.

Project 1 Video Production Basics. Student Product Short video sequence Storyboard.

1 Evaluation of Multi-Media Data QA Systems AQUAINT Breakout Session – June 2002 Howard Wactlar, Carnegie Mellon Yiming Yang, Carnegie Mellon Herb Gish,

Images were sourced from the following web sites: Slide 2:commons.wikimedia.org/wiki/File:BorromeanRing...commons.wikimedia.org/wiki/File:BorromeanRing...

Information Architecture

America in Miniature 1. Question

Digital Video Library - Jacky Ma.

Tips and Tricks for Creating Story Maps

CS 430: Information Discovery

Web Site Design Plan Checklist

Advanced Scientific Visualization

Unit 3 - A Digital Portfolio

Objective Understand web-based digital media production methods, software, and hardware. Course Weight : 10%

AN INTRODUCTION TO COMPUTER GRAPHICS Subject: Computer Graphics Lecture No: 01 Batch: 16BS(Information Technology)

ICT Communications Lesson 4: Creating Content for the Web

Phases of the Moon Mini Research Project.

Slam Dunk Title 1. Question & Research Task

Discussion Class 9 Informedia.

The Audio Notetaker Workspace Explained

Presentation transcript:

Accessing News Video Libraries through Dynamic Information Extraction, Summarization, and Visualization Mike Christel Carnegie Mellon University, USA June 28, 2001 Digital Video Library

© Copyright 2001 Carnegie Mellon University Informedia Project Information Sponsors NSF Digital Libraries Initiative NSF National Science, Mathematics, Engineering, and Technology Education Digital Library Program Images in later slides © , Cable News Network. More information on project sponsors is at the Carnegie Mellon University Informedia Project web site:

© Copyright 2001 Carnegie Mellon University Informedia Video Surrogates Purpose of Video Surrogate: Represent contents of video clip through text, imagery, audio and/or video in a format that can be interpreted in significantly less time than the associated video clip. Example Surrogates: Thumbnail image Short text title Set of thumbnail images (aka filmstrip or storyboard) Abstract Transcript Storyboard plus text Video skim

© Copyright 2001 Carnegie Mellon University Query-based Thumbnail Surrogates

Informedia Storyboard Interface © Copyright 2001 Carnegie Mellon University

Informedia Storyboard Plus Text Surrogate © Copyright 2001 Carnegie Mellon University

Informedia Video Playback Interface © Copyright 2001 Carnegie Mellon University

The Need for Visualization Strategies As digital video library grew, so did result sets Linear traversal of result pages sorted by relevance/date/size/etc. not sufficient: needed overview capability Prior work offered many solutions: Visualization By Example (VIBE) for matching entity relationships Scatter plots for low dimensionality relationships, e.g., timelines Dynamic query sliders for direct manipulation of plots Colored maps for geographic relationships (demonstration of Informedia system follows…)

Informedia Timeline Scatter Plot Interface © Copyright 2001 Carnegie Mellon University

Informedia Map Interface

© Copyright 2001 Carnegie Mellon University What’s Next…

© Copyright 2001 Carnegie Mellon University Visualization Schemes with Image Overlays

© Copyright 2001 Carnegie Mellon University Questions for Further Investigation How do you reduce 2,000,000 images to manageable set(s)? What are good strategies for dealing with uncertain data, e.g., errorful speech and image processing? How can the temporal dimension for motion video be better represented/summarized? How should evaluation for information visualizations be conducted? How should fast, scaleable interfaces supporting direct manipulation be delivered over the web?