1. XML and Data Integration Edward Yau (2002/03/27)

2. Fundamental Digital Video Library Functions  Functions –Extraction and Discovery –Searching and Indexing –Query and Presentation

3. Modalities  Video Information Processing  Modality concept –Video Channel Scene break, Face, Logo –Audio Channel Speech -> Text (Summary, Topic) –Event Channel Mouse click, movement

4. Functions x Modalities Functions Modalities Face Logo Speech Text Name Feature Vector Extraction Discovery String Match Exact Match Distance Match Searching Indexing Text Graphic Text Query Presentation Knowledge

5. iView System  Container system for modalities modules  Easy integration of additional modalities  Minimal effort if replacing different module of same modality

6. XML as Data Glue  Each modality has it own data format  Some of them already in XML –NewsXML, MathXML, …  Design policy to integrate them together

7. Data Integration  Data model reconciliation –Common data model Time/Frame Over specify reduce flexibility  Schema Reconciliation –Different representation format –Semantically the same  Instance Reconciliation –Contradictory information

8. 中文大學 … [10.9, 21.9, 23 ….] … TVB 1542 … 中文大學 … [10.9, 21.9, 23 ….] … TVB 1542 … Face Recognizer Speech Recognizer Logo Recognizer

9. 中文大學 … [10.9, 21.9, 23 ….] … TVB 1542 … 中文大學 … [10.9, 21.9, 23 ….] … TVB 1542 … Text Index Engine Face Index Engine Logo Index Engine iView XMLRepository

10. 中文大學 … [10.9, 21.9, 23 ….] … TVB 1542 … 中文大學 … [10.9, 21.9, 23 ….] … TVB 1542 … Text Presentation Face Presentaion Logo Presentation iView Browser (Timing)

11. Time Tag Problem  Common data modal and data reconciliation  Tag –  Attribute of Tag – –“ Attribute of Tag to Tag” translation policy