1. LYU0302: PVCAIS-Personal Video- Conference Archive Indexing System Background –Videoconference is becoming popular –Participants wish to keep videoconference archives for the later reference –Normal video and audio files are neither searchable nor helpful to recall their contents –Indexing of videoconference archives has not been investigated till now

2. LYU0302: PVCAIS Objective: develop an experimental system with the following architecture. Phase IPhase IIPhase III

3. LYU0302: PVCAIS Phase I: Media acquisition (3~4 months) - Study the mechanism and media format of a videoconferencing client to obtain media data.

4. Architecture of H.323-Based Videoconference System Terminal MCU MCMP 0-n Terminal PBN A/V, Data, Control

5. Structure of H.323 Terminal A terminal (videoconferencing client) interacts with users, encode/decode/render media streams, and communicates with MCU. PBN inter- face UDP+R TP/IP TCP/IP Video CODEC H.261, H.263 Audio CODEC G.711, G.723 User CODEC T.120 System control CODEC H.245, H.225 Video I/O Audio I/O Data application: Text chat & whiteboard GUI

6. What we’ll do to a terminal? Intercept media streams and store them in files. –Video/Audio: intercept encoded streams –Text/Whiteboard: intercept decoded streams PBN inter- face UDP+R TP/IP TCP/IP Video CODEC H.261, H.263 Audio CODEC G.711, G.723 User data CODEC T.120 System control CODEC H.245, H.225 Video I/O Audio I/O Data application: Text chat & whiteboard GUI Video fileAudio file Text fileWhiteboard file

7. LYU0302: PVCAIS Phase II: Media info retrieval (3~4 months) -Select a group of algorithms to implement the multimedia-indexing functions. -Face detection & recognition -Speech recognition -OCR -Title generation -Keyword selection

8. LYU0302: PVCAIS Phase II - Integrate these functions to generate an XML index file for each videoconference. - Create and manage the file system of indexed archives.

9. LYU0302: PVCAIS Phase III: GUI (2 months) -Implement a GUI of PVCAIS to: -Search in indexed videoconference archives. -Synchronized playback of a selected conference. Searching Playback Figure 4. An example GUI of PVCAIS

10. Required Techniques for Phase I Source code of H.323 videoconference system (outsourcing) H.323 knowledge –Structure of terminal –H.263 video CODEC Visual C++ –Multithread –DirectSound –GUI programming