1. Batch VIP — A backend system of video processing VIEW Technologies The Chinese University of Hong Kong

2. Outline Ideas of BatchVIP Design Goals Concepts Rules Structure Processing modules

3. Design goals Integrate and update different kinds of video processing function efficiently Coordinate processes High stability Real-time monitor the progressing status Record events in log

4. Module A Module is a component which implements a certain video processing task. Module is independent of Batch VIP by using a standalone executable file with a XML specification Advantages: Easy to integrate new modules or update existing modules without modifying the Batch VIP Guarantee the reliability. Standard interface

5. Sample of XML Specification <Info NAME="SpeechRecognition" SRC="speechrecognition.exe" DESCRIPTION="Speech Recognition" MULTIPLEINSTANCE="0" USEENGINE="1" /> ADRemove Speech Script

6. If one module needs the results of other modules, it can not run until all those modules finish. Each file only can be processed by one module at any time Only the module which has the multiple-instance feature can process several files at the same time Each module must apply for the thread quota before creating process and must release it after finishing. Rules of the task arrangement:

7. Reliability Module mechanism Multi-Thread Management Critical Section Management Monitor Process status CPU utilization Socket communication

8. Communication Socket based Duplex TCP/IP Message Control message Progress message Error message

9. Batch Control Center Structure: Video Log Scene Detection Ad Detection Module Module Manager Task Manager Process Manager Xml interface Publish ……

10. Working flow Create Process Destroy Socket Terminate Monitor Process status Exception No Yes Create Socket Server Process Client Termination message Update task status Update task progress tasks Task Queue Add to Task Queue Check preprocess return quota Select Task: Have not be processed All preprocesses have finished Video file is not under process Apply quota succeed fail Task Manager

11. Processing Layer VOCD Face Detection Speech Recognition Story Segmentation Publish Scene Change VOCR Ad Detection

12. Scene Detection Histogram-based difference time D(X,Y) Eliminate duplicated results

13. VOCD Sampling & Color space conversion Multi-frame comparison Coarse-to-fine localization Text area enhancement Local thresholding Text area recovery High-pass filter Edge detection

14. Speech Recognition Audio Extraction ViaVoice

15. Story Segmentation

16. Publish

17. Thank you for you attention!