DTI Management of Information LINK Project: ICONS Incident reCOgnitioN for surveillance and Security funded by DTI, EPSRC, Home Office (March March 2003) Queen Mary Westfield College, University of London Safehouse Technologies Heritage Protection British Telecom British Airport Authority

The Central Research Issue (Pre-competitive): Recognition, Searching and Categorising Spatio-Temporal Events of “Significance” (Smart Content) in Video Data (on- or off-line) “Zero Motion” Detection –Detecting and searching pre-defined significant events (spatial and temporal) in a known scene “Abnormal Behaviour” Recognition –Recognition and indexing human activities and temporal signatures in space and over time

In Real-Time with limited resources (on PC) From all different views Varying lighting, distance and racial colours Under partial and total occlusion Multiple subjects of interest Fault tolerant to missing frames Robust Detection and Tracking of Multiple Subjects and their Faces in Real-Time

Tracking human presence Understanding scene layout Behaviour Profiling and Categorisation Modelling patterns of activities Learning behaviour patterns

Behaviour Recognition and Search

Automatic Recognition of Human Gestures for Visually Mediated Interaction and Intelligent Human-Machine Interface

Other Currently Funded Research Projects Gesture Recognition in Visually Mediated Interaction (EPSRC) –Gong, Sherrah Advanced Incident Monitoring System (Industry) –Gong, Parkinson, Verity, Ong Learning Human Models from Live Video (British Council) –Ong, Gong Motion-based Recognition of Face and Behaviour (HEFCE) –Psarrou, Gong, Romdhani, Walter Tracking and Segmentation in Virtual Studios (BBC & EPSRC) –Raja, Gong, Paker Multi-Camera Data Fusion (Overseas) –Chang, Gong Visual Learning in Dynamic Scenes (University of London) –Ng, Lee, Gong

Key References S. Gong, S. McKenna, A. Psarrou. Dynamic Vision: From Images to Face Recognition. World Scientific Publishing & Imperial College Press, March S. Gong, A. Psarrou, S. Romdhani. Multi-view Face Appearance Models. Invited article (1999 British Machine Vision Conference Best Scientific Paper Award), Image and Vision Computing, July S. Gong, A. Psarrou and M. Walter. Learning Stochastic Models of Human Behaviour. Invited article, Image and Vision Computing, July 2000 (also in ICCV’99, September 1999, Corfu, Greece). E. Ong, S. Gong. Modelling Nonlinear Dynamics of View Transformation: An Application to Tracking 3D Human Skeleton Models in Multiple Views. Invited article, Computer Vision and Image Understanding, October 2000 (also in IEEE Int. Workshop on Modelling People, 1999). S. Gong. Understanding head pose and body gestures for visually mediated interaction. Invited talk in IEE Colloquium on Computer Vision for Virtual Human Modelling. 1998, London (also in ECCV’98, Freiburg, Germany). S. McKenna, S. Gong. Recognising moving faces. In Wechsler, Philips and Bruce (Eds.) Face Recognition: From Theory to Applications, NATO ASI Series F, Springer-Verlag, July H. Buxton, S. Gong. Visual surveillance in a dynamic and uncertain world. Artificial Intelligence, Invited special volume on computer vision, Vol. 78, October 1995 (also in ICCV’95, June 1995, MIT, USA).