1. 2.3.3 MAD SAMBA (Multicamera and distributed Surveillance and multisensor-based surveillance) Contact: Alessandro ZANASI Alessandro.zanasi @ zanasi-alessandro.eu Tel:+39 349 4131718 Bruxelles September, 2009 ZANASI Alessandro SrL Academic Institutions SMEs

2. SEC-2010.2.3-3: Automatic detection and recognition of threats to critical assets in large unpredictable environment. Topic

3. Objective Create a large scalable, flexible platform – basically new software tools for addressing new emerging problems in Wide Area People Surveillance of unconstrained outdoor scenario. with free path, cluttered scene, unpredictable people interaction a)Public areas e.g. urban squares, monumental sites, public parks and playgrounds b) Private areas e.g. large building construction sites, open warehouse,.. Needs of new setting of a)New multicamera and distributed camera systems ( i.e. tigthly or loosely coupled more ore less syncrhronized cameras with or without overlapping field of view), with stationary, moving PTZ sensors b) Other Sensor networks To Protect the area against dangerous situations or threaths for citizen and workers

4. Project goals and field trials Create a new platform for integrating synergic techniques based on computer vision, pattern recognition and computer graphics for automatic surveillance of wide unconstrained and complex areas reliable with standard videosurveillance sensors, robust, scalable and reconfigurable in many fields. New state-of-the-art techniques allows to identify new challenging scenario for future applications of automatic smart surveillance systems. Examples are Large outdoor working environment, as building construction sites, naval stores, warehouse which typically needs surveillance for security ( e.g. to avoid the presence of unauthorized people) : in these scenario the background scene has normally a very high dynamic variation due to the work in progress and often static position of point of observations are not possible so that temporary surveillance points are necessary. Here, visual stationary multi-view cameras must be integrated with ptz cameras to catch the identity of the people with automatic zoom on identifying details ( face, gesture) and with temporary platforms. Here targets are fews but hidden in very complex cluttered environments and people recognition, and identification are the main problems. Moreover the integration of other devices such as RFIDs could help to distinguish authorized workers, from unauthorized ones. Large outdoor public places such as parks or squares and monumental sites in urban environment typically need real time surveillance to prevent accidents, abuses or threat typically of urban criminality such as drugs or aggressions: here the systems should be based on distributed cameras to cover large areas; the presences of infrastructures, trees etc could avoid a complete view of the scene so that a temporal continuity of the tracking is not always allowed; the need in these scenario is to track the action of single and group of people and their interaction; the high challenges in computer vision, often unsolved, yet regards the correct management of group of people moving together, their action and interaction.

5. Novelties (and challenges) of the project A fully integrated approach to detect and track single or group of people in both multicamera and distributed systems Multicamera reconstruction from existing sensors, moving object detection A 3D reconstruction of the scene with automatic avatar creation to validate hypothesis of recognition and give new 3D immersive display of warning and alarms to security officers Innovative probabilistic inference engine for reasoning about people action and interaction Camera and sensor fusion for people identification and unauthorized people identification

6. Partners Academic Institutions University of Modena (I) SMEs Bridge129 (I), Zanasi Srl (I) Required Large integrator coordination High level competences

7. Involvement in previous projects in the area: 1.THIS (JLS Project) Intelligent System 2.SUBBING (Proposal to DG JLS) SUspicious Behaviour grabBING BRIDGE 129 ( Italian SME) Skills: Computer Vision + System Integration Text, Image and Video Retrieval, Recognition and Surveillance.

8. Skills 1.Computer Vision University of Modena & Reggio Emilia ImageLab Involvement in previous projects in the area: 1. THIS (ICT/SEC Project) Transport Hub Intelligent Surveillance (Coordinator) 2. SUBBING (Proposal to DG JLS) SUspicious Behaviour grabBING

9. ZANASI Alessandro SrL (It SME) ZANASI Alessandro SrL Skills: 1.Intelligence Process 2.Technological Applications to Intelligence problems 3.EU indications (ZANASI is ESRAB/ESRIF member) Involvement in previous projects in the area: 1.THIS (JLS Project) Transport Hub Intelligent System 2. SUBBING (Proposal to DG JLS) SUspicious Behaviour grabBING