Presentation is loading. Please wait.

Presentation is loading. Please wait.

Signal Processing in EU R&D Projects Current activities and future perspectives EUSIPCO 2000 September 6, 2000 Tampere, Finland Eric Badiqué

Similar presentations


Presentation on theme: "Signal Processing in EU R&D Projects Current activities and future perspectives EUSIPCO 2000 September 6, 2000 Tampere, Finland Eric Badiqué"— Presentation transcript:

1 Signal Processing in EU R&D Projects Current activities and future perspectives EUSIPCO 2000 September 6, 2000 Tampere, Finland Eric Badiqué

2 Outline Why Europe ? Why Europe ? The IST Programme The IST Programme Signal processing and related issues in IST Signal processing and related issues in IST Trends and opportunities Trends and opportunities Future calls for proposal Future calls for proposal Recommendations Recommendations

3 The European Commission’s 5 th Framework Programme Selection criteria   European “value added” and the subsidiarity principle (critical mass, problem of European dimension...)   Social objectives (employment, environment…)   Economic development and scientific and technological prospects

4 Seven Specific Programmes Quality of life and management of living resources User-friendly information society Competitive and sustainable growth Energy, environment and sustainable development. International aspects of Community research Promotion of innovation and encouragement of SMEs Improving human research potential

5 Types of actions supported Shared-cost actions   R&D projects   Demonstration projects   Combined R&D and demonstration projects   “SME Co-operative” research projects   “SME Exploratory” awards Training fellowships Thematic networks, concerted actions etc..

6 Collaborative R&D model Workplan consultation (yearly) Call for proposal Evaluation by independent experts Contract Yearly audit by independent experts Dissemination of results

7 Exploiting synergy Cluster Programme World Collaborative, pre-competitive R&D by multi-national consortia  building European teams Working in a wide « infocom » environment  contribute to formulation and implementation of European policies contributing to global standardisation Project Complementary and synergetic clusters of projects  exploring options, optimising coverage

8 Research networking Future & emerging technologies Systems & Services for the citizen New methods of working & Electronic Commerce Multimedia content & tools Essential technologies & infrastructure Information Society Technologies Program

9 The Information Society Technologies (IST) Programme The IST vision: Our surrounding is the interface  Build on Europe’s strengths (mobile and fixed coms, consumer electronics, digital broadcasting, content...)  Start creating the ambient intelligence landscape for seamless delivery of services and applications in Europe

10 - Ambient intelligence landscape - Priorities related to Signal Processing Embedded intelligence Embedded intelligence Multi-lingual and multi-modal interfaces Multi-lingual and multi-modal interfaces Personalised services Personalised services Cross-media content Cross-media content Trust, confidence and security Trust, confidence and security Distributed applications Mobile and wireless internet Converging networks Open source software

11 Signal Processing in IST - Overview Signal Processing is everywhere ! Signal Processing is everywhere ! 70+ projects have an SP component 70+ projects have an SP component IST contributes significantly to SP funding IST contributes significantly to SP funding Participants: Academia, consumer electronics, broadcasters, network operators, SMEs... Participants: Academia, consumer electronics, broadcasters, network operators, SMEs...

12 Signal Processing in IST - Overview Cryptography Watermarking Authoring Restoration HealthEnvironment Communication Biometry Transport Representation & Coding Processors Multimodal interfaces Telepresence Computer vision

13 for 3D modelling 3D acquisition cluster in ACTS 3D acquisition cluster in ACTS t Laser Range Finder (Resolv) t Uncalibrated (corner and line matching, trifocal tensor) (Vanguard) t Calibrated trinocular images (Panorama) New projects in IST (Hiscore, Visire) New projects in IST (Hiscore, Visire) t Extraction of 3D geometry and textures from video streams t Image-based rendering Applications to virtual museums, archeology, architecture, eCommerce... Applications to virtual museums, archeology, architecture, eCommerce...

14 Authoring Content to transform TV watching into an immersive experience (eg. focus on sport, Piste): 2nd Gen iTV Content to transform TV watching into an immersive experience (eg. focus on sport, Piste): 2nd Gen iTV Seamless blending of real and virtual objects Seamless blending of real and virtual objects Augmented views of events, advanced interaction Augmented views of events, advanced interaction Large market is virtual advertising on TV and on Web (Enrevi) Large market is virtual advertising on TV and on Web (Enrevi) uRequires segmentation, analysis, tracking, fusion, animation uStandards (MPEG-4 over MPEG-2)

15 Agent-Based Hybrid Scene Creation and Management Authoring tool for telepresence Authoring tool for telepresence and augmented reality (Art.Live) Real-time model-based Real-time model-based and blind segmentation Multi-agent architecture Multi-agent architecture Mixed 2D-3D scene Mixed 2D-3D scenereconstruction Dynamic database Dynamic database

16 Signal Processing in IST - Overview Cryptography Watermarking Authoring Restoration HealthEnvironment Communication Biometry Transport Representation & Coding Processors Multimodal interfaces Telepresence Computer vision

17 Representation and coding Representation and coding Indexing and retrieval Strong contribution to MPEG standard (ACTS legacy) Strong contribution to MPEG standard (ACTS legacy) Initiatives to bridge the gap between coding and CG world (MPEG-4/VRML/Web3D) Initiatives to bridge the gap between coding and CG world (MPEG-4/VRML/Web3D) JPEG2000 JPEG2000 Universal production system for TV and HDTV Universal production system for TV and HDTV Indexing and retrieval Indexing and retrieval t Shot detection, feature extraction, segmentation, classification, indexing, semantic annotation (Divan, Avir, Cuidad, Vicar, Assavid…) t Use of dual audio and visual features to locate content, association of text and audio fragments (Ciwos) t Automatic recognition of audio titles based on fingerprints (RAA)

18 Communication - Software radio Multicarrier access system (Adamas) Multicarrier access system (Adamas) Terrestrial and satellite UMTS (Virtuous) Terrestrial and satellite UMTS (Virtuous) Reconfigurable terminals (Pastoral) Reconfigurable terminals (Pastoral) Smart antennas (Saturn) Smart antennas (Saturn) Wireless indoor high bitrate modems (Wind-flex) Wireless indoor high bitrate modems (Wind-flex)  Partners: Philips, VTT, Intracom, Thomson, FT, ST, Alcatel, CSELT, Siemens, Telefonica, ASCOM, Lucent...

19 Multimodal Interfaces Speech recognition Speech recognition t Multi-linguality, multi-acoustic environments ( Speecon, Coretex ) t Unsupervised learning techniques t Applications to consumer electronics and distributed environments ( Smada ) Avatars and virtual humans Avatars and virtual humans t Face detection, registration, facial expression classification, animation (Interface, Mesh, Visicast, Vpark..) Eye-tracking (I-eye) Eye-tracking (I-eye) t Gaze as active element in user interface t Applications: assisted translation, hand-free assisted tutoring Haptics, telerobotics (Teledimos) Haptics, telerobotics (Teledimos)

20 Signal Processing in IST - Overview Cryptography Watermarking Authoring Restoration HealthEnvironment Communication Biometry Transport Representation & Coding Processors Multimodal interfaces Telepresence Computer vision

21 Biometrics & Cryptography Multimodal verification (M2VTS) Multimodal verification (M2VTS) t facial feature extraction and tracking, 3D analysis, face recognition, speech recognition, fusion speaker verification Applications are access control (e-commerce, e-banking), surveillance, alarm verification (Banca) Applications are access control (e-commerce, e-banking), surveillance, alarm verification (Banca) Signature, integrity and encryption (Nessie) Signature, integrity and encryption (Nessie) Primitives for Gigabit networking, wireless comms, PDAs and smart cards Primitives for Gigabit networking, wireless comms, PDAs and smart cards t Contribution to Advanced Encryption standard (AES)

22 Environment Water quality monitoring (Bluewater, Rapsodi) Water quality monitoring (Bluewater, Rapsodi) t Multi-cameras, image analysis of wave motion damping t Integration of aircraft and satellite sensors t Integration of radar signal and image-processing t Detection, estimation and tracking Robot-based measurement of volcanic environment (Robovolcist) Robot-based measurement of volcanic environment (Robovolcist) Automatic, visual inspection for structural risk assessment (Robosense) Automatic, visual inspection for structural risk assessment (Robosense) Flood analysis (Anfas) Flood analysis (Anfas) t Remote sensing imagery, computer vision, propagation simulation

23 Healthcare Confocal imaging for early diagnosis of skin cancer (Ediscim) Pattern recognition of tumours using magnetic resonance (Interpret) Reconstruction and visualisation for dynamic computed tomography (Dynct) Home-based care and medical treatment (Telemedicare) 24 hour real-time medical monitoring at home, body-sensors for ECG, blood pressure, oxymetry and temperature Segmentation and tracking for echocardiography (Adequate) MRI-based minimally invasive therapy (Amit) instrument tracking, visualisation Rehearsal and planning of surgical interventions (Ierapsi, VR- SUR)

24 Transport Advanced Driver Assistance System (Carsense) Advanced Driver Assistance System (Carsense) Stereo vision, image processing for multiple targets Stereo vision, image processing for multiple targets Sensorial and communication systems to improve safety of vulnerable road users (Protector) Sensorial and communication systems to improve safety of vulnerable road users (Protector) computer vision + cooperative means carried by road user computer vision + cooperative means carried by road user Near impending crash detection (Chameleon) Near impending crash detection (Chameleon) Sensor fusion and standardisation Sensor fusion and standardisation Automotive radar system (RadarNet) Automotive radar system (RadarNet) Multi-agent architecture for road surveillance (Modest) Multi-agent architecture for road surveillance (Modest)

25 Telepresence (Virtue) Eye contact, spatial awareness, Look-around effect dynamic view synthesis from multiple cameras Semi-immersive display life-size head and torso images Same virtual table Correct perspective Video segmentation & coding 3D audio head-tracking multi-view reconstruction Fusion Networking Synchronisation Human factors...

26 Trends, opportunities and issues Signal processing as the great enabler ? Signal processing as the great enabler ? Web and mobile developments (flexibility, scalability…) Web and mobile developments (flexibility, scalability…) Processor architecture to cope with complexity ? (beyond speed and memory) Processor architecture to cope with complexity ? (beyond speed and memory) Progress in sensors, displays and actuators (fusion) Progress in sensors, displays and actuators (fusion) Need for increased and embedded intelligence (more than signals, higher abstraction levels, it’s another world...) Need for increased and embedded intelligence (more than signals, higher abstraction levels, it’s another world...) New representation standards as catalyst for SP ? (we have got decoders; what about the coders ?) New representation standards as catalyst for SP ? (we have got decoders; what about the coders ?) Multi-disciplinarity ? (has been a major issue for years but..) Multi-disciplinarity ? (has been a major issue for years but..) Initiatives to structure some aspects of SP ? (COST211 analysis model ? Evolving model ? Architecture ? Relation to human perception ?) Initiatives to structure some aspects of SP ? (COST211 analysis model ? Evolving model ? Architecture ? Relation to human perception ?) Mixed Realities (Augmenting reality & virtuality, new imaging frontiers..) Mixed Realities (Augmenting reality & virtuality, new imaging frontiers..)

27 On the edge ? Meta-cameras (beyond AV..) Meta-cameras (beyond AV..) High-end SP for special effects: Back to reality (Matrix..) High-end SP for special effects: Back to reality (Matrix..) Embedded intelligence, smart devices (MI2..) Embedded intelligence, smart devices (MI2..) Transcoding (the universal mail box) Transcoding (the universal mail box) Personalised entertainment and work environments (Oz..) Personalised entertainment and work environments (Oz..) Super high resolution, real size, real color displays (Immersive TV, Natural Vision..) Super high resolution, real size, real color displays (Immersive TV, Natural Vision..) Holodecks….. Holodecks…..  This is just the beginning

28 Current call for proposal Most action lines relevant to SP are open Deadline RTD: October 31, Call details 

29 Consultation process (WP2001) Consultation meeting “High Performance Signal Processing” was held on May15 Consultation meeting “High Performance Signal Processing” was held on May15 15 experts (Imec, Thomson, ARM, Philips, UC Dublin, Infineon, KU Leuven…) 15 experts (Imec, Thomson, ARM, Philips, UC Dublin, Infineon, KU Leuven…) Led to a proposal for a cross-programme action (currently with ISTC) Led to a proposal for a cross-programme action (currently with ISTC) IST CPA12: Advanced Signal Processing Systems and Applications Applications, algorithms, devices for high performance signal processing systems Biomedical processing, media, communications, security Advanced algorithms Implementation in embedded systems Standards, methodologies, support tools

30 If you want to submit a proposal, don’t forget the following... Objectives Partnership Eligible partners Management Contract type Scope of CfP Presentation Completeness Ethical issues Competition

31  Information Society Technologies  IST Unit E3: Overview of SP activities uploaded soon More information on IST


Download ppt "Signal Processing in EU R&D Projects Current activities and future perspectives EUSIPCO 2000 September 6, 2000 Tampere, Finland Eric Badiqué"

Similar presentations


Ads by Google