1. Virtual Image Processing System for Intelligent Reconstruction of 3D Environments IST-1999-10756

2. Project Data 4 Contract Number: IST-1999-10756 4 Key Action: IV Essential Technologies and Infrastructures. 4 Action lines: IV.4.4.2, IV.4.6.1. 4 Started: 15 may 2000. 4 Duration: 36 months. 4 Contact: tomasrod@eptron.estomasrod@eptron.es 4 Web: www.eptron.es/projects/visire

3. Participants 4 P.O: Mr Carlos Morais-Pires. 4 EPTRON SA. (Project Coordinator). 4 INRIA. 4 Lund University. 4 Universidad Politécnica de Madrid. GTI. 4 Giunti Multimedia.

4. Objectives 4 Provide Photo-realistic 3D reconstruction of the interior of buildings. 4 Approach based on advanced Computer Vision techniques. 4 Acquisition sessions based on free-hand video streams by a conventional camcorder. 4 Semi-automatic system. Meant for Multimedia professionals with NO experience in Computer Vision. 4 Output format compatible with VRML 2.0 standard. 4 Pilot application consisting in the 3D reconstruction of a Museum.

5. Computer Vision –Auto-calibration. –Robust and iterative methods. –Feature extraction on continuous video streams. –Multiple video streams are allowed. –Possibility to combine panoramic takes with close- ups. –Texture processing algorithms. –Semiautomatic method. Estimated 95% automatic.

6. Interfaces 4 Combine powerful Computer Vision research with sophisticated User Interfaces to achieve a usable prototype. 4 Visual interface with user feedback. 4 Possibility to monitorise the 3D reconstruction process. 4 Possibility of manual intervention at any image processing stage. 4 Possibility to do partial 3D reconstruction. 4 Specifically designed for optimized production times.

7. Pilot 4 Contacts with museums in Florence (Uffizi, Storia della Scienza, Palazzo Vecchio) and Milan (Scienza e tecnica). 4 Use of 3D navigation features, zoom, active areas. 4 Link with external media resources: Hot Spots. 4 Standard VMRL 2.0 compatible browser.

8. Image Processing Chain FEATURE EXTRACTION FEATURE TRACKINGFLEXIBLE CALIBRATION EUCLIDEAN 3D RECONSTRUCTION MESH GENERATIONTEXTURE MAPPINGPROJECTIVE RECONSTRUCTION LENS GEOMETRIC CORRECTION

9. Potential Applications 4 Cultural. Digital publishers. 4 Tourism. 4 Preservation of cultural heritage. 4 Architecture. 4 Virtual sets for TV. 4 Multimedia. 4 Virtual sets E-commerce. 4 Internet.

10. Current Status 4 WP1. Specifications: Completed. 4 WP2. Acquisition of test Images: Started Sept 00. 4 WP3. Feature Analysis: Started Sept 00. 4 WP4. Calibration: Started Sept 00. 4 WP5. 3D Recons. & Mesh Generation: Started Sept 00. 4 WP6. Application Software: Not Started. 4 WP7. System Integration: Not Started. 4 WP8. Pilot Application: Not Started. 4 WP9. Management: In progress. 4 WP2. Exploitation: In progress.