1. 2. WP9 – Earth Observation Applications ESA DataGrid Review Frascati, 10 June 2002 1.Welcome and introduction (15m) 2.WP9 – Earth Observation Applications (50m) 3.ESA and WP9: infrastr, appl, TB 0/1 (50m) 4.Demonstration of EO applications (45m) 5.ESA and WP9: scale up, effort, recovery plan (50m) 6.Side ESA actions related to GRID (30m) 7.Reviewer separate meeting (60m) 8.Conclusions (30m)

2. ESA DataGrid Review – 10 June 2002 – n° 2 Summary item 2 u WP9 – Earth Observation Applications (50m) n DataGrid EO requirement (LF, 15m) n DataGrid WP9 tasks, WP9 Plan (JL, 15m)

3. ESA DataGrid Review – 10 June 2002 – n° 3 Earth Observation Community GRID interactive scenario Common access to EO missions catalogues Acquisition plan, order, delivery Parametric data fusion and models integration Collaborative publishing of results On demand high level products generation

4. ESA DataGrid Review – 10 June 2002 – n° 4 EO and Network Computing data models: EO is more than “parallel task execution”!! u Distributed Computing n Integration of data from various instruments and missions u High-Throughput Computing n Interferometry … u On-Demand Computing n Generation of EO user products… u Data-Intensive Computing n Archive data re-processing, climate modeling… u Collaborative Computing n Scientists application interactions, Instrument cal/val … Ian Foster and Carl Kesselman, editors, “The Grid: Blueprint for a New Computing Infrastructure,” Morgan Kaufmann, 1999

5. ESA DataGrid Review – 10 June 2002 – n° 5 The Grid from a Services View : : E.g., Resource-specific implementations of basic services E.g., Transport protocols, name servers, differentiated services, CPU schedulers, public key infrastructure, site accounting, directory service, OS bypass Resource-independent and application-independent services authentication, authorization, resource location, resource allocation, events, accounting, remote data access, information, policy, fault detection Distributed Computing Toolkit Grid Fabric (Resources) Grid Services (Middleware) Application Toolkits Data- Intensive Applications Toolkit Collaborative Applications Toolkit Remote Visualization Applications Toolkit Problem Solving Applications Toolkit Remote Instrumentation Applications Toolkit Applications Chemistry Biology Cosmology High Energy Physics EO and Environment... Science & Application System

6. ESA DataGrid Review – 10 June 2002 – n° 6 Number crunching: interferometry, subsidence,DEM generation Pomona (Cal): subsidence velocity fields 40 ERS1/2 images (92-99), Ambiguity: 28 mm Digital Elevation Model GRID requirements: large data files (10+ GB) stages with intensive processing science driven value adding

7. ESA DataGrid Review – 10 June 2002 – n° 7 Provide a single access point to space systems to emergency & rescue organisations in case of disasters Participating Space Agencies: CNES, CSA, ESA, ISRO, NOAA, … Missions: RADARSAT; ERS, (Envisat); SPOT; IRS; NOAA, … Charter for Disaster Management

8. ESA DataGrid Review – 10 June 2002 – n° 8 ESRIN MATERA (I) NEUSTREL.ITZ (D) KIRUNA (S) - ESRANGE MASPALOMAS (E) TROMSO (N) MATERA (I) METADATA BROWSE WEB SEAWIFS SPOT IRS-P3 LANDSAT 7 TERRA/MODIS STANDARD PRODUCTION CHAINS MULTIMISSION DATABASES FOR REMOTE ACCESS AND USER SERVICES USERS HISTORICAL ARCHIVES USERS PRODUCTS AVHRR ESA EO facilities real-time infrastructure

9. ESA DataGrid Review – 10 June 2002 – n° 9 No Projects 1-25 Projects 26-50 51-100 100+ Projects Countries P.I. geographic distribution AOs: Stimulating scientific research world-wide 3500+ science Users of ESA data 120 New Cat-1 Projects in 2001 700 Envisat AOs to start in 2002 Envisat science community

10. ESA DataGrid Review – 10 June 2002 – n° 10 Why GRID in EO? (1) u EO Community: Progressive refinement of data from many data sources to produce higher quality products n Product generation chain involving distributed organisations and users n Collaborative: distributed users and data – large international cooperation n Discovery: large numbers of products & resources n Interoperabiltiy of catalogue and metadata already in operation n Web based data services

11. ESA DataGrid Review – 10 June 2002 – n° 11 Why GRID in EO? (2) u Massive, non-stop data volumes n New instruments, sensors & product types n Distributed archives n Historical dataset reprocessing u Complex numerical processing algorithms u Near real-time turnover

12. ESA DataGrid Review – 10 June 2002 – n° 12 Needed GRID technologies u Resource-independent and application-independent services (middleware) n authentication, authorization, resource location, resource allocation, remote data access, n accounting, security, quality of services, fault detection, real time services, … u Specialized protocols, procedures, data standards, operational environments, interfaces to EO legacy systems… u EO dedicated portal and user access…

13. ESA DataGrid Review – 10 June 2002 – n° 13 OZONE: a case of Global Environmental Monitoring GOME analysis detected ozone thinning over Europe 31 Jan 2002 GRID requirements: Multi instrument data fusion Distributed data sources, science and institutional users Complex data processing (1d data = 20 d processing Near real time deliv.

14. ESA DataGrid Review – 10 June 2002 – n° 14 Application of DataGrid in EO u Focus on One EO application (Ozone) but explore: n Collaborative environment, parallel data processing, … n Interface to legacy and COTS systems n Develop generic components n Re-use components to add new applications n Integrate compatible technologies n Integrate other data types (new envisat instruments) u Testing in “controlled” GRID environment (ESRIN- ENEA) and in “wide-European” environment u Feedback to DataGrid developers and Architecture Group