Presentation is loading. Please wait.

Presentation is loading. Please wait.

GRID Perspectives at ESA/ESAC Science Archives and VO Team Computer Support Group ESAC, Villafranca del Castillo, Madrid, Spain.

Similar presentations


Presentation on theme: "GRID Perspectives at ESA/ESAC Science Archives and VO Team Computer Support Group ESAC, Villafranca del Castillo, Madrid, Spain."— Presentation transcript:

1 GRID Perspectives at ESA/ESAC Christophe.Arviset@esa.int Science Archives and VO Team Computer Support Group ESAC, Villafranca del Castillo, Madrid, Spain

2 Science Operations & Data Systems Division Research & Scientific Support Department Christophe ARVISET Science Operations & Data Systems Division Research & Scientific Support Department IVOA Interop, Victoria, 17/05/2006, page 2 Main Goals of ESAC GRID activities Build a GRID at ESAC that can be used by all projects at ESAC Scientists to use GRID for cpu intensive tasks Support to Projects for Pipeline Data Processing Integration with other GRIDs ESTEC, ESRIN, UCM, others, …. Closer link to the VO

3 Science Operations & Data Systems Division Research & Scientific Support Department Christophe ARVISET Science Operations & Data Systems Division Research & Scientific Support Department IVOA Interop, Victoria, 17/05/2006, page 3 Grid Computing scigrid.esac.esa.int vogrid.esac.esa.int GT4

4 Science Operations & Data Systems Division Research & Scientific Support Department Christophe ARVISET Science Operations & Data Systems Division Research & Scientific Support Department IVOA Interop, Victoria, 17/05/2006, page 4 How this all is organized? Firewall Migration is forcing us to divide the Local Grid To be installed 10 nodes, RHEL dual cpu, 6GB RAM Scigrid linked to ESTEC GRID ESRIN GRID UCM GRID

5 Science Operations & Data Systems Division Research & Scientific Support Department Christophe ARVISET Science Operations & Data Systems Division Research & Scientific Support Department IVOA Interop, Victoria, 17/05/2006, page 5 GRID for the day to day analysis The user could use the local Grid to: Run IDL Run SAS, OSA or whatever mission-specific software interactively Data visualization Submit massive data processing batch jobs, … The user will use his/her desktop for: Internet browsing Email Writing documents MP3 Data visualization SAS OSA iPython Heasoft

6 Science Operations & Data Systems Division Research & Scientific Support Department Christophe ARVISET Science Operations & Data Systems Division Research & Scientific Support Department IVOA Interop, Victoria, 17/05/2006, page 6 GRID for Project Data Processing Standard Pipeline Data Processing Bulk and On-the-Fly (OTF) Processing of data Run the Pipeline on many observations Automatic process, no human intervention Perfectly tuned for GRID processing Migrate XMM-Newton Archive OTF to scigrid (2006) Run Herschel Pipeline Data Processing on scigrid (2007) Increase number of nodes GAIA data processing in 2012+ Several hundreds of machines ?

7 Science Operations & Data Systems Division Research & Scientific Support Department Christophe ARVISET Science Operations & Data Systems Division Research & Scientific Support Department IVOA Interop, Victoria, 17/05/2006, page 7 GRID and the Virtual Observatory Interaction ESA VO and ESAC GRID teams being built up Main long term goals ESA VO as a data provider ESA VO as a data processing centre Use the GRID with VO protocols DAL, SSO/Certificates, SkyNode/Xmatch, … Build a VOSpace located on the ESA VO Grid Like to start linking ESAVO GRID with other VO GRIDs

8 Science Operations & Data Systems Division Research & Scientific Support Department Christophe ARVISET Science Operations & Data Systems Division Research & Scientific Support Department IVOA Interop, Victoria, 17/05/2006, page 8 Example : Xmatch on GRID (TBD)


Download ppt "GRID Perspectives at ESA/ESAC Science Archives and VO Team Computer Support Group ESAC, Villafranca del Castillo, Madrid, Spain."

Similar presentations


Ads by Google