Presentation is loading. Please wait.

Presentation is loading. Please wait.

Edwin A. Valentijn Prof Astronomical Information Technology Target- OmegaCEN – Kapteyn University of Groningen e-science platform 29 October2013 Target.

Similar presentations


Presentation on theme: "Edwin A. Valentijn Prof Astronomical Information Technology Target- OmegaCEN – Kapteyn University of Groningen e-science platform 29 October2013 Target."— Presentation transcript:

1 Edwin A. Valentijn Prof Astronomical Information Technology Target- OmegaCEN – Kapteyn University of Groningen e-science platform 29 October2013 Target DATA FEDERATIONS Probing Big data for Answers using Data about Data

2 Target Dit project wordt medegefinancierd door het Europees Fonds voor Regionale Ontwikkeling en door het ministerie van EZ, Pieken in de Delta. Het project wordt mede mogelijk gemaakt door de gemeente Groningen, de provincie Groningen, de provincie Drenthe en SNN en staat onder auspiciën van Sensor Universe.

3 Data federations datacentric approach • Federated dataservers • Our own • GPFS • GRID • Federated databases • Oracle • Open source • Distributed computing Target

4 AstroWise -> Wise “living archives” • Modeling dependencies • 64 bit identifyer • Terabytes of pointers • Extreme datalineage ++ • Distributed-acces-proces- calibrate- QC –analysis • KiDs • 11 nodes-260 users • 2Pb, 45M file • 10 Giga table entries • Web + Python interface Target Experimental Astronomy Volume 35 januari 2013 Topical issue 19 papers 389 pages Leiden Groningen Bonn Munich Padua Naples Potsdam Nijmegen Toulouse WFAU CASU VO Lyon Zürich

5 Distributed communities acces-proces-calibrate-analyse Present KiDS o 50 -100 researchers ~10 labs Future Euclid: o 1200 registered members and growing o 700 researchers o 130 laboratories/departments o 13 European countries contributing: Austria, Denmark, France, Finland, Germany, Italy, Netherlands, Norway, Spain,Switzerland, Portugal, Romania, UK o NASA/US: provides the IR detectors. o Canada: in negociation

6 LOWISE – LOFAR LTA Target EGEE Julich – SARA GRID ftp 5 Petabyte/year EGEE Julich – SARA GRID ftp 5 Petabyte/year

7 MuseWISE Target ESO VLT IFS 24 IFU 100 Gb/night

8 National Archive Target

9 Integration Lifelines – Healthcare 165.000 persons- 30 years LifeWise AstroInformatics 2011 METABASE MOLGENIS Molecular Care Physiology GCC

10 Target

11 IJKDIJK TNO -Target Holding - Dijkdatacenter Target

12 Euclid Mission Archive Target – ESA data centric approach Target

13 Euclid Archive System data centric approach Target Metadata Repository ESAC + RUG


Download ppt "Edwin A. Valentijn Prof Astronomical Information Technology Target- OmegaCEN – Kapteyn University of Groningen e-science platform 29 October2013 Target."

Similar presentations


Ads by Google