Edwin A. Valentijn Prof Astronomical Information Technology Target- OmegaCEN – Kapteyn University of Groningen e-science platform 29 October2013 Target.

Slides:



Advertisements
Similar presentations
Share of population - GDP per capita (PPP), 2004 EU-15 and other West European countries Hungary Czech Republic Malta Slovenia Cyprus Portugal Greece Spain.
Advertisements

CERN STAR TAP June 2001 Status of the EU DataGrid Project Fabrizio Gagliardi CERN EU-DataGrid Project Leader June 2001
DLM-Forum - Barcelona, 7-8 May 2002 Promoting and Supporting Open Archives in Europe: The Open Archives Forum Project Donatella Castelli IEI-CNR
1 Doingbusiness in 2006 Creating Jobs Simeon Djankov Manager, Doing Business Project, World Bank September 15, 2005 Belgrade.
Toulouse, May 2011, Slide 1 20 x 20. Toulouse, May 2011, Slide 2 20 x 20.
GROWING REGIONS, GROWING EUROPE Fourth Report on Economic and Social Cohesion By Prof. Danuta Hübner Brussels, 30 May 2007.
MEDIA Distribution Berlin MEDIA Day 11 February 2008.
CSL 13 TORINO Some information. GENERAL SUBMISSIONS 103 ACCEPTED 37 ACCEPTANCE RATE0,36 REVIEWS332 EXTERNAL REVIEWERS199 EXTERNAL REVIEWS227.
How much do you know about Europe? The European Day of Languages 26 th September 1Lancashire County Council.
INAF experience in Grid projects F. Pasian INAF. Wed 17 May GRID.IT Project The GRID.IT Project The GRID.IT Project –Application 1 Accessing Databases.
Are we where the Jews are? LCJE – CEO conference, France May 18-22, 2009 Rolf G. Heitmann.
ESO-ESA Existing Activities Archives, Virtual Observatories and the Grid.
BAU 2011 Europe’s building industry after the crisis – What now? Erich Gluch ifo Institute for Economic Research, Munich BAU Information Talks on 28 October.
NRT AQ data provision for Turkey. NRT air quality display - ozone.
ASTRO-WISE Science “A new approach to astronomical archiving & researching for the data- flooded era” Gijs Verdoes Kleijn OmegaCEN, Kapteyn Astronomical.
Results of the Food Circle/HANNN project - Food for Healthy Ageing Seminar Action plan for the future of organic production in the EU: time for regions.
Welcome to CERN Accelerating Science and Innovation 2 nd March 2015 – Bidders Conference – DO-29161/EN.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Infrastructure overview Arnold Meijster &
Lofar Survey workshop 8/3/2007 Lofar -Surveys and AstroWise OmegaCEN NOVA – Kapteyn Institute -RuG 8 March 2007 Lofar Survey Workshop OmegaCEN NOVA – Kapteyn.
NWO Meeting 24 May 04 a Virtual Survey System AstroWise- OmegaCAM – Lofar – Euro-VO a Virtual Survey System AstroWise- OmegaCAM – Lofar – Euro-VO Edwin.
XLDB -Lyon Aug 2009 Astro-WISE -> TarGet OmegaCEN – TarGet Kapteyn Astronomical Institute University of Groningen 28 August 2009 UU OmegaCEN – TarGet Kapteyn.
Welcome to CERN Research Technology Training Collaborating.
Knowledge Management LXV International Council Meeting Qawra, Malta 16 th - 23 rd of March 2014.
Poverty & Human Capability 101 Introductory Class.
The importance of being ERIC Developments in cross-European data sharing.
Development of Censuses in Europe and Development for EC Statistical Co-operation European Commission (Eurostat) Jurgen Heimann UNFPA/PARIS 21 International.
C ross-European data sharing made easy EDAF Luxembourg.
Markus Dolensky, ESO Technical Lead The AVO Project Overview & Context ASTRO-WISE ((G)A)VO Meeting, Groningen, 06-May-2004 A number of slides are based.
Results of the HPC in Europe Taskforce (HET) e-IRG Workshop Kimmo Koski CSC – The Finnish IT Center for Science April 19 th, 2007.
Rackspace Analyst Event Tim Bell
Astro-WISE & Grid Fokke Dijkstra – Donald Smits Centre for Information Technology Andrey Belikov – OmegaCEN, Kapteyn institute University of Groningen.
Capitalist. Main Points In a capitalist or free-market country, people can own their own businesses and property. People can also buy services for private.
The LHC Computing Grid – February 2008 The Worldwide LHC Computing Grid Dr Ian Bird LCG Project Leader 25 th April 2012.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks LOFAR Archive Information System Kor Begeman.
Astro-WISE workshop 2008 Astro-WISE Astro-WISE workshop Lorentz center Leiden OmegaCEN NOVA – Kapteyn Institute – University Groningen 31 March – 4 April.
SPACE. What is the ISS? The International Space Station.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Integration of Astro-WISE with Grid storage.
Virtual Survey System sept 04 ASTRO-WISE- federation OmegaCEN AstroWise a Virtual Survey System OmegaCAM – Lofar – AstroGrid –((G)A) VO AstroWise a Virtual.
Prologue Major VO objective: “Data at your fingertips” (Lawrence) VO-user’s desire: “going backstage” –Data quality assessment by user (talk Gilmore)
The LHC Computing Grid – February 2008 The Challenges of LHC Computing Dr Ian Bird LCG Project Leader 6 th October 2009 Telecom 2009 Youth Forum.
Les Les Robertson LCG Project Leader High Energy Physics using a worldwide computing grid Torino December 2005.
The Astro-Wise Federation … staying connected Lorentz center, Monday, 31 March 2008.
The GRADE website and membership Yngve Falck-Ytter, M.D. Case Western Reserve University School of Medicine Barcelona, January 12&13, 2012 GRADE January.
EXTREME MAKEOVER Members’ Magazine LXIV International Council Meeting Opatija, Croatia October 28 th - November 3 rd 2013.
WelcomeWelcome CSEM – CERN Day 23 rd May 2013 CSEM – CERN Day 23 rd May 2013 to Accelerating Science and Innovation to Accelerating Science and Innovation.
CERN as a World Laboratory: From a European Organization to a global facility CERN openlab Board of Sponsors July 2, 2010 Rüdiger Voss CERN Physics Department.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarksEGEE-III INFSO-RI Astro-Wise and EGEE.
EURO-VO: GRID and VO Lofar Information System Design OmegaCEN Kapteyn Institute TARGET- Computing Center University Groningen Garching, 10 April 2008 Lofar.
Lofar Information System on GRID A.N.Belikov. Lofar Long Term Archive Prototypes: EGEE Astro-WISE Requirements to data storage Tiers Astro-WISE adaptation.
Introduction to the VO ESAVO ESA/ESAC – Madrid, Spain.
E u r o g u i d a n c e A Network of National Resource and Information Centres for Guidance Established in 1992.
Stakeholder Relations at Large-Scale Infrastructures The CERN Model Rolf Heuer 7 th Canadian Science Policy Conference, Ottawa, 26 November 2015.
Gijs Verdoes Kleijn Edwin Valentijn Marjolein Cuppen for the Astro-WISE consortium.
Data Presentation Data Presentation Frances A. Pfab.
Northern Europe Label the following countries on the next page, using the color each countries is labeled in, then add capitals to each country using a.
The European Law Students’ Association Albania ˙ Austria ˙ Azerbaijan ˙ Belgium ˙ Bosnia and Herzegovina ˙ Bulgaria ˙ Croatia ˙ Cyprus ˙ Czech Republic.
F. Genova, AstroNET meeting, Poitiers The Astrophysical Virtual Observatory.
The Mission of CERN  Push back  Push back the frontiers of knowledge E.g. the secrets of the Big Bang …what was the matter like within the first moments.
Berlin Observatory Berlin, Germany. What is it? The Berlin Observatory is a series of observatories and related organizations in and around the city of.
USD billion
The 5 minutes tour of CERN The 5 minutes race of CERN
DISTRIBUTION AUTOMATIC - GENERATION
VO – NOVA/NL wp3/wp5 Optical SURVEYS Lofar VST-OMEGACAM:
EGEE NA4 Lofar Lofar Information System Design OmegaCEN
The European Parliament – voice of the people
The European Parliament – voice of the people
Adriatic Persian Gulf Map Test #1 Answers.
Adriatic Persian Gulf Map Test #1 Answers.
European representation of respiratory critical care HERMES participants. European representation of respiratory critical care HERMES participants. Countries.
2006 Rank Adjusted for Purchasing Power
Presentation transcript:

Edwin A. Valentijn Prof Astronomical Information Technology Target- OmegaCEN – Kapteyn University of Groningen e-science platform 29 October2013 Target DATA FEDERATIONS Probing Big data for Answers using Data about Data

Target Dit project wordt medegefinancierd door het Europees Fonds voor Regionale Ontwikkeling en door het ministerie van EZ, Pieken in de Delta. Het project wordt mede mogelijk gemaakt door de gemeente Groningen, de provincie Groningen, de provincie Drenthe en SNN en staat onder auspiciën van Sensor Universe.

Data federations datacentric approach • Federated dataservers • Our own • GPFS • GRID • Federated databases • Oracle • Open source • Distributed computing Target

AstroWise -> Wise “living archives” • Modeling dependencies • 64 bit identifyer • Terabytes of pointers • Extreme datalineage ++ • Distributed-acces-proces- calibrate- QC –analysis • KiDs • 11 nodes-260 users • 2Pb, 45M file • 10 Giga table entries • Web + Python interface Target Experimental Astronomy Volume 35 januari 2013 Topical issue 19 papers 389 pages Leiden Groningen Bonn Munich Padua Naples Potsdam Nijmegen Toulouse WFAU CASU VO Lyon Zürich

Distributed communities acces-proces-calibrate-analyse Present KiDS o researchers ~10 labs Future Euclid: o 1200 registered members and growing o 700 researchers o 130 laboratories/departments o 13 European countries contributing: Austria, Denmark, France, Finland, Germany, Italy, Netherlands, Norway, Spain,Switzerland, Portugal, Romania, UK o NASA/US: provides the IR detectors. o Canada: in negociation

LOWISE – LOFAR LTA Target EGEE Julich – SARA GRID ftp 5 Petabyte/year EGEE Julich – SARA GRID ftp 5 Petabyte/year

MuseWISE Target ESO VLT IFS 24 IFU 100 Gb/night

National Archive Target

Integration Lifelines – Healthcare persons- 30 years LifeWise AstroInformatics 2011 METABASE MOLGENIS Molecular Care Physiology GCC

Target

IJKDIJK TNO -Target Holding - Dijkdatacenter Target

Euclid Mission Archive Target – ESA data centric approach Target

Euclid Archive System data centric approach Target Metadata Repository ESAC + RUG