Michael Lautenschlager World Data Center Climate Model and Data / Max-Planck-Institute for Meteorology German Climate Computing Centre (DKRZ)

Slides:



Advertisements
Similar presentations
Preservation and Long Term Access of Data at the World Data Centre for Climate Frank Toussaint N.P. Drakenberg, H. Höck, M. Lautenschlager, H. Luthardt,
Advertisements

ESCI/CMIP5 Tools - Jeudi 2 octobre CMIP5 Tools Earth System Grid-NetCDF4- CMOR2.0-Gridspec-Hyrax …
CG & GIS Lab: Igor Antolović Vladan Mihajlović Dejan Rančić SEEVCCC: Dragan Mihić Vladimir Đur đ ević Republic Hydrometeorologica l service of Serbia 12th.
Long-term Archiving of Climate Model Data at WDC Climate and DKRZ Michael Lautenschlager WDC Climate / Max-Planck-Institute for Meteorology, Hamburg Data.
M. Lautenschlager, H. Ramthun 1 Metafor Review 5 / 2010.
M.Lautenschlager (WDCC/MPI-M) / / 1 The CEOP Model Data Archive at the World Data Center for Climate as part of the CEOP Data Network CEOP / IGWCO.
Anthropogenic Climate Change in the World Climate Research Programme 2007 A. Henderson-Sellers Director, World Climate Research Programme.
METAFOR and the role of standards To be presented at First DRIVER Summit SUB Göttingen, 16th-17th January th e-Infrastructure Concertation Event.
M. Stockhause et al. Martina Stockhause, Michael Lautenschlager, Frank Toussaint Deutsches Klimarechenzentrum (DKRZ) World Data Centre for Climate (WDCC)
German Cluster of WDCs for Earth System Research - Entwurf - Michael Lautenschlager 1, Michael Diepenbroek 2, Hannes Grobe 2, Michael Bittner 3, Jens Klump.
Review on 5 Years DataCite and 10 Years DOI Registration for Data DataCite Annual Conference 2014 Nancy, August 25th – 26th Michael Lautenschlager (DKRZ.
Preservation and Long Term Access of Data at the World Data Centre for Climate Frank Toussaint N.P. Drakenberg, H. Höck, S. Kindermann, M. Lautenschlager,
M.Lautenschlager (WDCC / MPI-M) / / 1 GO-ESSP at LLNL Livermore, June 19th – 21st, 2006 World Data Center Climate: Status and Portal Integration.
M. Lautenschlager (M&D/MPIM)1 The CERA Database Michael Lautenschlager Modelle und Daten Max-Planck-Institut für Meteorologie Workshop "Definition.
Z EGU Integration of external metadata into the Earth System Grid Federation (ESGF) K. Berger 1, G. Levavasseur 2, M. Stockhause 1, and M. Lautenschlager.
Eric Guilyardi (LOCEAN/IPSL and Univ. Reading) and the Metafor team Common Metadata for Climate Modelling Digital Repositories IS-ENES kick-off meeting.
Coordinated Energy and water-cycle Observations Peroject A Well Organized Data Archive System Data Integrating/Archiving Center at University of Tokyo.
1 Eric Guilyardi and the Metafor team Common Metadata for Climate Modelling Digital Repositories Metafor Dissemination Workshop Abingdon, 14 March 2011.
IS-ENES [ees-enes] InfraStructure for the European Network for Earth System Modelling IS-ENES will develop a virtual Earth System Modelling Resource Centre.
CIM – The Common Information Model in Climate Research
Presented by The Earth System Grid: Turning Climate Datasets into Community Resources David E. Bernholdt, ORNL on behalf of the Earth System Grid team.
The Tyndall Centre comprises nine UK research institutions. It is funded by three Research Councils - NERC, EPSRC and ESRC – and receives additional support.
Initiatives toward Climate Services in France and in the European Communities C. Déandreis (CNRS/IPSL); M. Plieger and W. Som de Cerff (KNMI); Ph. Dandin,
Metadata Concepts / Use in Climate Research Stephan Kindermann, Martina Stockhause German Climate Computing Center (DKRZ) Hamburg, Germany.
F. Toussaint (WDCC, Hamburg) / / 1 CERA : Data Structure and User Interface Frank Toussaint Michael Lautenschlager World Data Center for Climate.
Bulk Metadata Structures in CERA Frank Toussaint, Michael Lautenschlager Max-Planck-Institut für Meteorologie World Data Center for Climate.
M.Lautenschlager (WDCC, Hamburg) / / 1 Semantic Data Management for Organising Terabyte Data Archives Michael Lautenschlager World Data Center.
M.Lautenschlager (WDCC, Hamburg) / / 1 Semantic Data Management for Organising Terabyte Data Archives Michael Lautenschlager World Data Center.
Long-term Archiving of Climate Model Data at WDC Climate and DKRZ Michael Lautenschlager WDC Climate / Max-Planck-Institute for Meteorology, Hamburg Wolfgang.
M.Lautenschlager (WDCC, Hamburg) / / 1 Training-Workshop Facilities and Sevices for Earth System Modelling Integrated Model and Data Infrastructure.
Data Publication and Quality Control Procedure for CMIP5 / IPCC-AR5 Data WDC Climate / DKRZ:
M.Lautenschlager (WDCC, Hamburg) / / 1 ICSU World Data Center For Climate Semantic Data Management for Organising Terabyte Data Archives Michael.
Principle Investigator : Eric Guilyardi IPSL/Reading Lois Steenman-Clark NCAS, University of Reading Leader of METAFOR Work Package 2 GO-ESSP Seattle 2008.
Technical and social requirements for a putative AR5 distributed database of simulation and other data Bryan Lawrence (obviously et.al.)
- EGU 2010 ESSI May Building on the CMIP5 effort to prepare next steps : integrate community related effort in the every day workflow to.
- Vendredi 27 mars PRODIGUER un nœud de distribution des données CMIP5 GIEC/IPCC Sébastien Denvil Pôle de Modélisation, IPSL.
Michael Lautenschlager, Hannes Thiemann, Frank Toussaint WDC Climate / Max-Planck-Institute for Meteorology, Hamburg Joachim Biercamp, Ulf Garternicht,
IPCC TGICA and IPCC DDC for AR5 Data GO-ESSP Meeting, Seattle, Michael Lautenschlager World Data Center Climate Model and Data / Max-Planck-Institute.
The CF Conventions: Options for Sustained Support Involving Unidata Russ Rew Unidata Policy Committee May 12, 2008.
The Repository of the World Data Centre for Climate Frank Toussaint, Michael Lautenschlager Max-Planck-Institut für Meteorologie Repositories in Research.
PSI Meta Data meeting, Toulouse - 15 November The CERA C limate and E nvironment data R etrieval and A rchiving system at MPI-Met / M&D S. Legutke,
WP6/SA2: Access to IS-ENES Data Federation SA2 is a European distributed data infrastructure providing access to data from ESM simulations produced in.
H. Widmann (M&D) Data Discovery and Processing within C3Grid GO-ESSP/LLNL / June, 19 th 2006 / 1 Data Discovery and Basic Processing within the German.
Lautenschlager + Thiemann (M&D/MPI-M) / / 1 Introduction Course 2006 Services and Facilities of DKRZ and M&D Integrating Model and Data Infrastructure.
Product-Generation in ESG: some explorations of the user experience Steve Hankin – March, 2007.
1 Adventures in Web Services for Large Geophysical Datasets Joe Sirott PMEL/NOAA.
1 Accomplishments. 2 Overview of Accomplishments  Sustaining the Production Earth System Grid Serving the current needs of the climate modeling community.
1 Overall Architectural Design of the Earth System Grid.
SCD Research Data Archives; Availability Through the CDP About 500 distinct datasets, 12 TB Diverse in type, size, and format Serving 900 different investigators.
1 Final Report on WTF-CEOP JAXA Prototype system Satoko Horiyama MIURA JAXA/Earth Observation Research Center.
1 Summary. 2 ESG-CET Purpose and Objectives Purpose  Provide climate researchers worldwide with access to data, information, models, analysis tools,
1 Earth System Grid Center for Enabling Technologies (ESG-CET) Overview ESG-CET Team Climate change is not only a scientific challenge of the first order.
Welcome to the PRECIS training workshop
Create XML from a template Browse available records WDCC Metadata Generation with GeoNetwork Hans Ramthun, Michael Lautenschlager, Hans-Hermann Winter.
IPCC WG II + III Requirements for AR5 Data Management GO-ESSP Meeting, Paris, Michael Lautenschlager, Hans Luthardt World Data Center Climate.
Hannes Thiemann Michael Lautenschlager Deutsches Klimarechenzentrum GmbH, Germany EGU 2010.
Weather Observations have been made on this site in Stockholm since 1756 probably the longest unbroken series of observations in the world.
M. Lautenschlager (M&D/MPIM)1 WDC on Climate as Part of the CERA 1 Database System Michael Lautenschlager Modelle und Daten Max-Planck-Institut.
Sources of Climate Information and the WB Climate Data Portal Michael I. Westphal CC Team ENV SDN Week 26/2/08.
The British Atmospheric Data Centre Alison Pamment Kevin Marsh.
CAS2K11 in Annecy, France September 11 – 14, 2011 Data Infrastructures at DKRZ Michael Lautenschlager.
The TIGGE Model Validation Portal: An Improvement in Data Interoperability 1 Thomas Cram Doug Schuster Hannah Wilcox Michael Burek Eric Nienhouse Steven.
2005 – 06 – - ESSP1 WDC Climate : Web Access to Metadata and Data Frank Toussaint World Data Center for Climate (M&D/MPI-Met, Hamburg)
Approaches and Challenges in Managing Persistent Identifiers
AP7/AP8: Long-Term Archival of CMIP6 Data
World Conference on Climate Change October 24-26, 2016 Valencia, Spain
Data Citation Service for CMIP6 and IPCC DDC Aspects
Climate Data Analytics in a Big Data world
Summary for Policymakers: Key Points AR5 – WG II
Comeaux and Worley, NSF/NCAR/SCD
Presentation transcript:

Michael Lautenschlager World Data Center Climate Model and Data / Max-Planck-Institute for Meteorology German Climate Computing Centre (DKRZ)

 AR4 DM for IPCC WG I has been performed by PCMDI within CMIP 3  AR4 DM for WG II + III has been performed by BADC and WDCC within the IPCC DDC  Main drawbacks: ◦ Different data sources were used in the IPCC AR4 (CMIP 3 in WG I, IPCC TAR still in WG II + III) ◦ Field based data access only for the subset of time series in the IPCC DDC (monthly means of surface climatology) ◦ No reference data archive has been conserved in AR4 except IPCC DDC 2

3

4

5

6

7 Full CERA metadata

8

 Requirements for model data: ◦ Data products are expected and not model raw data ◦ Complete daily / sub-daily time series of individual variables, climate indices, climate extremes  Requirements for metadata (browse + use): ◦ Searchable data repository including information to decide on the usefulness of the data entity (e.g. experiment, model, variable, etc.)  METAFOR ◦ Complete information to allow for data processing and use the model data (e.g. grid, variable, unit, time)  GRIDSPEC 9

 Requirements for services: ◦ Instructions how to use the data (guidance material) ◦ Data processing options for aggregation and extraction in time and space and for visualization ◦ Specific user support (FAQs and help desk / request tracker) 10

 Database for IPCC AR5 will be produced within CMIP5  Range of estimates for amount of data for CMIP5 requested variables archive 0.6 – 1.2 PB (September 2009)  Two different layers of data management are involved: ◦ Production and archive creation within CMIP5 as scientific research data archive ◦ Permanent archiving within IPCC Reference Data Archive which is presently the IPCC DDC (WDCC + BADC for GCM data + products)  Memorandum of Understanding between BADC, PCMDI and WDCC/DKRZ to share data mangement responsibility for CMIP5 / IPCC AR5 (Dec. 2008) 11

12 PCMDI: 0.75 PByte WDCC: 0.75 PByte BADC: 0.75 PByte Gateway PCMDI 1.5 PB Data Nodes: MPI-M / DKRZ Hadley Centre / BADC IPSL NCAR GFDL Other Centres Gateway BADC / IPCC DDC Gateway WDCC / IS-ENES Mirrors: Australia Japane Other ? CMIP5 Requested Variables IPCC AR5 Reference Data Archive (snapshot end of 2010) CMIP5/AR5 Data Federation

13 (Partly) open issues  Sharing responsibilities within the CMIP5/AR5 federation after taking the IPCC AR5 data snapshot ◦ Continuation of CMIP5 scientific data archive ◦ Permanent archiving of IPCC AR5 reference data archive and generation of application adapted data products  Data products and services in IPCC DDC ◦ 30 year means ◦ Extremes ◦ Field-based data access ◦ Re-gridding of complex grids to regular lat-lon grid ◦ Extraction of geographical subregions ◦ Format conversion (Excel, GIS) ◦ Visualisatuon ◦ Guidance Material ◦ FAQ and help desk ◦ …….