AP7/AP8: Long-Term Archival of CMIP6 Data

Slides:

Advertisements

Similar presentations

Std-doi Publication of Climate Data at WDCC DataCite Summer Meeting 7./8. June 2010 Publication of climate data Heinke Höck World Data Center for Climate.

Advertisements

ESGF and ES-DOC Documenting climate models and their simulations ES-DOC current and future plans Working with ESGF Eric Guilyardi, Balaji, Cecelia DeLuca,

Providing access to your data: Determining your audience Robert R. Downs, PhD NASA Socioeconomic Data and Applications Center (SEDAC) Center for International.

Preservation and Long Term Access of Data at the World Data Centre for Climate Frank Toussaint N.P. Drakenberg, H. Höck, M. Lautenschlager, H. Luthardt,

Climate Analytics on Global Data Archives Aparna Radhakrishnan 1, Venkatramani Balaji 2 1 DRC/NOAA-GFDL, 2 Princeton University/NOAA-GFDL 2. Use-case 3.

CLIMATE SCIENTISTS’ BIG CHALLENGE: REPRODUCIBILITY USING BIG DATA Kyo Lee, Chris Mattmann, and RCMES team Jet Propulsion Laboratory (JPL), Caltech.

M. Stockhause et al. Martina Stockhause, Michael Lautenschlager, Frank Toussaint Deutsches Klimarechenzentrum (DKRZ) World Data Centre for Climate (WDCC)

German Cluster of WDCs for Earth System Research - Entwurf - Michael Lautenschlager 1, Michael Diepenbroek 2, Hannes Grobe 2, Michael Bittner 3, Jens Klump.

Review on 5 Years DataCite and 10 Years DOI Registration for Data DataCite Annual Conference 2014 Nancy, August 25th – 26th Michael Lautenschlager (DKRZ.

Preservation and Long Term Access of Data at the World Data Centre for Climate Frank Toussaint N.P. Drakenberg, H. Höck, S. Kindermann, M. Lautenschlager,

M.Lautenschlager (WDCC / MPI-M) / / 1 GO-ESSP at LLNL Livermore, June 19th – 21st, 2006 World Data Center Climate: Status and Portal Integration.

M. Lautenschlager (M&D/MPIM)1 The CERA Database Michael Lautenschlager Modelle und Daten Max-Planck-Institut für Meteorologie Workshop "Definition.

Z EGU Integration of external metadata into the Earth System Grid Federation (ESGF) K. Berger 1, G. Levavasseur 2, M. Stockhause 1, and M. Lautenschlager.

IS-ENES [ees-enes] InfraStructure for the European Network for Earth System Modelling IS-ENES will develop a virtual Earth System Modelling Resource Centre.

DOI Registration for Social and Economic Data da|ra Brigitte Hausstein GESIS Leibniz-Institute for the Social Sciences, Berlin.

CIM – The Common Information Model in Climate Research

Providing Access to Your Data: Tracking Data Usage Robert R. Downs, PhD NASA Socioeconomic Data and Applications Center (SEDAC) Center for International.

Metadata Concepts / Use in Climate Research Stephan Kindermann, Martina Stockhause German Climate Computing Center (DKRZ) Hamburg, Germany.

Michael Lautenschlager World Data Center Climate Model and Data / Max-Planck-Institute for Meteorology German Climate Computing Centre (DKRZ)

Bulk Metadata Structures in CERA Frank Toussaint, Michael Lautenschlager Max-Planck-Institut für Meteorologie World Data Center for Climate.

SEEK EcoGrid l Integrate diverse data networks from ecology, biodiversity, and environmental sciences l Metacat, DiGIR, SRB, Xanthoria,... l EML is the.

M.Lautenschlager (WDCC, Hamburg) / / 1 Training-Workshop Facilities and Sevices for Earth System Modelling Integrated Model and Data Infrastructure.

Data Publication and Quality Control Procedure for CMIP5 / IPCC-AR5 Data WDC Climate / DKRZ:

U.S. Department of the Interior U.S. Geological Survey CDI Webinar Series 2013 Data Management at the National Climate Change and Wildlife Science Center.

- EGU 2010 ESSI May Building on the CMIP5 effort to prepare next steps : integrate community related effort in the every day workflow to.

The CERA2 Data Base Data input – Data output Hans Luthardt Model & Data/MPI-M, Hamburg Services and Facilities of DKRZ and Model & Data Hamburg,

- Vendredi 27 mars PRODIGUER un nœud de distribution des données CMIP5 GIEC/IPCC Sébastien Denvil Pôle de Modélisation, IPSL.

H. Thiemann (M&D) / / 1 Hannes Thiemann M&D Statusseminar, 22. April 2004.

IPCC TGICA and IPCC DDC for AR5 Data GO-ESSP Meeting, Seattle, Michael Lautenschlager World Data Center Climate Model and Data / Max-Planck-Institute.

May 6, 2002Earth System Grid - Williams The Earth System Grid Presented by Dean N. Williams PI’s: Ian Foster (ANL); Don Middleton (NCAR); and Dean Williams.

The Repository of the World Data Centre for Climate Frank Toussaint, Michael Lautenschlager Max-Planck-Institut für Meteorologie Repositories in Research.

Data formats and requirements in CMIP6: the climate-prediction case Pierre-Antoine Bretonnière EC-Earth meeting, Reading, May 2015.

PSI Meta Data meeting, Toulouse - 15 November The CERA C limate and E nvironment data R etrieval and A rchiving system at MPI-Met / M&D S. Legutke,

WP6/SA2: Access to IS-ENES Data Federation SA2 is a European distributed data infrastructure providing access to data from ESM simulations produced in.

H. Widmann (M&D) Data Discovery and Processing within C3Grid GO-ESSP/LLNL / June, 19 th 2006 / 1 Data Discovery and Basic Processing within the German.

Lautenschlager + Thiemann (M&D/MPI-M) / / 1 Introduction Course 2006 Services and Facilities of DKRZ and M&D Integrating Model and Data Infrastructure.

1 Accomplishments. 2 Overview of Accomplishments  Sustaining the Production Earth System Grid Serving the current needs of the climate modeling community.

1 Gateways. 2 The Role of Gateways  Generally associated with primary sites in ESG-CET  Provides a community-facing web presence  Can be branded as.

M. Stockhause 1, G. Levavasseur 2, K. Berger 1 1 Deutsches Klimarechenzentrum (DKRZ) 2 Institute Pierre Simon Laplace (IPSL) ESGF-QCWT Quality Control.

Create XML from a template Browse available records WDCC Metadata Generation with GeoNetwork Hans Ramthun, Michael Lautenschlager, Hans-Hermann Winter.

|| Barbara Hirschmann1 Establishing a DOI service for Switzerland’s university and research sector.

The Modeling Circle Courtesy M. Lautenschlager, DKRZ.

SEDAC Long-Term Archive Development Robert R. Downs Socioeconomic Data and Applications Center Center for International Earth Science Information Network.

4 th WCRP Observations and Assimilation Panel Meeting Hamburg, Germany, March 29-31, Workshop on Ensuring Access and Trustworthiness of Climate.

IPCC WG II + III Requirements for AR5 Data Management GO-ESSP Meeting, Paris, Michael Lautenschlager, Hans Luthardt World Data Center Climate.

Hannes Thiemann Michael Lautenschlager Deutsches Klimarechenzentrum GmbH, Germany EGU 2010.

M. Lautenschlager (M&D/MPIM)1 WDC on Climate as Part of the CERA 1 Database System Michael Lautenschlager Modelle und Daten Max-Planck-Institut.

CAS2K11 in Annecy, France September 11 – 14, 2011 Data Infrastructures at DKRZ Michael Lautenschlager.

Weigel, Berger, Kindermann, Lautenschlager EGU Versioning for CMIP6 in the Earth System Grid Federation Data preparation Initial registration.

2005 – 06 – - ESSP1 WDC Climate : Web Access to Metadata and Data Frank Toussaint World Data Center for Climate (M&D/MPI-Met, Hamburg)

1 This slide indicated the continuous cycle of creating raw data or derived data based on collections of existing data. Identify components that could.

Intentions and Goals Comparison of core documents from DFIG and Publishing Workflow IG show that there is much overlap despite different starting points.

CMIP6-DICAD AP 6.1: Installation und Betrieb des ESMValTools in der ESGF DKRZ Infrastruktur Stephan Kindermann1, Björn Brötz2, Veronika Eyring2, and.

Approaches and Challenges in Managing Persistent Identifiers

World Conference on Climate Change October 24-26, 2016 Valencia, Spain

EUDAT’s engagement with the Earth Sciences

DIAS & DIAS data release 2 years DIAS-GCI Cooperation Hiroko KINUTANI DIAS (Data Integration and Analysis System in Japan) , St. Petersburg.

Data Citation Service for CMIP6 and IPCC DDC Aspects

Data Ingestion in ENES and collaboration with RDA

WCRP Modelling Advisory Council (WMAC)

VI-SEEM Data Repository

iSERVOGrid Architecture Working Group Brisbane Australia June

Climate Data Analytics in a Big Data world

CMIP6 / ENES Data TF Meeting: DKRZ

Tech introduction.

Repository Platforms for Research Data Interest Group: Requirements, Gaps, Capabilities, and Progress Robert R. Downs1, 1 NASA.

IS-ENES Cases Seven use cases are listed as data lifecycle steps A B C

A Case Study for Synergistically Implementing the Management of Open Data Robert R. Downs NASA Socioeconomic Data and Applications.

RDA uptake activities and plans: ESGF

Presentation transcript:

AP7/AP8: Long-Term Archival of CMIP6 Data DICAD, 24.01.2017

IPCC Data Distribution Centre (IPCC DDC) DICAD, Long-Term Archival 24.01.2017

IPCC Data Distribution Centre at WDCC IPCC DDC (Data Distribution Centre) – ipcc-data.org jointly managed by: British Atmospheric Data Centre (BADC): climatology World Data Center Climate (WDCC) at DKRZ: Reference Data Archive for climate model output Center for International Earth Science Information Network (CIESIN) at Columbia University: social-economic data archive  Certified ICSU World Data System (WDS) members Reference Data Archive for Climate Model Output The Reference Data Archive provides data on the long-term for an interdisciplinary user community and in support of the IPCC Authors. DICAD, Long-Term Archival 24.01.2017

IPCC DDC Data Services for AR6 Data Creator IPCC Author IPCC DDC User IPCC DDC AR6 Services Earth System Grid Federation (ESGF) CMIP Data Pool IPCC DDC Reference Data Archive CMIP6 (subset) AR6 Replication Long-Term Archival CMIP5 AR5 CORDEX AR4 Derived Products AR3 Analysis Input AR2 DICAD, Long-Term Archival 24.01.2017

DICAD, Long-Term Archival Coordination Efforts Coordination between IPCC DDC and IPCC Working Groups Discussions between DDC Manager and WG I and II have been started in 01/2016 and continued in 09/2016: The contact for the DDC is a TSU member of WG II, which will coordinate IPCC WG requirements with the TSUs of WG I and WG III after a general discussion about data requirements among the WG co-chairs. Coordination with WGCM Infrastructure Panel and Infrastructure Partners Accessibility of ancillary metadata by DRS_id by integration of URL into ESGF index (ESGF working team lead) DICAD, Long-Term Archival 24.01.2017

Long-Term Data Archival: Provide data on the long-term for an interdisciplinary user community = Data (AP8) + Metadata (AP7) DICAD, Long-Term Archival 24.01.2017

Long-Term Archival Workflow Ancillary Metadata Long-Term Archive WDC Climate at DKRZ CERA2 Metadata Data Creator 1 Delivery of Data Transfer of Data by WDCC Metadata Transfer of Use MD by WDCC Transfer of ancill. II. Federated Projects I. DKRZ or Central Projects Temporary Storage 3 Long-Term Archival 2 Technical Quality Assurance 4 DataCite DOI Publication Process Data and Metadata Creators DICAD, Long-Term Archival 24.01.2017

Before LTA: CMIP6 Workflow Workflow for CMIP6 project phase WGCM Infrastructure Panel (WIP) defines standards for data and data documentation (ancillary metadata). Registration of institute and model at: https://github.com/WCRP-CMIP/CMIP6_CVs Contact your local data node for data publication: DKRZ: esgf-publishing@dkrz.de Contact repositories for ancillary metadata on details how to provide your metadata DICAD, Long-Term Archival 24.01.2017

Ancillary Metadata for CMIP6 CIM model and simulation documentations (http://es-doc.org) Data citation information  WIP email (http://cmip6cite.wdc-climate.de; GUI: http://cera-www.dkrz.de/citeXA) Annotation service developed by IPSL and additional information hosted by the institutions and integrated in furtherInfoUrl web page. to scholarly publications and data (part of Citation and CMIP6 Publication Services) Documentation of data quality Citation: Errata: References: ESMVal or other QA Documentation: Part of Data Documentation in Reference Data Archive DICAD, Long-Term Archival 24.01.2017

Long-Term Data Archival: Progress Step 1: Transfer CMIP6 Data and Create Use Metadata Integration of Use Metadata (NetCDF Header) in Archive: Develop structured XML templates for transfer of metadata from ESGF to CERA DB Revise mapping of use metadata to CERA2 schema DICAD, Long-Term Archival 24.01.2017

DICAD, Long-Term Archival Next Steps Goals for next steps: IPCC DDC: IPCC cross-WG Co-Chair's discussion on CMIP6 data requirements initiated by TSUs  integrate IPCC WG data requirements into CMIP6 data pool discussions Long-Term Archival: Enhance structured XMLs to define first working version Check plausibility and completeness of use metadata to be inserted into CERA2 schema Try mapping with test data Citation information mapping to CERA2 schema and technical realization DICAD, Long-Term Archival 24.01.2017

DICAD, Long-Term Archival Summary IPCC DDC: New IPCC DDC service (CMIP data pool) in discussion with IPCC WGs LTA requirements implemented into ESGF (ancillary MD) Long-Term Archival: Interface for ingest of use metadata from NetCDF headers is investigated. DICAD, Long-Term Archival 24.01.2017