ESGF and ES-DOC Documenting climate models and their simulations ES-DOC current and future plans Working with ESGF Eric Guilyardi, Balaji, Cecelia DeLuca,

Slides:



Advertisements
Similar presentations
Seite 1 Heinz Nixdorf Zentrum für Informationsmanagement in der Max-Planck-Gesellschaft 17 Oct 2002 Gerhard Beier MPG eDocument Server Building an institutional.
Advertisements

E-Science and Open Access, Data, Science, … a Nordic perspective Sverker Holmgren Director The Nordic e-Science Globalisation Initiative.
Earth System CoG and the Earth System Grid Federation: A Partnership for Improved Data Management and Project Coordination BESSIG March 18, 2014 Boulder,
What can we do with controlled vocabularies? The PIMMS story Charlotte Pascoe May 11 th 2012, Rutherford Appleton Laboratory.
AGU 2013 IN21D-07 :: The ES-DOC Project.
AGU 2013 IN22A-07 :: The ES-DOC Software Process.
CMIP6 and how observations can inform evaluation
Preparing CMOR for CMIP6 and other WCRP Projects
FAO and UNESCO-IOC/IODE Combine Efforts in their Support of Open Access Written by Marc Goovaerts, U. Hasselt, BE.
M. Lautenschlager, H. Ramthun 1 Metafor Review 5 / 2010.
Meta Dater Metadata Management and Production System for surveys in Empirical Socio-economic Research A Project funded by EU under the 5 th Framework Programme.
METAFOR and the role of standards To be presented at First DRIVER Summit SUB Göttingen, 16th-17th January th e-Infrastructure Concertation Event.
M. Stockhause et al. Martina Stockhause, Michael Lautenschlager, Frank Toussaint Deutsches Klimarechenzentrum (DKRZ) World Data Centre for Climate (WDCC)
Modelling and Data Centre Requirements: CEDA ESGF UV-CDAT Conference December 2014 Philip Kershaw, Centre for Environmental Data Archival, RAL Space,
A Scalable Framework for the Collaborative Annotation of Live Data Streams Thesis Proposal Tao Huang
OpenMDR: Generating Semantically Annotated Grid Services Rakesh Dhaval Shannon Hastings.
Z EGU Integration of external metadata into the Earth System Grid Federation (ESGF) K. Berger 1, G. Levavasseur 2, M. Stockhause 1, and M. Lautenschlager.
Eric Guilyardi (LOCEAN/IPSL and Univ. Reading) and the Metafor team Common Metadata for Climate Modelling Digital Repositories IS-ENES kick-off meeting.
Open Archives for Library and Information Science: an international experience Antonella de Robbio and Paula Sequeiros IV EBIB Conference: Open Access.
OpenMDR: Alternative Methods for Generating Semantically Annotated Grid Services Rakesh Dhaval Shannon Hastings.
1 Eric Guilyardi and the Metafor team Common Metadata for Climate Modelling Digital Repositories Metafor Dissemination Workshop Abingdon, 14 March 2011.
Metadata Creation with the Earth System Modeling Framework Ryan O’Kuinghttons – NESII/CIRES/NOAA Kathy Saint – NESII/CSG July 22, 2014.
The Earth System Curator Metadata Representations Prototype Portal in Collaboration with ESMF and ESG Rocky Dunlap Spencer Rugaber Georgia Tech.
Dr. Jūratė Kuprienė Director for innovations and infrastructure development Workshop: Information services for research process , Rīga Research.
Metafor Year 2 review: 29 th April 2010 Work Package 7 – Training and Dissemination.
Science Archives in the 21st Century 25/26 April Towards an International standard for Audit and Certification of Digital Repositories David Giaretta.
CIM – The Common Information Model in Climate Research
Sarah Callaghan: British Atmospheric Data Center Sylvia Murphy: NOAA/CIRES CISL Seminar, August 29 th, National Center for Atmospheric Research, Boulder.
NE II NOAA Environmental Software Infrastructure and Interoperability Program Cecelia DeLuca Sylvia Murphy V. Balaji GO-ESSP August 13, 2009 Germany NE.
Bryan Lawrence on behalf of BADC, BODC, CCLRC, PML and SOC An Introduction to NDG concepts [ ]=
CF Conventions Support at BADC Alison Pamment Roy Lowry (BODC)
Metadata Concepts / Use in Climate Research Stephan Kindermann, Martina Stockhause German Climate Computing Center (DKRZ) Hamburg, Germany.
Using the Open Metadata Registry (openMDR) to create Data Sharing Interfaces October 14 th, 2010 David Ervin & Rakesh Dhaval, Center for IT Innovations.
Call with D. Maraun Statistical Downscaling Controlled Vocabulary 5 DEC 2013.
Creating and Operating a Digital Library for Information and Learning– the GROW Project Muniram Budhu Department of Civil Engineering & Engineering Mechanics.
Joint agINFRA & SCI-BUS workshop, 30/05/2013, Budapest, Hungary FP 7-INFRASTRUCTURES programme agINFRA Joint agINFRA & SCI-BUS workshop agINFRA.
1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.
Software Engineering Committee Status Report: Preliminary Findings and Recommendations Richard Loft and Gerry Wiener SE Committee Co-chairs National Center.
Data Publication and Quality Control Procedure for CMIP5 / IPCC-AR5 Data WDC Climate / DKRZ:
TCH, 9/9/8 A common world-view? The meta-for metamodel Bryan Lawrence.
Questionnaire Project Plan Alpha development Beta development Release for CMIP5 approval Production Phase After CMIP5 Questionnaire 01 Jan 2010 – 30 Dec.
Principle Investigator : Eric Guilyardi IPSL/Reading Lois Steenman-Clark NCAS, University of Reading Leader of METAFOR Work Package 2 GO-ESSP Seattle 2008.
- EGU 2010 ESSI May Building on the CMIP5 effort to prepare next steps : integrate community related effort in the every day workflow to.
Sarah Callaghan 1, Eric Guilyardi 2, Charlotte Pascoe 3 and the Metafor Project Team 1 BADC- UK, 2 University of Reading, UK.
- Vendredi 27 mars PRODIGUER un nœud de distribution des données CMIP5 GIEC/IPCC Sébastien Denvil Pôle de Modélisation, IPSL.
…building the next IT revolution From Web to Grid…
Portable Infrastructure for the Metafor Metadata System Charlotte Pascoe 1, Gerry Devine 2 1 NCAS-BADC, 2 NCAS-CMS University of Reading PIMMS provides.
SimDB Implementation & Browser IVOA InterOp 2008 Meeting, Theory Session 1. Baltimore, 26/10/2008 Laurent Bourgès This work makes use of EURO-VO software,
Alison Pamment 1, Steve Donegan 1, Calum Byrom 2, Oliver Clements 3, Bryan Lawrence 1, Roy Lowry 3 1 NCAS/BADC, Science and Technology Facilities Council,
1 Accomplishments. 2 Overview of Accomplishments  Sustaining the Production Earth System Grid Serving the current needs of the climate modeling community.
Sarah Callaghan 1, Gerry Devine 2, Eric Guilyardi 3, Bryan Lawrence 1, Charlotte Pascoe 1, Lois Steenman-Clark 2 and the Metafor Project Team 1 NCAS-BADC;
M. Stockhause 1, G. Levavasseur 2, K. Berger 1 1 Deutsches Klimarechenzentrum (DKRZ) 2 Institute Pierre Simon Laplace (IPSL) ESGF-QCWT Quality Control.
Earth System Curator and Model Metadata Discovery and Display for CMIP5 Sylvia Murphy and Cecelia Deluca (NOAA/CIRES) Hannah Wilcox (NCAR/CISL) Metafor.
Open Archive Forum Rachel Heery UKOLN, University of Bath UKOLN is funded by Resource: The Council for Museums, Archives.
LLNL-PRES-XXXXXX This work was performed under the auspices of the U.S. Department of Energy by Lawrence Livermore National Laboratory under contract DE-AC52-07NA27344.
The Modeling Circle Courtesy M. Lautenschlager, DKRZ.
Institutional data curation implementation 1st African Digital Curation Conference 12 February 2008.
Application of RDF-OWL in the ESG Ontology Sylvia Murphy: Julien Chastang: Luca Cinquini:
1 Alison Pamment, 2 Calum Byrom, 1 Bryan Lawrence, 3 Roy Lowry 1 NCAS/BADC,Science and Technology Facilities Council, 2 Tessella plc, 3 British Oceanogrphic.
EMI is partially funded by the European Commission under Grant Agreement RI Open Source Software and the ScienceSoft Initiative Alberto DI MEGLIO,
International Planetary Data Alliance Registry Project Update September 16, 2011.
The Earth System Curator Metadata Infrastructure for Climate Modeling Rocky Dunlap Georgia Tech.
Metadata Support for Model Intercomparison Projects Sylvia Murphy: Cecelia DeLuca: Julien.
Metafor Year 3 Meeting, March 2011 Governance. Metafor Year 3 Meeting, March 2011 What does metafor leave behind? The CIM –UML –XSD –Vocbularies (mindmaps)
Metafor Year 3 EU Review CIM Component Services. Of itself an Ontology is an inert artefact, i.e. a dictionary. CON-CIM Conceptual CIM.
AP7/AP8: Long-Term Archival of CMIP6 Data
aspects of archive system design
The Re3gistry software and the INSPIRE Registry
School of Information Studies, Syracuse University, Syracuse, NY, USA
RDA uptake activities and plans: ESGF
Presentation transcript:

ESGF and ES-DOC Documenting climate models and their simulations ES-DOC current and future plans Working with ESGF Eric Guilyardi, Balaji, Cecelia DeLuca, Sébastien Denvil, Mark Greenslade, Bryan Lawrence, Sylvia Murphy, Karl Taylor + = ESGF & UV-CDAT meeting, Livermore - December 2013

Why ES-DOC Document underlying science in climate models and whys and hows of simulations (forcing, protocol, …) Understand differences and similarities in multi- model ensembles Use of climate model data expanding Maturity and openness of model development Essential building block of professional documentation (with CF, DOI, …) Legacy joint venture of METAFOR (EU) and CURATOR (US) projects Guilyardi et al. (BAMS 2013)

ES-DOC = creation, exploitation and dissemination of standards Climate modelling metadata conceptual model: the Common Information Model (CIM) -> ConCIM (UML) Real life application: CMIP5 -> AppCIM (XML) – Questionnaire, database, CIM tools (viewer, comparator) Definition of controlled vocabulary (CV) Part of CMIP standards Governance of standards

4 Conceptual Model Climate Modelling = an activity using a software to produce data on a grid to be archived in a repository. UML Application Model Application Model XSD RDF PCMDI XML An essential aim is that the conceptual model is not changed by the manner in which it is used or applied. IPSL BADC e.g. CIM e.g. CMIP5 The CONCIM to APPCIM

5 Novelty in community: Software CV Gathering a way of describing (in a community consistent way) the scientific properties of model subcomponents Controlled Vocabulary 570 controlled questions - hundred of choices ! Creating the CV mindmap

cf. Mark Greenslade presentation Thursday

ES-DOC and CMIP5 metadata status What we have today: – The CIM: strategic community effort effort here to stay, several projects already leveraging from it – CMIP5 documentation: 42 models and 600 simulations described in CIM database – a unique ressource – contributes to AR5 (model table), articles… – A set of controlled vocabulary – CIM tools: viewer and comparator (web service) – Governance: ES-DOC. EU-US close collaboration, management and development process – Community « education » that such efforts contribute to scientific process, credibility of projections and showcase of climate models

CMIP5 database quality control – Role of model development groups vs. role of users (e.g. annotation) ? Governance of CIM and CV Extension of scope (downscaling, …) CIM tools ecosystem development Prepare CMIP6: – Core and tier 1 documentation ? – New generation of capture tool, better separation of concerns – Quality control, peer-review, DOIs Sustained funding on top of « ad-hoc » institutional funding and projects (IS-ENES2, PIMMS, ex-Arch,… ) Next steps and challenges

Coherence of data/metadata structure and contents (e.g. 8 realms not useful for IPCC report) – via CMIP or new data panel ? ESGF/ES-DOC human and technical coordination – For development and operations – On web services, new ESGF deployments include metadata checks, etc… How do we organise coordination for CMIP6 ? Similar governance and funding challenges Working with ESGF

12 The CONCIM Software Data Activity Grid CIM versions available at: Climate Modelling = an activity using a software to produce data on a grid to be archived in a repository.