Earth System Curator and Model Metadata Discovery and Display for CMIP5 Sylvia Murphy and Cecelia Deluca (NOAA/CIRES) Hannah Wilcox (NCAR/CISL) Metafor.

Slides:



Advertisements
Similar presentations
Panel 2 – Promoting Re-Use of Scientific Collections John Harrison SHAMAN Project University of Liverpool
Advertisements

Earth System CoG and the Earth System Grid Federation: A Partnership for Improved Data Management and Project Coordination BESSIG March 18, 2014 Boulder,
NSF NCAR | NASA GSFC | DOE LANL ANL | NOAA NCEP GFDL | MIT | U MICH Emergence of the Earth System Modeling Framework NSIPP Seasonal Forecast.
Earth System Curator Spanning the Gap Between Models and Datasets.
Metadata Development in the Earth System Curator Spanning the Gap Between Models and Datasets Rocky Dunlap, Georgia Tech.
Development of an Integrated Earth System Climate Modeling Environment
Aug. 20, JPL, SoCalBSI '091 The power of bioinformatics tools in cancer research Early Detection Research Network, JPL Mentors: Dr. Chris Mattmann,
Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.
Robust Tools for Archiving and Preserving Digital Data Joseph JaJa, Mike Smorul, and Mike McGann Institute for Advanced Computer Studies Department of.
Tools and Services for the Long Term Preservation and Access of Digital Archives Joseph JaJa, Mike Smorul, and Sangchul Song Institute for Advanced Computer.
Weather Research & Forecasting Model (WRF) Stacey Pensgen ESC 452 – Spring ’06.
CLIMATE SCIENTISTS’ BIG CHALLENGE: REPRODUCIBILITY USING BIG DATA Kyo Lee, Chris Mattmann, and RCMES team Jet Propulsion Laboratory (JPL), Caltech.
A Quick Tour of the NOAA Environmental Software Infrastructure and Interoperability Group Cecelia DeLuca and the ESMF team ESRL Directorate Seminar June.
CCSM Portal/ESG/ESGC Integration (a PY5 GIG project) Lan Zhao, Carol X. Song Rosen Center for Advanced Computing Purdue University With contributions by:
Providing Access to Your Data: Access Mechanisms Robert R. Downs, PhD NASA Socioeconomic Data and Applications Center (SEDAC) Center for International.
The Earth System CoG Collaboration Environment Sylvia Murphy and Cecelia DeLuca (NOAA/CIRES), and Luca Cinquini (NASA/JPL) AGU Ocean Sciences February.
1 Eric Guilyardi and the Metafor team Common Metadata for Climate Modelling Digital Repositories Metafor Dissemination Workshop Abingdon, 14 March 2011.
Metadata Creation with the Earth System Modeling Framework Ryan O’Kuinghttons – NESII/CIRES/NOAA Kathy Saint – NESII/CSG July 22, 2014.
The Earth System Curator Metadata Representations Prototype Portal in Collaboration with ESMF and ESG Rocky Dunlap Spencer Rugaber Georgia Tech.
Sarah Callaghan: British Atmospheric Data Center Sylvia Murphy: NOAA/CIRES CISL Seminar, August 29 th, National Center for Atmospheric Research, Boulder.
Metadata for the Coupled Ocean/Atmosphere Mesoscale Prediction System (COAMPS) using the Earth System Modeling Framework (ESMF) Peter Bosler University.
NE II NOAA Environmental Software Infrastructure and Interoperability Program Cecelia DeLuca Sylvia Murphy V. Balaji GO-ESSP August 13, 2009 Germany NE.
Elements of a Data Management Plan: Identifying the materials to be created Ruth Duerr National Snow and Ice Data Center Version Review Date Section:
The Earth System Grid (ESG) Goals, Objectives and Strategies DOE SciDAC ESG Project Review Argonne National Laboratory, Illinois May 8-9, 2003.
The use of modeling frameworks to facilitate interoperability Cecelia DeLuca/NCAR (ESMF) Bill Putman/NASA GSFC (MAPL) David Neckels/NCAR.
Semantically-Enabled Science Data Integration (SESDI) and The Virtual Solar-Terrestrial Observatory (VSTO) Semantically-enabled (large-scale) Scientific.
Fisheries Oceanography Collaboration Software Donald Denbo NOAA/PMEL-UW/JISAO Presented by Nancy Soreide NOAA/PMEL AMS 2002/IIPS 10.3.
Software Engineering Committee Status Report: Preliminary Findings and Recommendations Richard Loft and Gerry Wiener SE Committee Co-chairs National Center.
Earth System Modeling Framework Status Cecelia DeLuca NOAA Cooperative Institute for Research in Environmental Sciences University of Colorado, Boulder.
Introduction to the Earth System Modeling Framework International Workshop on Next Generation Climate Models for Advanced High Performance Computing Facilities.
Large Scale Nuclear Physics Calculations in a Workflow Environment and Data Provenance Capturing Fang Liu and Masha Sosonkina Scalable Computing Lab, USDOE.
Components, Coupling and Concurrency in the Earth System Modeling Framework N. Collins/NCAR, C. DeLuca/NCAR, V. Balaji/GFDL, G. Theurich/SGI, A. da Silva/GSFC,
1 Earth System Modeling Framework Documenting and comparing models using Earth System Curator Sylvia Murphy: Julien Chastang:
The Earth System Grid (ESG) Computer Science and Technologies DOE SciDAC ESG Project Review Argonne National Laboratory, Illinois May 8-9, 2003.
Land Ice Verification and Validation (LIVV) Kit Weak scaling behavior for a large dome- shaped test case. It shows that the scaling behavior of a new run.
- Vendredi 27 mars PRODIGUER un nœud de distribution des données CMIP5 GIEC/IPCC Sébastien Denvil Pôle de Modélisation, IPSL.
ESG Observational Data Integration Presented by Feiyi Wang Technology Integration Group National Center of Computational Sciences.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Portable Infrastructure for the Metafor Metadata System Charlotte Pascoe 1, Gerry Devine 2 1 NCAS-BADC, 2 NCAS-CMS University of Reading PIMMS provides.
The Global Land Cover Facility is sponsored by NASA and the University of Maryland.The GLCF is a founding member of the Federation of Earth Science Information.
May 6, 2002Earth System Grid - Williams The Earth System Grid Presented by Dean N. Williams PI’s: Ian Foster (ANL); Don Middleton (NCAR); and Dean Williams.
Strategic Plan Implementation Cecelia DeLuca/NCAR (ESMF) December 17, 2008 ESMF Board/Interagency Meeting.
Exporting WaterML from the Earth System Modeling Framework Xinqi Wang Louisiana State University NCAR SIParCS Program August 4, 2009.
1 Accomplishments. 2 Overview of Accomplishments  Sustaining the Production Earth System Grid Serving the current needs of the climate modeling community.
| nectar.org.au NECTAR TRAINING Module 2 Virtual Laboratories and eResearch Tools.
1 Summary. 2 ESG-CET Purpose and Objectives Purpose  Provide climate researchers worldwide with access to data, information, models, analysis tools,
Building Community and Capability through Common Infrastructure: ESMF and the Earth System Curator Cecelia DeLuca MAP Meeting College.
Toward a common data and command representation for quantum chemistry Malcolm Atkinson Director 5 th April 2004.
O AK R IDGE N ATIONAL L ABORATORY U.S. D EPARTMENT OF E NERGY Data Requirements for Climate and Carbon Research John Drake, Climate Dynamics Group Computer.
Global Change Master Directory (GCMD) Mission “To assist the scientific community in the discovery of Earth science data, related services, and ancillary.
Emergence of a Common Modeling Architecture for Earth System Science American Geophysical Union December 13, 2010 Cecelia DeLuca NOAA/CIRES.
ESMF and the future of end-to-end modeling Sylvia Murphy National Center for Atmospheric Research
Application of RDF-OWL in the ESG Ontology Sylvia Murphy: Julien Chastang: Luca Cinquini:
The Earth Information Exchange. Portal Structure Portal Functions/Capabilities Portal Content ESIP Portal and Geospatial One-Stop ESIP Portal and NOAA.
Climate Modeling in a Browser The Development of an Earth System Climate Modeling Science Gateway Carol X. Song, Ph.D. Senior Research Scientist Rosen.
The Global Organization for Earth System Science Portals Don Middleton National Center for Atmospheric Research; Boulder, Colorado, USA Scientific Computing.
Metadata Development in the Earth System Curator Spanning the Gap Between Models and Datasets Rocky Dunlap, Georgia Tech 5 th GO-ESSP Community Meeting.
A WEB-ENABLED APPROACH FOR GENERATING DATA PROCESSORS University of Nevada Reno Department of Computer Science & Engineering Jigar Patel Sohei Okamoto.
Cyberinfrastructure Overview of Demos Townsville, AU 28 – 31 March 2006 CREON/GLEON.
Using a Simple Knowledge Organization System to facilitate Catalogue and Search for the ESA CCI Open Data Portal EGU, 21 April 2016 Antony Wilson, Victoria.
Enabling Digital Earth by focussing on ‘accessibility’ rather than ‘delivery’. Ryan Fraser CSIRO.
The Earth System Curator Metadata Infrastructure for Climate Modeling Rocky Dunlap Georgia Tech.
Metadata Support for Model Intercomparison Projects Sylvia Murphy: Cecelia DeLuca: Julien.
A Quick Tour of the NOAA Environmental Software Infrastructure and Interoperability Group Cecelia DeLuca Dr. Robert Detrick visit March 28, 2012
Joseph JaJa, Mike Smorul, and Sangchul Song
WGISS Connected Data Assets Oct 24, 2018 Yonsook Enloe
Malte Dreyer – Matthias Razum
Metadata Development in the Earth System Curator
Bird of Feather Session
Data Management Components for a Research Data Archive
Presentation transcript:

Earth System Curator and Model Metadata Discovery and Display for CMIP5 Sylvia Murphy and Cecelia Deluca (NOAA/CIRES) Hannah Wilcox (NCAR/CISL) Metafor Dissemination Meeting, Abingdon UK March 14, 2011

Outline Background (CIM within ESG): – What is Curator? – What is the Earth System Grid (ESG)? – Metadata and the Curator Project – Trackback display features Background (CIM within ESMF): – The Earth System Modeling Framework (ESMF) – How ESMF is implementing the CIM Live Demonstration of CMIP5 model metadata in ESG

What is Curator? The Curator project collaboratively develops software infrastructure to support end-to-end modeling in the Earth sciences. – Span the gaps between modeling and data services. – Use metadata to internally document models. – Automate routine processes with workflow software. – Develop software infrastructure that can facilitate the governance of community software projects within the Earth sciences. One important focus is preparing for CMIP5. Curator’s role in CMIP5 is to serve as a liaison between METAFOR and the Earth System Grid (ESG) and to implement the display of CMIP5 metadata in the ESG Gateway.

CMIP5 Metadata and Curator Making sense of CMIP5 data in the quantity expected requires a significant improvement the metadata associated with the data. – Metadata about the fields and units within the files. – Metadata about the grids associated with the fields. – Metadata about the models that generated the data. This involves many groups across the U.S. and internationally – ESG, Curator, the NOAA Geophysical Fluid Dynamics Laboratory (GFDL), the DOE Program for Climate Model Diagnosis and Intercomparison (PCMDI), METAFOR, and others.

What is the Earth System Grid (ESG)? The Earth System Grid (ESG) integrates supercomputers with large- scale data and analysis servers located at numerous national labs and research centers to create a powerful system of federated Data Gateways. Goals – Make data more useful for researchers and policy makers. – Meet the needs of international climate projects for distributed databases, data access and data movement. – Provide a universal, Web-based data access portal for multi-model, observational, and reanalysis data collections. – Provide a wide range of climate data-analysis tools and diagnostic methods to international and U.S. climate centers. The Earth System Grid - Center for Enabling Technologies (ESG-CET) is funded by the U.S. Department of Energy as part of the SciDAC (Scientific Discovery through Advanced Computing) program. Content courtesy of Dean Williams (PCMDI) and Don Middleton (NCAR) from the ESG website and Cyberinfrastructure and the Global Environmental Data Challenge", Feb 2011, e-Science Institute, Edinburgh

ESG’s Federated Architecture Image courtesy of Luca Cinquini (NASA) and used with the permission of Don Middleton (NCAR) from Cyberinfrastructure and the Global Environmental Data Challenge", Feb 2011, e-Science Institute, Edinburgh

Display Features: Tabs and Component Trees

Display Features: Pop-up Definitions

The Earth System Modeling Framework (ESMF) The ESMF is high-performance software infrastructure for building weather, climate, and related models. It enables models to be organized as sets of components representing physical domains and processes, such as atmospheres, oceans, and land masses. The components can be reused in different contexts and shared by multiple research and operational centers. ESMF also provides toolkits for common modeling functions, so modelers don't need to develop those utilities independently. One of these utilities is an Attribute Class that can be used to make models self-describing. ESMF is used in the U.S. in both operational and research models.

An Example of an ESMF Application NASA’s GEOS-5 Atmospheric General Circulation Model is built from the ground up using ESMF. – Each of the boxes is an ESMF component, including the couplers. – The hierarchical tree of components can be "snipped" at different levels so that the whole physics package could be replaced, or a single parameterization.

ESMF and the CIM ESMF is implementing the CIM as a series of nestable Attribute Packages that can then be exported at model initialization as a CIM XML. This work is ongoing, but as of ESMF release 5.2.0, which was released in Feb 2011, ESMF supports: – General component description – Responsible parties – ISO citations – Platform descriptions – Couplings/Inputs – Field descriptions These features are currently being implemented into a version of the Community Earth System Model (CESM).

Resources PCMDI: ESG: Earth System Curator: ESMF: