ESMF Development Status and Plans ESMF 4 th Community Meeting Cecelia DeLuca July 21, 2005 Climate Data Assimilation Weather.

Slides:

Advertisements

Similar presentations

NSF NCAR | NASA GSFC | DOE LANL ANL | NOAA NCEP GFDL | MIT | U MICH Arlindo da Silva, NASA/GSFC/GMAO The Earth System Modeling Framework.

Advertisements

NSF NCAR | NASA GSFC | DOE LANL ANL | NOAA NCEP GFDL | MIT | U MICH Emergence of the Earth System Modeling Framework NSIPP Seasonal Forecast.

Earth System Curator Spanning the Gap Between Models and Datasets.

WRF Modeling System V2.0 Overview

CCSM Testing Status Tony Craig Lawrence Buja Wei Yu CCSM SEWG Meeting Feb 5, 2003.

21 July 20054th ESMF Community Meeting Overview of the Battlespace Environments Institute Rick Allard Naval Research Laboratory Stennis Space Center, MS.

1 Earth System Modeling Framework ESMF and the Transformation of Earth System Modeling Sylvia Murphy

Integrated Frameworks for Earth and Space Weather Simulation Timothy Killeen and Cecelia DeLuca National Center for Atmospheric Research, Boulder, Colorado.

NSF NCAR | NASA GSFC | DOE LANL ANL | NOAA NCEP GFDL | MIT | U MICH Architecture of the Earth System Modeling Framework GMAO Seasonal.

Introduction to the Earth System Modeling Framework Nancy Collins July 22, 2005 Climate Data Assimilation Weather.

Mesoscale & Microscale Meteorological Division / NCAR ESMF and the Weather Research and Forecast Model John Michalakes, Thomas Henderson Mesoscale and.

The Earth System Modeling Framework and the Earth System Curator Cecelia DeLuca and the ESMF Joint Specification Team.

Earth System Modeling Framework Capabilities Cecelia DeLuca SCD Users Forum May 18, GMAO.

Components and Concurrency in ESMF Nancy Collins Community Meeting July 21, GMAO Seasonal.

NSF NCAR | NASA GSFC | DOE LANL ANL | NOAA NCEP GFDL | MIT Adoption and field tests of M.I.T General Circulation Model (MITgcm) with ESMF Chris Hill ESMF.

NSF NCAR | NASA GSFC | DOE LANL ANL | NOAA NCEP GFDL | MIT | U MICH First Field Tests of ESMF GMAO Seasonal Forecast NCAR/LANL CCSM NCEP.

1 NOAA’s Environmental Modeling Plan Stephen Lord Ants Leetmaa November 2004.

Metadata Creation with the Earth System Modeling Framework Ryan O’Kuinghttons – NESII/CIRES/NOAA Kathy Saint – NESII/CSG July 22, 2014.

CCSM Software Engineering Coordination Plan Tony Craig SEWG Meeting Feb 14-15, 2002 NCAR.

Fast Parallel Grid Remapping for Unstructured and Structured Grids Robert Oehmke NOAA Cooperative Institute for Research in Environmental Sciences University.

Earth System Modeling Infrastructure Cecelia DeLuca/ESMF-NCAR March 31-April 1, 2009 CHyMP Meeting.

Project Overview GMAO Seasonal Forecast NCAR/LANL CCSM NCEP Forecast GFDL FMS Suite MITgcm NASA GMAO Analysis Climate Data Assimilation.

What is ESMF and what does it mean to adopt it? 3 rd ESMF Community Meeting Cecelia DeLuca Nancy Collins

NE II NOAA Environmental Software Infrastructure and Interoperability Program Cecelia DeLuca Sylvia Murphy V. Balaji GO-ESSP August 13, 2009 Germany NE.

Coordination of Common Modeling Infrastructure Cecelia DeLuca WGCM/WMP Meeting, Exeter, UK Oct 6, 2005 Climate Data Assimilation Weather.

Cecelia DeLuca, Don Stark, Chris Hill Arctic System Model Workshop May 20, 2008 Earth System Modeling Framework.

Computational Design of the CCSM Next Generation Coupler Tom Bettge Tony Craig Brian Kauffman National Center for Atmospheric Research Boulder, Colorado.

Initial Results from the Integration of Earth and Space Frameworks Cecelia DeLuca/NCAR, Alan Sussman/University of Maryland, Gabor Toth/University of Michigan.

1 CW 2015, Manchester, 04/ Coupling technology benchmarking in IS-ENES2 Coupling technology benchmarking in IS-ENES2 IS-ENES2 WP10-T3 Evaluation.

ESMF Application Status GMAO Seasonal Forecast NCAR/LANL CCSM NCEP Forecast GFDL FMS Suite MITgcm NCEP/GMAO Analysis Climate Data Assimilation.

Introduction to the Earth System Modeling Framework V. Balaji, GFDL Cecelia DeLuca, Chris Hill, MIT

The use of modeling frameworks to facilitate interoperability Cecelia DeLuca/NCAR (ESMF) Bill Putman/NASA GSFC (MAPL) David Neckels/NCAR.

ESMF Performance Evaluation and Optimization Peggy Li(1), Samson Cheung(2), Gerhard Theurich(2), Cecelia Deluca(3) (1)Jet Propulsion Laboratory, California.

Integrated Model Data Management S.Hankin ESMF July ‘04 Integrated data management in the ESMF (ESME) Steve Hankin (NOAA/PMEL & IOOS/DMAC) ESMF Team meeting.

ARGONNE NATIONAL LABORATORY Climate Modeling on the Jazz Linux Cluster at ANL John Taylor Mathematics and Computer Science & Environmental Research Divisions.

Earth System Modeling Framework Status Cecelia DeLuca NOAA Cooperative Institute for Research in Environmental Sciences University of Colorado, Boulder.

Introduction to the Earth System Modeling Framework International Workshop on Next Generation Climate Models for Advanced High Performance Computing Facilities.

ESMF/Curator Status Cecelia DeLuca CCSM Software Engineering Working Group Boulder, CO March 16, 2007 Climate Data Assimilaton Weather.

30 November 2004ESMF Interagency Working Group Meeting Battlespace Environments Institute Overview Rick Allard Oceanography Division NRL Stennis.

Components, Coupling and Concurrency in the Earth System Modeling Framework N. Collins/NCAR, C. DeLuca/NCAR, V. Balaji/GFDL, G. Theurich/SGI, A. da Silva/GSFC,

Earth System Modeling Framework Workshop on “Coupling Technologies for Earth System Modelling : Today and Tomorrow” CERFACS, Toulouse (France) – Dec 15.

ESMF Status and Future Plans Cecelia DeLuca BEI Technical Review Boulder, CO March 13-14, 2007 Climate Data Assimilaton Weather.

Earth System Modeling Framework Python Interface (ESMP) October 2011 Ryan O’Kuinghttons Robert Oehmke Cecelia DeLuca.

August 2001 Parallelizing ROMS for Distributed Memory Machines using the Scalable Modeling System (SMS) Dan Schaffer NOAA Forecast Systems Laboratory (FSL)

Strategic Plan Implementation Cecelia DeLuca/NCAR (ESMF) December 17, 2008 ESMF Board/Interagency Meeting.

Slides for NUOPC ESPC NAEFS ESMF. A NOAA, Navy, Air Force strategic partnership to improve the Nation’s weather forecast capability Vision – a national.

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH May 15, 2003 Nancy Collins, NCAR 2nd Community Meeting, Princeton, NJ Earth System.

NCEP ESMF GFS Global Spectral Forecast Model Weiyu Yang, Mike Young and Joe Sela ESMF Community Meeting MIT, Cambridge, MA July 21, 2005.

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH 15 May 2003 Cecelia DeLuca / NCAR 2 nd ESMF Community Meeting Princeton, NJ NSIPP Seasonal.

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH May 14, 2003 Nancy Collins, NCAR Components Workshop, Princeton, NJ Components in the.

CCSM Performance, Successes and Challenges Tony Craig NCAR RIST Meeting March 12-14, 2002 Boulder, Colorado, USA.

1 National Environmental Modeling System (NEMS) Status M. Iredell and EMC Staff.

Extension of the ESMF for Space Weather Cecelia DeLuca SWW April 7, NSIPP Seasonal Forecast.

Earth System Curator and Model Metadata Discovery and Display for CMIP5 Sylvia Murphy and Cecelia Deluca (NOAA/CIRES) Hannah Wilcox (NCAR/CISL) Metafor.

WRF Software Development and Performance John Michalakes, NCAR NCAR: W. Skamarock, J. Dudhia, D. Gill, A. Bourgeois, W. Wang, C. Deluca, R. Loft NOAA/NCEP:

The Earth System Modeling Framework Robert Oehmke, Gerhard Theurich, Cecelia DeLuca NOAA Cooperative Institute for Research in Environmental Sciences University.

Toward GSI Community Code Louisa Nance, Ming Hu, Hui Shao, Laurie Carson, Hans Huang.

ESMF,WRF and ROMS. Purposes Not a tutorial Not a tutorial Educational and conceptual Educational and conceptual Relation to our work Relation to our work.

Building Community and Capability through Common Infrastructure: ESMF and the Earth System Curator Cecelia DeLuca MAP Meeting College.

SDM Center High-Performance Parallel I/O Libraries (PI) Alok Choudhary, (Co-I) Wei-Keng Liao Northwestern University In Collaboration with the SEA Group.

Enhancements for Hydrological Modeling in ESMF Cecelia DeLuca/NCAR (ESMF) December 19, 2008 AGU Fall Meeting.

ESMF Change Review Board Robert Ferraro ESMF Board Meeting Dec 17, 2008 Climate Data Assimilation Weather.

Emergence of a Common Modeling Architecture for Earth System Science American Geophysical Union December 13, 2010 Cecelia DeLuca NOAA/CIRES.

ESMF and the future of end-to-end modeling Sylvia Murphy National Center for Atmospheric Research

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH C. DeLuca/NCAR, J. Anderson/NCAR, V. Balaji/GFDL, B. Boville/NCAR, N. Collins/NCAR,

A Quick Tour of the NOAA Environmental Software Infrastructure and Interoperability Group Cecelia DeLuca Dr. Robert Detrick visit March 28, 2012

GMAO Seasonal Forecast

GMAO Seasonal Forecast

ESPC Air-Ocean-Land-Ice Global Coupled Prediction

ESMF Governance Cecelia DeLuca NOAA CIRES / NESII April 7, 2017

Presentation transcript:

ESMF Development Status and Plans ESMF 4 th Community Meeting Cecelia DeLuca July 21, 2005 Climate Data Assimilation Weather

Outline Where we are now Where we are going Challenges

ESMF Development Status Overall, component-based architecture is well-defined Serial or parallel execution (mpiuni stub library) Concurrent or sequential execution, single executable Logically rectangular grids with regular and arbitrary distributions can be represented and regular distributions can be regridded On-line parallel regridding (bilinear, 1 st order conservative) implemented and optimized Other parallel methods - e.g. halo, redistribution, low-level comms implemented Utilities such as time manager, logging, and configuration manager usable and adding features Virtual machine with hooks for load balancing implemented Fortran interfaces and complete documentation, some C++ interfaces

Growing ESMF Customer Base Original ESMF applications: NOAA GFDL atmospheres NOAA GFDL MOM4 ocean NOAA NCEP atmospheres, analyses NASA GMAO models and GEOS-5 NASA/COLA Poseidon ocean LANL POP ocean NCAR WRF NCAR CCSM MITgcm atmosphere and ocean Other groups adopting ESMF: NASA GISS UCLA CSU NASA Land Information Systems (LIS) project NOAA Integrated Dynamics in Earth’s Atmosphere (IDEA) project, more… New applications coming in during FY05 through the newly funded, ESMF-based DoD Battlespace Environments Institute (BEI): DoD Navy HYCOM ocean DoD Navy NOGAPS atmosphere DoD Navy COAMPS coupled atm-ocean DoD Air Force GAIM ionosphere DoD Air Force HAF solar wind DoD Army ERDC WASH123 watershed More new applications will begin adopting ESMF during FY06 through the ESMF-based NASA Modeling Analysis and Prediction (MAP) Climate Variability and Change program. Further growth of the customer base is anticipated through partnership with space weather computational environments.

Supported Platforms and the ESMF Test Suite IBM AIX (32 and 64 bit addressing) SGI IRIX64 (32 and 64 bit addressing) Compaq OSF1 (64 bit addressing) Linux Intel (32 and 64 bit addressing, with mpich and lam) Linux PGI (32 bit addressing, with mpich) Linux NAG (32 bit addressing, with mpich) Linux Absoft (32 bit addressing, with mpich) Linux Lahey (32 bit addressing, with mpich) Mac XLF (32 bit addressing, with lam) Mac Absoft (32 bit addressing, with lam) SGI Altix (64 bit addressing) Cray X1 (64 bit addressing) The ESMF Test Suite consists of ~1500 unit tests, ~17 system tests, ~40 examples. The Suite is run nightly on the platforms above. The ESMF Test Suite is bundled with the ESMF source code so that users can run it themselves for verification, debugging, and porting.

Planned ESMF Extensions Support for representing, partitioning, communicating with, and regridding data based on general curvilinear coordinates and unstructured grids Advanced support for data assimilation systems, including data structures for observational data and adjoints for ESMF methods Looser couplings: support for multiple executable and Grid-enabled versions of ESMF I/O including asynchronous I/O Support for nested, moving grids and adaptive grids Support for regridding in three dimensions and between different coordinate systems Advanced optimization and load balancing

Current Development Challenges Refocus of core team on grid development, production quality and performance, increased customer support – new balance of tasks, new hires Rework mid-level data structures for more advanced decompositions and grids – ensure the framework is usable for real, complex applications ◦Integrate mid-level data structures with advanced low level communications (threading, chunking, load balancing) ◦Create a mid-level array class that offers a set of commonly used index space communications ◦Increase generality of the decomposition and grid representation ◦Add options such as masking to grids and arrays ◦Increase grid and regrid extensibility (read/write grids, read/write interpolation weights, interface for user registration of new grids and their methods) Many new requirements ◦New tool for tracking requirements (DOORS) ◦New mechanism for prioritizing design and implementation tasks (CRB)

This Time Next Year… Representation, regridding, communication methods for grids with general curvilinear coordinates Representation, regridding, communication methods for unstructured grids and location streams Read/write interpolation weights and read/write grid specifications Robust netCDF-based IO capability Fully-featured utilities (config attributes, logging, Tau timers)