Presentation is loading. Please wait.

Presentation is loading. Please wait.

Www.esmf.ucar.edu Strategic Plan Implementation Cecelia DeLuca/NCAR (ESMF) December 17, 2008 ESMF Board/Interagency Meeting.

Published byDuane Hood Modified over 8 years ago

Similar presentations

Presentation on theme: "Www.esmf.ucar.edu Strategic Plan Implementation Cecelia DeLuca/NCAR (ESMF) December 17, 2008 ESMF Board/Interagency Meeting."— Presentation transcript:

1 www.esmf.ucar.edu Strategic Plan Implementation Cecelia DeLuca/NCAR (ESMF) December 17, 2008 ESMF Board/Interagency Meeting

2 www.esmf.ucar.edu Strategic objectives through 2010 1.Complete functionality and increase ease of use 2.Integrate ESMF into science gateways 3.Support integration into applications

3 www.esmf.ucar.edu Release Plan 2002 2003 2004 2005 2006 2007 2008 2009 2010 ESMF v1 Prototype ESMF v3 Index Space Operations ESMF_ArraySparseMatMul() ESMF v4 Grid Operations ESMF_GridCreate() ESMF_FieldRegrid() ESMFv5 Standardization Build, init, data types, error handling, … Public release May 2008 ESMF v3.1.0r ESMF v2 Components, VM and Utils ESMF_GridCompRun() Complete re-write of data and grid structures for generality and robustness

4 www.esmf.ucar.edu Outstanding functionality From ESMF Strategic Plan: 1. complete an ArrayBundle class that enables optimized data transfers of multiple Arrays 2. complete the Field and FieldBundle communications methods 3. integrate contributed Location Stream code for the representation of observational data 4. complete arbitrary distributions for structured Grids, introduce multi-tile Grid methods, and implement exchange Grids 5. complete the interface to a general regridding package (still need conservative regrid) 6. complete the interface to unstructured Meshes 7. complete a C interface 8. complete a hierarchical attribute package 9. complete a rudimentary IO package 10. complete a compliance tester for components

5 www.esmf.ucar.edu Data representation options ESMF data structures were reworked and released in ESMF v3, starting May 2006. Two options: 1. Representation in index space (Arrays) One or more logically rectangular tiles store indices and topology Sparse matrix multiply for regridding with user supplied interpolation weights Highly scalable - no global information held locally 2. Representation in physical space (Fields) Built on Arrays + some form of Grid Grids may be logically rectangular, unstructured mesh, or based on location of observations Regridding using parallel on-line interpolation weight generation, bilinear or higher order Supported Array distributions

6 www.esmf.ucar.edu Coupling options Single executable Multiple executable Coupling communications can be set up and called in a coupler Coupling communications can be setup in a coupler but called directly from within components – useful when it is inconvenient to return from a component in order to perform a coupling operation Recursive components for nesting higher resolution regions Ensemble management, including sequential execution of ensemble members Comp AComp B Comp A Comp B Contributed by U Maryland Coupler Array send/recv Multiple executable options

7 www.esmf.ucar.edu Results for ESMF higher order regrid in CCSM Interp. noise Interpolation noise in the derivative of the zonal wind stress grid index in latitudinal direction dTAUx/dy - closely related to the curl of the wind stress, which drives the upper ocean circulation and is therefore important to represent accurately in climate simulations Mapped from the T62 (2-degree) Community Atmospheric Model (CAM) grid to the gx1v5 (384x320 irregularly spaced) Noise is calculated as deviation of a point from the sum of itself plus four neighbors 33% reduction in noise globallycompared to current bilinear approach Black = bilinear Red = higher-order ESMF v3.1.1 Green = higher order ESMF v4.0.0

8 www.esmf.ucar.edu Usability Metrics: Bugs 40% reduction from peak (230 to 140)

9 www.esmf.ucar.edu Usability Metrics: Feature Requests 30% reduction from peak (110 to 76)

10 www.esmf.ucar.edu Usability Metrics: Support Requests Holding steady

11 www.esmf.ucar.edu Port and test status 30+ platform/compiler combinations regression tested nightly, new ports include gfortran (4.3) and Solaris, Windows in progress http://www.esmf.ucar.edu/download/platforms Received award to employ the TeraGrid Build & Test service to access additional platforms for testing New test harness for automating the test coverage of a huge grid and distribution parameter space

12 www.esmf.ucar.edu Strategic objectives through 2010 1.Complete functionality and increase ease of use 2.Integrate ESMF into science gateways 3.Support integration into applications

13 www.esmf.ucar.edu Metadata export from ESMF (v4.0) ESMF holds information about grids, component inter-relationships Users can associate additional metadata with ESMF classes (Grids, Arrays, Fields, States, Components) Metadata is stored as name/value pairs in Attribute packages Attribute packages can be standard (e.g CF conventions for Fields) or custom Packages can be nested – for example, metadata for an import State contains metadata for all the Fields in the State. Metadata can be exported in plain text or XML format … then ingested into portal, where users can search and browse components, more (Curator talk) Image courtesy of Rocky Dunlap, Georgia Institute of technology Preview of the portal for dynamical core comparison developed jointly with ESG

14 www.esmf.ucar.edu More on science gateways … Work in progress: translation of ESMF interfaces into web service interfaces to support loose coupling and integration of components into service oriented architectures Will enable invocation of ESMF components and applications from a portal in a Grid-based (e.g. Teragrid) gateway Data and metadata from the run stored back to the portal Image courtesy of Rocky Dunlap, Georgia Institute of technology

15 www.esmf.ucar.edu Strategic objectives through 2010 1.Complete functionality and increase ease of use 2.Integrate ESMF into science gateways 3.Support integration into applications

16 www.esmf.ucar.edu Support and broaden the customer base HAF GAIM Jan 2008

17 www.esmf.ucar.edu ESMF adoption 76 components in the community – most recent additions are CCSM4 dead and data components. (Live coming next…) 4 large production or operational codes running ESMF: ◦NCEP GFS ◦GEOS-5 ◦HYCOM-CICE ◦COAMPS-NCOM Goals from strategic plan for end 2010: ◦100 components ◦20 large production or operational codes running ESMF Image courtesy of Rocky Dunlap, Georgia Institute of technology

18 www.esmf.ucar.edu A peek at the future … 2009 2010 2011 2012 2013 2014 2015 Interoperability Compliance definitions and verification tools Tutorial development and classroom deployment Integration with workflows Generation of service interfaces for loose coupling Metadata links to data and other services Automated model assembly and run environment Based on metadata files Numerical/computational maintenance and development

Download ppt "Www.esmf.ucar.edu Strategic Plan Implementation Cecelia DeLuca/NCAR (ESMF) December 17, 2008 ESMF Board/Interagency Meeting."

Similar presentations

1 NASA CEOP Status & Demo CEOS WGISS-25 Sanya, China February 27, 2008 Yonsook Enloe.

1 NASA CEOP Status & Demo CEOS WGISS-25 Sanya, China February 27, 2008 Yonsook Enloe.
Expanding Regridding Capabilities of the Earth System Modeling Framework Andrew Scholbrock University of Colorado – Boulder Robert Oehmke NOAA/CIRES 1.

Expanding Regridding Capabilities of the Earth System Modeling Framework Andrew Scholbrock University of Colorado – Boulder Robert Oehmke NOAA/CIRES 1.
NSF NCAR | NASA GSFC | DOE LANL ANL | NOAA NCEP GFDL | MIT | U MICH www.esmf.ucar.edu Emergence of the Earth System Modeling Framework NSIPP Seasonal Forecast.

NSF NCAR | NASA GSFC | DOE LANL ANL | NOAA NCEP GFDL | MIT | U MICH Emergence of the Earth System Modeling Framework NSIPP Seasonal Forecast.
Earth System Curator Spanning the Gap Between Models and Datasets.

Earth System Curator Spanning the Gap Between Models and Datasets.
Metadata Development in the Earth System Curator Spanning the Gap Between Models and Datasets Rocky Dunlap, Georgia Tech.

Metadata Development in the Earth System Curator Spanning the Gap Between Models and Datasets Rocky Dunlap, Georgia Tech.
Development of an Integrated Earth System Climate Modeling Environment

Development of an Integrated Earth System Climate Modeling Environment
21 July 20054th ESMF Community Meeting Overview of the Battlespace Environments Institute Rick Allard Naval Research Laboratory Stennis Space Center, MS.

21 July 20054th ESMF Community Meeting Overview of the Battlespace Environments Institute Rick Allard Naval Research Laboratory Stennis Space Center, MS.
1 Earth System Modeling Framework ESMF and the Transformation of Earth System Modeling Sylvia Murphy

1 Earth System Modeling Framework ESMF and the Transformation of Earth System Modeling Sylvia Murphy
Integrated Frameworks for Earth and Space Weather Simulation Timothy Killeen and Cecelia DeLuca National Center for Atmospheric Research, Boulder, Colorado.

Integrated Frameworks for Earth and Space Weather Simulation Timothy Killeen and Cecelia DeLuca National Center for Atmospheric Research, Boulder, Colorado.
OpenMDR: Generating Semantically Annotated Grid Services Rakesh Dhaval Shannon Hastings.

OpenMDR: Generating Semantically Annotated Grid Services Rakesh Dhaval Shannon Hastings.
Components and Concurrency in ESMF Nancy Collins 2005 Community Meeting July 21, 2005 GMAO Seasonal.

Components and Concurrency in ESMF Nancy Collins Community Meeting July 21, GMAO Seasonal.
NSF NCAR | NASA GSFC | DOE LANL ANL | NOAA NCEP GFDL | MIT Adoption and field tests of M.I.T General Circulation Model (MITgcm) with ESMF Chris Hill ESMF.

NSF NCAR | NASA GSFC | DOE LANL ANL | NOAA NCEP GFDL | MIT Adoption and field tests of M.I.T General Circulation Model (MITgcm) with ESMF Chris Hill ESMF.
4.x Performance Technology drivers – Exascale systems will consist of complex configurations with a huge number of potentially heterogeneous components.

4.x Performance Technology drivers – Exascale systems will consist of complex configurations with a huge number of potentially heterogeneous components.
NSF NCAR | NASA GSFC | DOE LANL ANL | NOAA NCEP GFDL | MIT | U MICH www.esmf.ucar.edu First Field Tests of ESMF GMAO Seasonal Forecast NCAR/LANL CCSM NCEP.

NSF NCAR | NASA GSFC | DOE LANL ANL | NOAA NCEP GFDL | MIT | U MICH First Field Tests of ESMF GMAO Seasonal Forecast NCAR/LANL CCSM NCEP.
Metadata Creation with the Earth System Modeling Framework Ryan O’Kuinghttons – NESII/CIRES/NOAA Kathy Saint – NESII/CSG July 22, 2014.

Metadata Creation with the Earth System Modeling Framework Ryan O’Kuinghttons – NESII/CIRES/NOAA Kathy Saint – NESII/CSG July 22, 2014.
Fast Parallel Grid Remapping for Unstructured and Structured Grids Robert Oehmke NOAA Cooperative Institute for Research in Environmental Sciences University.

Fast Parallel Grid Remapping for Unstructured and Structured Grids Robert Oehmke NOAA Cooperative Institute for Research in Environmental Sciences University.
Www.esmf.ucar.edu Earth System Modeling Infrastructure Cecelia DeLuca/ESMF-NCAR March 31-April 1, 2009 CHyMP Meeting.

Earth System Modeling Infrastructure Cecelia DeLuca/ESMF-NCAR March 31-April 1, 2009 CHyMP Meeting.
ESMF Town Hall Meeting AGU Fall Meeting 2010 San Francisco Gerhard Theurich, Fei Liu, Peggy Li, Cecelia DeLuca NOAA/CIRES December 15, 2010

ESMF Town Hall Meeting AGU Fall Meeting 2010 San Francisco Gerhard Theurich, Fei Liu, Peggy Li, Cecelia DeLuca NOAA/CIRES December 15, 2010
Metadata for the Coupled Ocean/Atmosphere Mesoscale Prediction System (COAMPS) using the Earth System Modeling Framework (ESMF) Peter Bosler University.

Metadata for the Coupled Ocean/Atmosphere Mesoscale Prediction System (COAMPS) using the Earth System Modeling Framework (ESMF) Peter Bosler University.
NE II NOAA Environmental Software Infrastructure and Interoperability Program Cecelia DeLuca Sylvia Murphy V. Balaji GO-ESSP August 13, 2009 Germany NE.

NE II NOAA Environmental Software Infrastructure and Interoperability Program Cecelia DeLuca Sylvia Murphy V. Balaji GO-ESSP August 13, 2009 Germany NE.

Similar presentations

Ads by Google