1. 1 Earth System Modeling Framework ESMF and the Transformation of Earth System Modeling http://www.esmf.ucar.edu Sylvia Murphy murphys@ucar.edu

2. 2 Outline  What is ESMF?  Who is Using it?  How is ESMF Transforming Earth System Modeling?  Current Development Status  Future Directions

3. 3 What is ESMF? ESMF is a software library that consists of coupling tools and model utilities that increase modularity, interoperability, and performance of geoscience applications.

4. 4 What models are using ESMF? Operational Version of the GFS Weather Forecasting Model GEOS-5 Atmospheric GCM HYCOM Ocean Model COAMPS Atmospheric Model CICE-HYCOM 58 components are currently using ESMF WRF Weather Forecasting Model ADCIRC Hydrodynamic model ADCIRC-WASH123 MIT GCM GFDL FMS MOM4 UCLA AGCM

5. 5 What programs are using ESMF? NUOPC: National Unified Operational Prediction Capability Consortium (NOAA, Navy, Air Force Weather Agency) Has announced intentions to base its next generation National Weather Prediction (NWP) system on ESMF BEI: Battlespace Environments Institute Developing integrated forecasting systems across DoD. MAP: Modeling and Analysis Program Facilitating research and model use of NASA data Image from NOAA rapid refresh (RR) model, a replacement model for the Rapid Update Cycle (RUC) model.

6. 6 The Transformation of Earth System Modeling  How models are structured  How models are developed  The scale of collaborations  Governance strategies for developing community scientific software ESMF is changing:

7. 7 How Models are Structured  Hierarchical component based architecture  Interchangeability  Easy replacement of component elements  Interoperability  Swapping component between applications  Coupling diverse applications

8. 8 How Models are Developed  Large number of components available from across the community  Develop science components for a well-understood community architecture and interfaces  Technological advances are propagated quickly across many applications simultaneously

9. 9 The Scale of Community Collaborations Collaborations across:  Operational centers (e.g CNMOC, COPC, FNMOC)  Research centers (e.g. GFDL, NCAR, NASA Goddard)  Universities (e.g. MIT, University of Hawaii)  Different domains (weather, climate, space weather, hydrology) BEI: Battlespace Environment Institute NUOPC: National Unified Operational Prediction Capability CCSM: Community Climate System Model WRF: Weather Research & Forecasting Model MAP: Modeling Analysis and Prediction Program

10. 10 Governance strategies for developing community scientific software  Distributed, global development  Direct participation of users in setting development priorities  Multi-agency management  Incorporates open-source methodologies into scientific software development Shared governance model emphasizes: esmf_jst@ucar.edu has 300 subscribers who participate in ESMF development

11. 11 ESMF Release Plan 2002 2003 2004 2005 2006 2007 2008 2009 2010 ESMF v1 Prototype ESMF v2 Components, VM and Utils ESMF_GridCompRun() ESMF v3 Index Space Operations ESMF_ArraySparseMatMul() ESMF v4 Grid Operations ESMF_GridCreate() ESMF_FieldRegrid() ESMFv5 Standardization Build, init, data types, error handling, … Last public ESMF v2.2.2r Last internal ESMF v3.0.3

12. 12 Current Features (v3.0.3)  Component-based architecture  Allows serial or parallel execution  Components can run concurrently or sequentially  Single executable support, limited support for multiple executables  Support for model ensembles  User friendly uniform, rectilinear, and curvilinear grid representation  Unstructured and multi-patch grids represented in index space  Regridding via sparse matrix multiply with user defined weights  Utilities such as time manager, message logger, and resource file manager are usable and adding features  Fortran interfaces and complete documentation, increasing number of C interfaces  Distributed with Reference Manual, Users Guide, ~2500 tests and examples  ~2000 downloads

13. 13 Current Supported Platforms  Cray X1  Cray XT3/4  HP ZX6000 Linux intel  IBM Bluegene,  IBM Opteron Linux pathscale  IBM Opteron Linux pgi  IBM SP  MAC G5 Darwin xlf  MAC G5 Darwin xlfgcc  MAC G5 Darwin nag ESMF runs 2500 tests on all these platforms every night  MAC G5 Darwin absoft  Pentium III Linux lahey  Pentium III Linux pgi  Pentium III Linux pgigcc  PC Xeon Cluster Linux absoftintel  PC Xeon Cluster Linux g95  PC Xeon Cluster Linux intel  PC Xeon Cluster Linux nagintel  SGI Altix Linux nagintel  SGI Origin 3800

14. 14 Sparse Matrix Multiply Updated  User supplied weights  Facilitates the widest possible couplings  The methods have the following new features:  Improved performance and reduced memory usage  Support for distributed definition of factors  Support for user-supplied arbitrary sequence indices via 1D DistGrid  Support for ESMF_TYPEKIND_I4/I8/R4/R8  Default initialization of destination Array to zero (can be overridden)

15. 15 New Structured Grids  Support 1D, 2D, 3D and higher dimensions  Supports parallelization across any or all grid dimensions  Supports uniform, rectilinear and curvilinear grids Image of HYPSE (Hydrostatic Padua Surface Elevation Model) Dept.of Physics, Univ. of Padua

16. 16 Near Future: Structured Grids  Multi-tile grids (e.g. cube-sphere)  More efficient memory use for non-curvilinear grids  Coordinate halo  A wide variety of different types of connections between tile edges  Automatic generation of topology and coordinates for common shapes (e.g. sphere) Image courtesy Steve Thomas and Rich Loft, NCAR

17. 17 Near Future: General Regridding Exact curl Curl of bilinear interpolant Curl of patch-recovered interpolant Work conducted by David Neckels/ESMF in collaboration with Bill Large of the ocean modeling section at NCAR.

18. 18 Near Future: Unstructured Grids  Uses same infrastructure as general regridding  Representation for hydrology grids and other grids  Future basis for exchange grids and observational data streams Image of rossby waves on a triangular adaptive grid (Alfred- Wegener-Institute for Polar and Meteorological Forecasting)

19. 19 Longer Term: Interoperability & Integration Initiative  Enable groups with compilations of ESMF components to develop integrated modeling systems  Define standards to increase component interoperability  Metadata conventions  Strategies for automation and supplemental tools (e.g. MAPL) http://esmfi3.org/wiki/

20. 20 Questions? http://www.esmf.ucar.edu