1. ESMF Development Status and Plans ESMF 4 th Community Meeting Cecelia DeLuca July 21, 2005 Climate Data Assimilation Weather

2. Outline Where we are now Where we are going Challenges

3. ESMF Development Status Overall, component-based architecture is well-defined Serial or parallel execution (mpiuni stub library) Concurrent or sequential execution, single executable Logically rectangular grids with regular and arbitrary distributions can be represented and regular distributions can be regridded On-line parallel regridding (bilinear, 1 st order conservative) implemented and optimized Other parallel methods - e.g. halo, redistribution, low-level comms implemented Utilities such as time manager, logging, and configuration manager usable and adding features Virtual machine with hooks for load balancing implemented Fortran interfaces and complete documentation, some C++ interfaces

4. Growing ESMF Customer Base Original ESMF applications: NOAA GFDL atmospheres NOAA GFDL MOM4 ocean NOAA NCEP atmospheres, analyses NASA GMAO models and GEOS-5 NASA/COLA Poseidon ocean LANL POP ocean NCAR WRF NCAR CCSM MITgcm atmosphere and ocean Other groups adopting ESMF: NASA GISS UCLA CSU NASA Land Information Systems (LIS) project NOAA Integrated Dynamics in Earth’s Atmosphere (IDEA) project, more… New applications coming in during FY05 through the newly funded, ESMF-based DoD Battlespace Environments Institute (BEI): DoD Navy HYCOM ocean DoD Navy NOGAPS atmosphere DoD Navy COAMPS coupled atm-ocean DoD Air Force GAIM ionosphere DoD Air Force HAF solar wind DoD Army ERDC WASH123 watershed More new applications will begin adopting ESMF during FY06 through the ESMF-based NASA Modeling Analysis and Prediction (MAP) Climate Variability and Change program. Further growth of the customer base is anticipated through partnership with space weather computational environments.

5. Supported Platforms and the ESMF Test Suite IBM AIX (32 and 64 bit addressing) SGI IRIX64 (32 and 64 bit addressing) Compaq OSF1 (64 bit addressing) Linux Intel (32 and 64 bit addressing, with mpich and lam) Linux PGI (32 bit addressing, with mpich) Linux NAG (32 bit addressing, with mpich) Linux Absoft (32 bit addressing, with mpich) Linux Lahey (32 bit addressing, with mpich) Mac XLF (32 bit addressing, with lam) Mac Absoft (32 bit addressing, with lam) SGI Altix (64 bit addressing) Cray X1 (64 bit addressing) The ESMF Test Suite consists of ~1500 unit tests, ~17 system tests, ~40 examples. The Suite is run nightly on the platforms above. The ESMF Test Suite is bundled with the ESMF source code so that users can run it themselves for verification, debugging, and porting.

6. Planned ESMF Extensions Support for representing, partitioning, communicating with, and regridding data based on general curvilinear coordinates and unstructured grids Advanced support for data assimilation systems, including data structures for observational data and adjoints for ESMF methods Looser couplings: support for multiple executable and Grid-enabled versions of ESMF I/O including asynchronous I/O Support for nested, moving grids and adaptive grids Support for regridding in three dimensions and between different coordinate systems Advanced optimization and load balancing

7. Current Development Challenges Refocus of core team on grid development, production quality and performance, increased customer support – new balance of tasks, new hires Rework mid-level data structures for more advanced decompositions and grids – ensure the framework is usable for real, complex applications ◦Integrate mid-level data structures with advanced low level communications (threading, chunking, load balancing) ◦Create a mid-level array class that offers a set of commonly used index space communications ◦Increase generality of the decomposition and grid representation ◦Add options such as masking to grids and arrays ◦Increase grid and regrid extensibility (read/write grids, read/write interpolation weights, interface for user registration of new grids and their methods) Many new requirements ◦New tool for tracking requirements (DOORS) ◦New mechanism for prioritizing design and implementation tasks (CRB)

8. This Time Next Year… Representation, regridding, communication methods for grids with general curvilinear coordinates Representation, regridding, communication methods for unstructured grids and location streams Read/write interpolation weights and read/write grid specifications Robust netCDF-based IO capability Fully-featured utilities (config attributes, logging, Tau timers)