Lautenschlager + Thiemann (M&D/MPI-M) / / 1 Introduction Course 2006 Services and Facilities of DKRZ and M&D Integrating Model and Data Infrastructure (IMDI) and the World Data Center for Climate (WDCC) Michael Lautenschlager + Hannes Thiemann Modelle und Daten Max-Planck-Institut für Meteorologie, Hamburg Hamburg,

Lautenschlager + Thiemann (M&D/MPI-M) / / 2 WDCC IMDI

Lautenschlager + Thiemann (M&D/MPI-M) / / 3 IMDI + WDCC

Lautenschlager + Thiemann (M&D/MPI-M) / / 4 Central Components of IMDI SCE: Standard Compile Environment for flexible model assemblage and compilation SRE: Standard Run Environment for efficient use of HPC architectures WDCC: World Data Center for Climate for long-term archiving and international, interdisciplinary data dissemination according to the rules of the ICSU WDC system

Lautenschlager + Thiemann (M&D/MPI-M) / / 5 Objective and requirements IMDI objective: Integrate any earth system model on any platform …. requires standards for.... Source Codes Component models Coupling software Compilation environment Running environment Quality assessment Postprocessing environment Visualization environment

Lautenschlager + Thiemann (M&D/MPI-M) / / 6 Benefits from IMDI  Common look-and-feel for all models  Common look-and-feel for all platforms  Portability  profit from future developments  Support (M&D, PRISM Team, vendors)  Wide community of users  Facilitation of model exchange within a coupled configuration between institutes  Post-processing, visualisation tools

Lautenschlager + Thiemann (M&D/MPI-M) / / 7 OCEAN Complexity of Earth System Models in IMDI ATMOSPHERE Atmospheric Chemistry Sea Ice OASIS3 Marine Biogeo- chemistry Land Surface

Lautenschlager + Thiemann (M&D/MPI-M) / / 8 Model configurations adapted to the SCE and SRE (Coupled) Model Component modelsECHAM5 ECHO (=MPI-AO)ECHAM5 + MPI-OM EOLECHAM5 + OPA+LIM MPI-AOBECHAM5 + MPI-OM+HAMOCC MPI-AO-PISCESECHAM5 + MPI-OM+PISCESMPI-OM MPI-OBMPI-OM+HAMOCC MPI-O-PISCES MPI-OM+PISCES IPSL_CM4OPA+LIM + LMDZ+ORCHIDEE OPATOYOPA+LIM + TOY4OPA TOYCLIMTOYATM + TOYOCE + TOYCHE

Lautenschlager + Thiemann (M&D/MPI-M) / / 9 PRISM Platforms Linux i686divers inst. Cray X1Cray, France IBM Power4ECMWF, Reading Fujitsu Opteron ClusterF.S.E. Toulouse Fujitsu VPP5000Meteo France, Toulouse NEC SX-5IPSL, Paris NEC SX-6e.g. DKRZ, Hamburg SGI Altix 3000e.g. CERFACS, Toulouse SGI IRIX64SGI, Munich SGI Origin 3800KNMI, De Bilt

Lautenschlager + Thiemann (M&D/MPI-M) / / 10 SCE: Model Integration

Lautenschlager + Thiemann (M&D/MPI-M) / / 11 Experiment Flow in SCE + SRE CVS Repository Retrieving the code Source code modifications Compile script generation Compilation Experiment configuratio n Model Execution Output Data Post-processing Visualisation Archiving Tasks generation

Lautenschlager + Thiemann (M&D/MPI-M) / / 12 Standard Running Environment Create_TASKS.frm cplmod expid [node] model executionRUN_cplmod_expid postprocessing visualization archiving POST_cplmod_expid VIS_cplmod_expid SAVE_cplmod_expid executables mod1_ID.MPI[1,2].frm mod2_ID.MPI[1,2].frm oasis3.MPI[1,2].frm Input data archive output data Restart files

Lautenschlager + Thiemann (M&D/MPI-M) / / 13 SRE: Directory Structure

Lautenschlager + Thiemann (M&D/MPI-M) / / 14 The Runscript comments_cplmod.h queue_commands_node.h setup_cplmod_expid complete_setup_cplmod.h functions.h calendar.h create_directories.h get_executables_cplmod.h get_input_data_model.h namelist_model.h launching_cplmod_node.h save_output_model.h submit_next_jobs.h for all component models and the coupler Definitions Preprocessing Execution Postprocessing Job submission cplmod: coupled model node: node name expid: experiment ID model: component model

Lautenschlager + Thiemann (M&D/MPI-M) / / 15 Start: Approved in January 2003 Maintenance: Model and Data (M&D/MPIMET) and German Climate Computing Centre (DKRZ) Mission: Data for climate research are collected, stored and disseminated ICSU Policy: long-term archiving and unrestricted data access for scientists Restriction: Only climate data products in CERA DB, no raw data storage. Content: Emphasis is on climate modelling and related data products. Co-operation: with thematically corresponding data centres like WDC- MARE (Bremen) and WDC-RSAT (Oberpfaffenhofen) URL: WDCC The WDCC is IMDI's central component for data archiving and data dissemination

Lautenschlager + Thiemann (M&D/MPI-M) / / 16 WDCC Content Data from Earth System Modelling and Related Observations March 2006: 220 TB / 566 Experiments / Data Sets ERA40 IPCC CEOP BALTEX HOAPS CARIBIC WOCE ERA15/40 NCEP GEBCO COSMOS MPI, GKSS,… EH5/MPI-OM IPCC-AR4 ENSEMBLES IPCC-DDC

Lautenschlager + Thiemann (M&D/MPI-M) / / 17 WDCC Data Catalogue … based on the CERA-2 data model Entry Reference Status Distribution Contact Coverage Parameter Spatial Reference Local Adm. Data Access Data Org

Lautenschlager + Thiemann (M&D/MPI-M) / / 18 WDCC Database Size March

Lautenschlager + Thiemann (M&D/MPI-M) / / 19 WDCC Usage

Lautenschlager + Thiemann (M&D/MPI-M) / / 20 WDCC user distribution

Lautenschlager + Thiemann (M&D/MPI-M) / / 21

Lautenschlager + Thiemann (M&D/MPI-M) / / 22 Further information M&D's webpage: WDC Climate: Assistance: