1. ORCHIDEE’s Evaluation

2. Objectives To gather all the contributions on a wiki page, that may serve to each of you for information on 'who has done what’ To benefit of these contributions for the development of a 'systematic' evaluation chain

3. Session’s plan Presentation of the on-going effort towards a systematic evaluation chain YOUR Contributions – the observation datasets that you use for evaluation purpose – the variables you are evaluating – the temporal/spatial scale(s) that you focus on – what kind of scores/metrics you work with – and what are the tools you have developped

4. Towards an evaluation chain Evaluation of a version against – Data – A Referenced version of ORCHIDEE (benchmark) Both simulations and diagnostics will be freely and easily available – Simulations available for your own analysis – Diagnostics will serve to evaluate the model’s versions and to benchmark them Set of referenced simulations Set of diagnostics Set of scripts

5. Steps towards an evaluation chain To define the set of referenced simulations To build and version easy-to-use, portable and generic tools used for evaluation of any version of ORCHIDEE To produce and distribute the diagnostics - produced by these tools - that any ORCHIDEE user can look at, for different tagged versions of ORCHIDEE

6. Set-up of the referenced simulations 3 types of simulation – Forced and Local simulations (FL) – Forced and Global simulations (FG) – Coupled simulations LMDZ-OR (CL) Activated flags: ok_stomate=y ; fire_disable=n ; ok_routing=y ; land_cover_change=y ; cwrr=y/n Standard outputs : CMOR, ALMA Output frequency: daily (except for FL, 30 min)

7. Forced and Local simulations FL1 Time PeriodVariable Hydro SchemeChoisnel/ CWRR Grid150 sites RoutingN Forcing ClimateLocale (gapfillée avec ERA-i) DGVMN Forcing Land-UseN (prescrit) LUCN # simulations150 sites (x2) Béta-tagX (~40 sites)

8. Forced and Global simulations FG1FG2FG3FG4 Time Period1900-2010 avec spinup sur 1900- 1910 1980-2010 (x3) 1900-1910 (x10) Hydro Scheme Choisnel/ CWRR GridYYYY RoutingYYYY Forcing Climate CRU-NCEP ERA-interimCRU-NCEP DGVMNNNY Forcing Land- Use CMIP5 Poulter/ LUCYYN/ # simulations2222 Béta-tag X

9. Coupled simulations LMDz-OR CL1CL2CL3CL4 Time Period1982-1991 2008-2009 Hydro Scheme Choisnel/ CWRR Grid96x95x39 reg Zoomé RoutingYYNY Forcing Climate YNNN Guided NNNERAI SST/SIC forcing AMIP ? DGVMNNNN Forcing Land- Use CMIP5 ? LUCYYY? # simulations2222 Béta-tagX X

10. The Fluxnet chain Objective: Evaluation of modeled LH, SH, NEE, GPP and TER against in-situ data for different time frequencies The chain is fully developped, from launching to post- processing steps. Makes use of 50 sites (150 sites available) The Fluxnet configuration is versioned with svn under /trunk/ORCHIDEE_OL/FLUXNET It is documented on the wiki, under : /Scripts/FluxnetValidation Diagnostics are accessible from a dods server : http://www-lscedods.cea.fr/orchidods/FLUXNET And from the wiki Evaluation’s page

11. The Fluxnet data A new set of meteorological ORCHIDEE forcing files for in-situ FLUXNET sites (~150 sites) – Data Gaps filled using ERA-I forcing Available on the shared repositories at IPSL from the /IGCM/BC/SRF/OOL/OL2/FLUXNET directory. For Gaya: /u/rech/psl/rpsl035/ For Curie: /ccc/work/cont003/dsm/p86ipsl/ For Obelix: /home/orchidee01/mmancip/ For Ciclad: /ipslfs/igcmg/

12. The Fluxnet diagnostics Time-series, taylor diagrams for different time- frequencies (hour, day, month, year) Scripts developed in Ferret, making use of the atlas program (P. Brockman)

13. Remote-sensed global products Objective: Evaluation of modeled variables (LAI, water content, …) against remote-sensed data in terms of variability A generic Ferret script has been written for generating correlation maps between observation and model outputs (and map of differences of correlation for 2 versions) Outputs are accessible from a dods server : http://www-lscedods.cea.fr/orchidods/LAI

14. Example of a diagnostic generated by the ‘Correlation’ script Correlation between modeled LAI and obs. FPAR (MODIS) Monthly time step from 2000 to 2008 for trunk version 195 and revision r988

15. Perspectives for the ‘evaluation’ initiative To conclude on the set of suitable simulations (length, meteorological forcings, PFT map) To develop predefined libigcm-based configurations for the referenced simulation To develop diagnostic scripts making use of new observation datasets To define and use shared repositories for the observational datasets and the produced simulations

16. Contributions Jan Polcher / Agnès : Hydrology Catherine Ottlé: Snow Camille Risi / Francesca Guglielmo : Isotopes Fabienne Maignan: Vegetation Index Ben Poulter: Biomass Philippe Peylin : [CO2] at stations