Presentation is loading. Please wait.

Presentation is loading. Please wait.

Database: submission, status, future. Send data and receive email confirmation is not enough!!!! Remember to import or discard your variables!!

Similar presentations


Presentation on theme: "Database: submission, status, future. Send data and receive email confirmation is not enough!!!! Remember to import or discard your variables!!"— Presentation transcript:

1 Database: submission, status, future

2 Send data and receive email confirmation is not enough!!!! Remember to import or discard your variables!!

3

4 Status Looking to who submitted what…..

5 Status Main sites Status Main sites – LEVEL4 prod.

6 Associated Main sites

7 Status of General information and Soil Respiration files submission Soil RespGen file Soil RespGen file

8

9 In the next weeks the Greengrass database will be incorporated in the Carboeurope IP database and processed. We asked also the data from Carbomont without answer We are waiting the data from the Siberian projects (from Eurasia-net to TCOS) We will try also to obtain data from the Amazonian project from EU Any other dataset is welcome We invite also the PIs to send their data and in particular the 2003 missed months!!! NO (only partially)… Still without (partially)… Coming

10 Questions/discussion about the status?

11 Gapfilling intercomparison results

12 From the Gapfilling WS: Do we need more variables? Flag indicating if there are footprint problems (particularly for crop) Flags indicating the management LAI or NDVI or Vegetation height (crop and grass) NOTE! It is not a good solution to put simply qcFc = 2 because the qcFc are defined from Spoleto!

13 The database role in standardization 1)Storage correction whit Sc provided by the PI (NEE_or) and calculated from the CO 2 concentration top of tower (NEE_st) 2) Ustar threshold calculated centrally 3) Spike filtering performed centrally 4) Gapfilling performed centrally using the two best methods from the gapfilling intercomparison 5) Partitioning in GPP and TER performed centrally BUT What about “standard quality flags obtained from the raw data”? What about the corrections/checks applied to the raw data? What about the corrections implemented in your software? Unfortunately not all the PIs are sending the correct quality flags. Many sites have all the data with qc=0, or with all qc=2. There are sites that are not applying the qc correctly and mix-up with ustar filtering or footprint How many of you provided these info correctly to the database? Are these information important?

14 Setting Comparison BA – 3D – ConstTLag LD – 3D – AutTLag BA LD

15 µmolCO 2 m -2 s -1 Generally this has a small effect to the sums However can have effect on the single half hour

16 How to solve this problem? How to avoid these differences? Using the same software with exactly the same settings BUT We compared different software and they give very similar results with the same settings Using the exactly the same settings BUT Can we define a “right” set of corrections and settings? What about the uniqueness of the sites? Use what you want but tell me what you did… BUT How can you send these information to the database? How many of you sent the information about the 2D 3D or PF correction applied? How many of you are sending the updated versions of the GEN file?

17 The best would be to have a common software where: -The user could decide which correction to apply -There would be implemented all the possible corrections -The user could also propose and add new options/corrections -All the settings used would be summarized in a table as metadata -The output would be directly formatted to be uploaded in the DB But to work, this software should be: -As flexible as possible -Available for all the HW/OS platforms -Continuously updated -User friendly for not expert users And in particular: -FREE -OPEN SOURCE -COMMON PROPERTY (CarboeuropeIP, Fluxnet)

18 Are you interested in developing a common “community owned eddy covariance software”? We started developing the structure of such a software and now it is ready for your input… code: FORTRAN 77/90 OPEN-SOURCE CODE SET-UP BASED ON “.ini”-files

19 ACQUISITION PROCESSING core: FORTRAN 77/90 Features a user-friendly GUI Simple but less flexible GUI: C (LabWindows) Graphical version available

20 RAW DATA SPECTRAL ANALYSIS PLANAR FIT ACQUISITION SOFTWARE RAW DATA SCREENING time-lag detection and data alignment fluctuation calculation mean, variances, co-variances Axis rotation Schotanus and WPL correction Fluxes, u *, T *, z/L etc.. calculation Spectral correction Quality Check / Quality Flagging CE-IP STANDARD OUTPUT.med FILES selected datasets all raw data TRANSLATOR OTHER RAW DATA

21 time-lag detection and data alignment fluctuation calculation mean, variances, co-variances Axis rotation Schotanus and WPL correction Fluxes, u *, T *, z/L etc.. calculation Spectral correction Quality Check / Quality Flagging Moncrieff et al., 1997 – Journal of Idrology Aubinet et al., 2000 – Advances in Eological Research Moncrieff et al, 2004 – Handbook of Micrometeorology Lee et al. 2004, Handbook of Micrometeorology Aubinet et al., 2000 – Advances in Eological Research Liu et al., 2001 – Boundary Layer Meteorolgy Webb et al., 1980 – Quart. J. R. Soc. Moncrieff et al., 1997 – Journal of Idrology Horst, 1997 – Boundary Layer Meteorology Aubinet et al., 2001 – Agricultural and Forest Meteorology Foken and Wichura, 1996 – Agricultural and Forest Meteorology Foken et al., 2004 – Handbook of Micrometeorology Thomas and Foken, 2002 – Am. Meteorol. Soc. warm thanks to the Eddy Covariance CE-IP Summer School (Wépion, July 10-21, 2006) organizers and speakers!!

22 RAW DATA SPECTRAL ANALYSIS PLANAR FIT ACQUISITION SOFTWARE RAW DATA SCREENING time-lag detection and data alignment fluctuation calculation mean, variances, co-variances Axis rotation Schotanus and WPL correction Fluxes, u *, T *, z/L etc.. calculation Spectral correction Quality Check / Quality Flagging.med FILES selected datasets all raw data TRANSLATOR OTHER RAW DATA CE-IP STANDARD OUTPUT

23 RAW DATA SPECTRAL ANALYSIS PLANAR FITRAW DATA SCREENING time-lag detection and data alignment fluctuation calculation mean, variances, co-variances Axis rotation Schotanus and WPL correction Fluxes, u*, T*, z/L etc.. calculation Spectral correction Quality Check / Quality Flagging CE-IP STANDARD OUTPUT.med FILES selected datasets all raw data headers, anemometer format, scaling factors, offsets, binary … TRANSLATOR suitable format ACQUISITION SOFTWARE

24 RAW DATA SPECTRAL ANALYSIS PLANAR FIT ACQUISITION SOFTWARE RAW DATA SCREENING time-lag detection and data alignment fluctuation calculation mean, variances, co-variances Axis rotation Schotanus and WPL correction Fluxes, u *, T *, z/L etc.. calculation Spectral correction Quality Check / Quality Flagging.med FILES selected datasets all raw data TRANSLATOR OTHER RAW DATA CE-IP STANDARD OUTPUT

25 fluctuation calculation mean, variances, co-variances Axis rotation Schotanus and WPL correction Fluxes, u *, T *, z/L etc.. calculation Spectral correction Quality Check / Quality Flagging RAW DATA SPECTRAL ANALYSIS PLANAR FIT ACQUISITION SOFTWARE RAW DATA SCREENING.med FILES selected datasets all raw data spike removal (*) amplitude resolution (*) drop-outs (*) absolute limits (*) discontinuities (*) Skewness and Kurtosis (*) unrealistic time-lag (*) angle of attack (*) non-steady horizontal wind (*).med FILES MODIFIED RAW DATA time-lag detection and data alignment TRANSLATOR OTHER RAW DATA (*) Vickers and Mahrt, 1997 – Jour. Atm. Ocean. Tech.

26 RAW DATA PLANAR FIT ACQUISITION SOFTWARE RAW DATA SCREENING time-lag detection and data alignment fluctuation calculation mean, variances, co-variances Axis rotation Schotanus and WPL correction Fluxes, u *, T *, z/L etc.. calculation Spectral correction Quality Check / Quality Flagging.med FILES selected datasets all raw data TRANSLATOR OTHER RAW DATA SPECTRAL ANALYSIS CE-IP STANDARD OUTPUT

27 Quality Check / Quality Flagging Schotanus and WPL correction RAW DATA PLANAR FIT ACQUISITION SOFTWARE RAW DATA SCREENING time-lag detection and data alignment fluctuation calculation mean, variances, co-variances Axis rotation Fluxes, u*, T*, z/L etc.. calculation CE-IP STANDARD OUTPUT.med FILES selected datasets all raw data Calculation of scalars / w co-spetra Calculation sens. heat / w co-spectrum Calculation of exper. transfer functions automatic or manual regression with a given function Spectral correction SPECTRAL ANALYSIS If user wants to use the or spectral correction options..

28 RAW DATA SPECTRAL ANALYSIS PLANAR FIT ACQUISITION SOFTWARE RAW DATA SCREENING time-lag detection and data alignment fluctuation calculation mean, variances, co-variances Axis rotation Schotanus and WPL correction Fluxes, u *, T *, z/L etc.. calculation Spectral correction Quality Check / Quality Flagging.med FILES selected datasets all raw data TRANSLATOR OTHER RAW DATA CE-IP STANDARD OUTPUT

29 TRANSLATOR OTHER RAW DATA RAW DATA SPECTRAL ANALYSIS PLANAR FIT ACQUISITION SOFTWARE RAW DATA SCREENING time-lag detection and data alignment fluctuation calculation mean, variances, co-variances Schotanus and WPL correction Fluxes, u*, T*, z/L etc.. calculation Spectral correction Quality Check / Quality Flagging CIP STANDARD OUTPUT.med FILES selected datasets all raw data Axis rotation passes plane coefficients to main prog for rotation angle calculation calculates planar fit (bi-linear regression) of w vs u/v If user wants to use the option..

30 Some preliminary validation With EDIRE BA 3D With MASE LD 3D

31 SOME CORRECTIONS, TESTS, OPTIONS ARE NOT YET IMPLEMENTED (EX: OGIVE TEST, FOOTPRINT TEST…) SOME ANEMOMETER AND IRGA ARE ALSO NOT YET SUPPORTED THE MODULE TO IMPORT RAW DATA FORM OTHER SOFTWARE READS NOW ONLY FEW DATA-TYPES THE SW STILL NEEDS A THOROUGH VALIDATION THE AVAILABLE GUI PRESENTLY RUNS ONLY ON WINDOWS (2000 and later).. AND SOME BUGS ARE TO BE FIXED!! WHERE WE ARE AND WHAT WE NEED.. THE SOFTWARE CURRENTLY SUPPORTS MANY OF THE FEATURES AND PROCESSING OPTIONS PRESENTED DURING THE SUMMER SCHOOL. NONETHELESS…

32 FLUXNET Synthesis Workshop 2007 19-22 February 2007 – La Thuille - Italy Different networks involved: CarboeuropeIP, Ameriflux, Fluxnet-Canada, LBA, CarboAfrica, OzFlux, TCOS Siberia, ChinaFlux, KoFlux, AsiaFlux, NECC, US-China Carbon Consortium Sponsors (not all confirmed): GTOS ILEAPS NASA DAO Global Carbon Project CarboeuropeIP Organizing Commitee: D. Baldocchi T. Boden P. Ciais B. Cook B. Law D. Papale M. Reichstein S. Running R. Valentini

33 FLUXNET Synthesis Workshop 2007 The workshop has been designed as a real hands-on data synthesis workshop It will be restrict to 30-50 people coming from the different regional networks Particularly scientists most interested in synthesis activities should participate This does not preclude valuable post-workshop intellectual input from non-participating scientists for the scientific papers and co-authorship The harmonized global dataset will be available to all the community for other synthesis works particularly for the many topics that will be not discussed at the WS Dataset will be pre-processed in an harmonized way before the WS 19-22 February 2007 – La Thuille - Italy

34 FLUXNET Synthesis Workshop 2007 19-22 February 2007 – La Thuille - Italy Carboeurope-IP Ecosystem Component will participate to the synthesis All the datasets submitted to the CarboeuropeIP database will be included (only if with good quality) and the PIs will be part of the activity. If you don’t want that your data will be used in this activity please send us a note. Carboeurope will have 7-8 participants to the WS and we have to provide a list of about 12-15 names with topic of interest to the Organising Committee before November 30th, with if possible a good balance between experienced and young PostDoc-level scientists Based on the suggestions of all networks and in consultation with networks, the Organising Commitee will propose a final participant list before December 10th (in order to avoid gaps or overloaded topics).

35 FLUXNET Synthesis Workshop 2007 19-22 February 2007 – La Thuille - Italy First draft of the list: Proposed namesArea of interest M. Aubinet / C. Bernhofer / A. KnohlEnergy partitioning I. Janssen / S. Luysaaert / G. MatteucciGPP / NPP N. Buchmann / A. Granier / D. YakirEcophysiology data driven J. Grace / D. Lousteau / D. SchulzeForest age/management effect JF. Soussana / P. Smith / M. WattenbachGrassland and croplands E. Falge / J. TenhunenEcophysiology model based F. Miglietta / S. Rambal / G. SuefertMediterranean synthesis T. Laurila, A. Lindroth, T. Vesala…Boreal ecosystems synth. - NECC


Download ppt "Database: submission, status, future. Send data and receive email confirmation is not enough!!!! Remember to import or discard your variables!!"

Similar presentations


Ads by Google