Presentation is loading. Please wait.

Presentation is loading. Please wait.

TCM data 2006: Data submissions, QA work and problems identified Jørgen Nørrevang Jensen ICES.

Similar presentations


Presentation on theme: "TCM data 2006: Data submissions, QA work and problems identified Jørgen Nørrevang Jensen ICES."— Presentation transcript:

1 TCM data 2006: Data submissions, QA work and problems identified Jørgen Nørrevang Jensen ICES

2 TCM data sources Data submitted through the EIONET system Data submitted through the EIONET system Data from the ICES Data Centre (data from the various commissions, OSPAR, HELCOM, AMAP and voluntary contributions) Data from the ICES Data Centre (data from the various commissions, OSPAR, HELCOM, AMAP and voluntary contributions) MEDPOL Data and other data in a different format than specified in the EIONET system. MEDPOL Data and other data in a different format than specified in the EIONET system.

3 ICES Data Handling procedures Oceanographic data The oceanographic data submitted to ICES is received in nearly any kind of format provided that it is well structured and documented. Data are then converted to the ICES format The oceanographic data submitted to ICES is received in nearly any kind of format provided that it is well structured and documented. Data are then converted to the ICES format The data are checked by a wide range of QA- procedures before data are uploaded to the ICES database The data are checked by a wide range of QA- procedures before data are uploaded to the ICES database The procedures mention above implies a time-lag between the submission of data and the upload The procedures mention above implies a time-lag between the submission of data and the upload In case of serious errors/correction the countries are asked to either resubmit or confirm potential unit errors etc. This will further delay the upload of data to the ICES database In case of serious errors/correction the countries are asked to either resubmit or confirm potential unit errors etc. This will further delay the upload of data to the ICES database

4 ICES Data Handling procedures Data on contaminants in biota, sediment and seawater The data on contaminants are submitted in a specific format The data on contaminants are submitted in a specific format The data are checked for structural consistency and QA by a screening programme before the upload to the ICES database The data are checked for structural consistency and QA by a screening programme before the upload to the ICES database Based on the result of the screening data are either uploaded to the database or the submitter is asked to resubmit a corrected version Based on the result of the screening data are either uploaded to the database or the submitter is asked to resubmit a corrected version The procedures mentioned above implies in principle no time-lag between the submission and upload (provided that the data submitter has used the screening programme and these data are without errors) The procedures mentioned above implies in principle no time-lag between the submission and upload (provided that the data submitter has used the screening programme and these data are without errors)

5 TCM data: Overview of data submissions 2007 (1) Hazardous sub. Biota Hazardous subs. Sediment Hazardous subs. Seawater Nutrients & Oxygen Chlorophyll a EIONET stations Data on fishing fleet capacity from FAO, EUROSTAT or DG MARE Score (Smileys) ALAlbania 12 No BA Bosnia and Herzegovina 483 NA BEBelgium372136/10814150983/568 53/81 Yes BGBulgaria 896 Yes HRCroatia26742 4327 630 47 No CYCyprus46854567 136 55 Yes DEGermany 65 11581 Yes DKDenmark2720 9573 666 Yes EEEstonia(650) 3319/2203 462 39 Yes ESSpain 568 Yes FIFinland1079 16904 534 Yes FRFrance 1693 370 Yes GB United Kingdom445612802 10413 871 Yes GRGreece Yes 0 Data submitted via EIONET Data submitted via ICES Data submitted via MEDPOL

6 TCM data: Overview of data submissions 2007 (2) Hazardous sub. Biota Hazardous subs. Sediment Hazardous subs. Seawater Nutrients & Oxygen Chloro- phyll a EIONET stations Data on fishing fleet capacity from FAO, EUROSTAT or DG MARE Score (Smileys) IEIreland291 Yes ISIceland Yes ITItaly10591793 94725 30184 Yes LTLithuania2912275511756 88 12 Yes LVLatvia 1372/2650 79 16 Yes MTMalta 104514491244119 Yes MEMontenegro No 0 NLNetherlands7981575 Yes NONorway102551417 Yes PLPoland420 703128/9989 138/54 36 Yes PTPortugal Yes 0 RORomania11256864946633 Yes SESweden14 14116/43286 950/2629 42 Yes SISlovenia907 71 Yes TRTurkey826135 610 41 No Data submitted via EIONET Data submitted via ICES Data submitted via MEDPOL

7 Spatial data coverage 2006 for CSI023 indicator

8 Spatial data coverage 2006 for CSI021 indicator

9 Temporal data coverage for CSI023 indicator (chlorophyll a) 1997199819992000200120022003200420052006 BE4434153431348992789575134 CY 276238278 DE6826073541151139292607220 DK253421060171435355506444067226673844281082 EE 823125396350321588676462 FI54758132814691060229717801885672644 FR2677973513484298466471180226420369 GB149747861041730196913613969119316911238 GR 50227125478 716408 HR 6276835717558068099331024627 IT8356946513206102494374876816402057950011625430184 LT6062110695564988618088 LV69116138111 246254255616284 NL830 4 571556544524 NO25442249211122902841257926372482419 PL37169 24790203207428482249 RU 104 SE2591230538954020430335413820408643494430 SI 57104458234204107112 TR 41

10 Temporal data coverage for CSI021 indicator (nutrients) (1) 19971998199920002001200220032004200520062007 Al 56593 BA 812 BE473403345169142144132149107169 BG 105 1407248 CY 786232276244116 DE7808872927715455369868282821296935774091 DK495628396248427380659156489405879856381745 EE 1255732879354342953700289 FI1330666758297328623279926242829333573050 FR285039947643304556579180322180162 GB4143509452698338453814761573355325704355104 GR 102475331420424797440 HR 71376364110361045116012461280618

11 Temporal data coverage for CSI021 indicator (nutrients) (2) 19971998199920002001200220032004200520062007 IE 154254259287251354437376 IS361420444 277768322 IT5500588690477248246944402415482069593404 LT10910622412094298236248245140 LV254454540464 12401834166129111283 MT 43847346762 NL763870534964660599578549 NO58324278327036504499410248953928649 PL1303669789801133412652362167715631062 RO 7281 7178 RU 104 SE59645745103837396868884868764901184288677 SI 2057486234204107124 TR 41

12 Temporal data coverage for contaminants in biota 19971998199920002001200220032004200520062007 AL 154815942200880 BE389390195390 584195 875372 CY 7981350158029702461921081842 DE2576218817519911516390502238 DK447255128354121359433574161290926462556 ES 1354816935 FI502456179060217269742912848071079 FR5247263549653337471828201826107361784 GB 3511139217441936292429694556435563 GR 844 8153 HR 376254715604366395237104134534 IE5587178414260118496654665279 IS365489427339424287445339 IT336642962933153633281938392430001059 LT 15072126573551 LV20 145499 NL110411051125876980662919755614798 NO9288930192898035891587468289990210936101811 PL 327314365377149714941260 RO 80 SE23982383360235212292250818432514236142 SI 152186166152200240200 TR 1602536224040028002156804592081

13 QA checking mistakes/errors found 1. DryWetRatio < 1 This is very likely a unit error – ratio given instead of % (Denmark and Croatia) Danish values corrected after correspondence with data submitter 2. NationalStationID not valid (measurements with no link to station) (for Estonia) 3. Basis (of determination) not filled in This information is mandatory and crucial for recalculation in relation to basis (D or W) (Croatia and Romania)

14 QA checking mistakes/errors found 4. Latitude and/or longitude out of range In this case most probably caused by a swap of latitude and longitude (Romania). Data corrected accordingly and data submitter notified and asked to confirm. 5. Concentrations NULL If an determinand has not been measured no records should be reported

15 QA checking mistakes/errors found 6. High values of concentrations (Croatia and Italy). Data submitter asked for clarification 7. Determinand names not according to codelist (Bulgaria, Croatia, Estonia, Italy, Latvia, Malta, Poland and Romania)

16 QA checking mistakes/errors found 8. Column names not according to EIONET template 9. SamplingDepth < 0 (Italy) Data corrected to positive sampling depth (Italy) Data corrected to positive sampling depth 10. Unit problems µg/kg is not the same as µg/kg. Unit converted to the correct format

17 Closing these gaps in space and time? Data from other sources – in a different format than the ICES or EIONET format: Data from other sources – in a different format than the ICES or EIONET format: 1. UNEP/MAP database copy 2. Collection of Black Sea data Stronger legal enforcement: Stronger legal enforcement: 1. WFD 2. MSFD Producing data products that makes these gaps obvious – might encourage countries to submit data Producing data products that makes these gaps obvious – might encourage countries to submit data

18 Suggestion for a change to the Smileys data submission scoring system: The present scoring system is based on the following rules: No data submission: 0 Delayed delivery of data: 1 Smiley. Submission of at least one data type: 2 Smileys Submission of at least 3 data types: 3 Smileys Bias in present system Easy to get 2 Smileys by just sending one set of data Data types are equally important Suggested change to the scoring system: No data submission: 0 Submission of at least one data type: 1 Smiley Submission of two or more data types including one data type that is basis for a CSI or a candidate CSI (in this case nutrients/chlorophyll-a and hazardous substances in biota): 2 Smileys Submissions of three or more data types including two or more data types that are the basis for a CSI or a candidate CSI (in this case nutrients/chlorophyll-a and hazardous substances in biota): 3 Smileys

19 Tasks and deadlines in 2008 for NRC Answer QA questions in relation to 2006 data (ASAP) Submissions of the 2007 EIONET data- business as usual (31 October 2008)

20 Questions for EIONET Marine and Coastal NRCs 1.Incomplete NRC contact person list. Could you endeavour to help your NFP to keep the list updated with the names of appropriate NRC contact persons? 2.In case you happen to be on the list of NRC contact persons without being the right person for data issues could you redirect us to the appropriate NRC contact for that? 3.In case that your country has not submitted any data directly or indirectly to EIONET-Water could your explain why this has not happened?

21 Questions for EIONET Marine and Coastal NRCs (continued) 4.Incomplete data series. Are you aware that this may be the case for your country and do you know why? 5.Could you endeavour to collaborate with the EEA- ETC/WTR (ICES as Marine Data Centre) to follow-up the results of the quality assurance checking of EIONET- Water data? 6.Could you agree with the EEA-ETC/WTR ideas to improve the Smileys scoring system for data submissions?

22 Thank you for your attention


Download ppt "TCM data 2006: Data submissions, QA work and problems identified Jørgen Nørrevang Jensen ICES."

Similar presentations


Ads by Google