TCM data 2006: Data submissions, QA work and problems identified Jørgen Nørrevang Jensen ICES
TCM data sources Data submitted through the EIONET system Data submitted through the EIONET system Data from the ICES Data Centre (data from the various commissions, OSPAR, HELCOM, AMAP and voluntary contributions) Data from the ICES Data Centre (data from the various commissions, OSPAR, HELCOM, AMAP and voluntary contributions) MEDPOL Data and other data in a different format than specified in the EIONET system. MEDPOL Data and other data in a different format than specified in the EIONET system.
ICES Data Handling procedures Oceanographic data The oceanographic data submitted to ICES is received in nearly any kind of format provided that it is well structured and documented. Data are then converted to the ICES format The oceanographic data submitted to ICES is received in nearly any kind of format provided that it is well structured and documented. Data are then converted to the ICES format The data are checked by a wide range of QA- procedures before data are uploaded to the ICES database The data are checked by a wide range of QA- procedures before data are uploaded to the ICES database The procedures mention above implies a time-lag between the submission of data and the upload The procedures mention above implies a time-lag between the submission of data and the upload In case of serious errors/correction the countries are asked to either resubmit or confirm potential unit errors etc. This will further delay the upload of data to the ICES database In case of serious errors/correction the countries are asked to either resubmit or confirm potential unit errors etc. This will further delay the upload of data to the ICES database
ICES Data Handling procedures Data on contaminants in biota, sediment and seawater The data on contaminants are submitted in a specific format The data on contaminants are submitted in a specific format The data are checked for structural consistency and QA by a screening programme before the upload to the ICES database The data are checked for structural consistency and QA by a screening programme before the upload to the ICES database Based on the result of the screening data are either uploaded to the database or the submitter is asked to resubmit a corrected version Based on the result of the screening data are either uploaded to the database or the submitter is asked to resubmit a corrected version The procedures mentioned above implies in principle no time-lag between the submission and upload (provided that the data submitter has used the screening programme and these data are without errors) The procedures mentioned above implies in principle no time-lag between the submission and upload (provided that the data submitter has used the screening programme and these data are without errors)
TCM data: Overview of data submissions 2007 (1) Hazardous sub. Biota Hazardous subs. Sediment Hazardous subs. Seawater Nutrients & Oxygen Chlorophyll a EIONET stations Data on fishing fleet capacity from FAO, EUROSTAT or DG MARE Score (Smileys) ALAlbania 12 No BA Bosnia and Herzegovina 483 NA BEBelgium372136/ /568 53/81 Yes BGBulgaria 896 Yes HRCroatia No CYCyprus Yes DEGermany Yes DKDenmark Yes EEEstonia(650) 3319/ Yes ESSpain 568 Yes FIFinland Yes FRFrance Yes GB United Kingdom Yes GRGreece Yes 0 Data submitted via EIONET Data submitted via ICES Data submitted via MEDPOL
TCM data: Overview of data submissions 2007 (2) Hazardous sub. Biota Hazardous subs. Sediment Hazardous subs. Seawater Nutrients & Oxygen Chloro- phyll a EIONET stations Data on fishing fleet capacity from FAO, EUROSTAT or DG MARE Score (Smileys) IEIreland291 Yes ISIceland Yes ITItaly Yes LTLithuania Yes LVLatvia 1372/ Yes MTMalta Yes MEMontenegro No 0 NLNetherlands Yes NONorway Yes PLPoland / /54 36 Yes PTPortugal Yes 0 RORomania Yes SESweden / / Yes SISlovenia Yes TRTurkey No Data submitted via EIONET Data submitted via ICES Data submitted via MEDPOL
Spatial data coverage 2006 for CSI023 indicator
Spatial data coverage 2006 for CSI021 indicator
Temporal data coverage for CSI023 indicator (chlorophyll a) BE CY DE DK EE FI FR GB GR HR IT LT LV NL NO PL RU 104 SE SI TR 41
Temporal data coverage for CSI021 indicator (nutrients) (1) Al BA 812 BE BG CY DE DK EE FI FR GB GR HR
Temporal data coverage for CSI021 indicator (nutrients) (2) IE IS IT LT LV MT NL NO PL RO RU 104 SE SI TR 41
Temporal data coverage for contaminants in biota AL BE CY DE DK ES FI FR GB GR HR IE IS IT LT LV NL NO PL RO 80 SE SI TR
QA checking mistakes/errors found 1. DryWetRatio < 1 This is very likely a unit error – ratio given instead of % (Denmark and Croatia) Danish values corrected after correspondence with data submitter 2. NationalStationID not valid (measurements with no link to station) (for Estonia) 3. Basis (of determination) not filled in This information is mandatory and crucial for recalculation in relation to basis (D or W) (Croatia and Romania)
QA checking mistakes/errors found 4. Latitude and/or longitude out of range In this case most probably caused by a swap of latitude and longitude (Romania). Data corrected accordingly and data submitter notified and asked to confirm. 5. Concentrations NULL If an determinand has not been measured no records should be reported
QA checking mistakes/errors found 6. High values of concentrations (Croatia and Italy). Data submitter asked for clarification 7. Determinand names not according to codelist (Bulgaria, Croatia, Estonia, Italy, Latvia, Malta, Poland and Romania)
QA checking mistakes/errors found 8. Column names not according to EIONET template 9. SamplingDepth < 0 (Italy) Data corrected to positive sampling depth (Italy) Data corrected to positive sampling depth 10. Unit problems µg/kg is not the same as µg/kg. Unit converted to the correct format
Closing these gaps in space and time? Data from other sources – in a different format than the ICES or EIONET format: Data from other sources – in a different format than the ICES or EIONET format: 1. UNEP/MAP database copy 2. Collection of Black Sea data Stronger legal enforcement: Stronger legal enforcement: 1. WFD 2. MSFD Producing data products that makes these gaps obvious – might encourage countries to submit data Producing data products that makes these gaps obvious – might encourage countries to submit data
Suggestion for a change to the Smileys data submission scoring system: The present scoring system is based on the following rules: No data submission: 0 Delayed delivery of data: 1 Smiley. Submission of at least one data type: 2 Smileys Submission of at least 3 data types: 3 Smileys Bias in present system Easy to get 2 Smileys by just sending one set of data Data types are equally important Suggested change to the scoring system: No data submission: 0 Submission of at least one data type: 1 Smiley Submission of two or more data types including one data type that is basis for a CSI or a candidate CSI (in this case nutrients/chlorophyll-a and hazardous substances in biota): 2 Smileys Submissions of three or more data types including two or more data types that are the basis for a CSI or a candidate CSI (in this case nutrients/chlorophyll-a and hazardous substances in biota): 3 Smileys
Tasks and deadlines in 2008 for NRC Answer QA questions in relation to 2006 data (ASAP) Submissions of the 2007 EIONET data- business as usual (31 October 2008)
Questions for EIONET Marine and Coastal NRCs 1.Incomplete NRC contact person list. Could you endeavour to help your NFP to keep the list updated with the names of appropriate NRC contact persons? 2.In case you happen to be on the list of NRC contact persons without being the right person for data issues could you redirect us to the appropriate NRC contact for that? 3.In case that your country has not submitted any data directly or indirectly to EIONET-Water could your explain why this has not happened?
Questions for EIONET Marine and Coastal NRCs (continued) 4.Incomplete data series. Are you aware that this may be the case for your country and do you know why? 5.Could you endeavour to collaborate with the EEA- ETC/WTR (ICES as Marine Data Centre) to follow-up the results of the quality assurance checking of EIONET- Water data? 6.Could you agree with the EEA-ETC/WTR ideas to improve the Smileys scoring system for data submissions?
Thank you for your attention