1 WISE SoE TCM data reporting - data processing and QC issues Event: 2013 Marine & Coastal Eionet Workshop, September Author: Jørgen Nørrevang Jensen, ICES

2 What is QA and QC? Event: 2013 Marine & Coastal Eionet Workshop, September Author: Jørgen Nørrevang Jensen, ICES Quality Assurance An overall management plan to guarantee the integrity of data (The “system”) Quality Control/check A series of analytical measurements used to assess the quality of the analytical data (The “tools”)

3 Sources of errors/noise in TCM data Event: 2013 Marine & Coastal Eionet Workshop, September Author: Jørgen Nørrevang Jensen, ICES Sampling strategy Main sources of “errors” Spatial and temporal distribution - Autocorrelation Sample Representative? Use of additional inform. Chemical analysis Analytical method Analytical procedures Data entry Data transfer Entry errors Linking of fields Unit conversions Size of noise/error Large Medium -large Medium Small- Medium Small- medium QA QC

4 Deadlines for data submissions Hazardous substances in biota, sediment and seawater Oceanographic data (nutrients, chlorophyll, S, T, etc.) HELCOM1 September1 May OSPAR1 September Eionet31 October Event: 2013 Marine & Coastal Eionet Workshop, September Author: Jørgen Nørrevang Jensen

5 Event: 2013 Marine & Coastal Eionet Workshop, September Author: Jørgen Nørrevang Jensen Eionet CDR Country folders TCM ETC template views ICES DOME Data on contaminants in biota, sediment and seawater TCM data Collective upload from this year QC marking and duplicate checking by ETC QC and feed- back by ETC Regional/national databases Overview of the data flow for the TCM SoER data November ICES TCM April ICES Oceano- graphic database QC screening of data QC and feedback by EEA QC and feed- back by ICES

6 ICES data flow overview Data from OSPAR, HELCOM, AMAP, etc. Event: 2013 Marine & Coastal Eionet Workshop, September Author: Jørgen Nørrevang Jensen, ICES Contaminants in biota, sediments and seawater DOME QC screening of data Data transformation to ICES format ICES Oceanographic Database Oceanographic data (nutrients, chlorophyll, T, S, etc.) Fixed format “Free” format QC screening of data ETC DD structure

7 Event: 2013 Marine & Coastal Eionet Workshop, September Author: Jørgen Nørrevang Jensen, ICES TCM priority data – main QC issues QC issueMain problemWhy is this a problem? Station issuesStations missingData useless without station information Duplicate stationsDestroys time series in CSI Duplicate checkingTrue duplicates can be difficult to find Important to remove true duplicates in data for the use in CSI False duplicates occurs due to missing primary key fields (e.g. SampleID and SampleDepth) Data “degradation” due to aggregation EEZ Country code versus Data submitter Country Code might get wrong due to inaccurate positions or EEZ layer Determinand namesMany different synonyms for the determinands Determinand names have to be unified for the use in CSI Countries not submitting data Some countries do not provide data Spatial coverage needs to be improved for the use in CSI

8 TCM Station ID’s – a big mess Event: 2013 Marine & Coastal Eionet Workshop, September Author: Jørgen Nørrevang Jensen, ICES Station identification can be difficult. Comparisons of stations within and between station tables have high-lighted these problems: Duplicates most likely occurs with the Eionet station table. These are not always easy to confirm due to slightly different coordinates and ID’s Eionet stations missing – some data refers to a station that is not reported in the station table The same stations most likely occurs in several station lists (Eionet, WFD, and the ICES station dictionary). As above the coordinates and ID’s are often slightly different Eionet stations that “refers” to a WFD’s station is not always found in the WFD’s station list

9 KML files with WFD, Eionet, and ICES Station dictionary stations Event: 2013 Marine & Coastal Eionet Workshop, September Author: Jørgen Nørrevang Jensen, ICES

10 Event: 2013 Marine & Coastal Eionet Workshop, September Author: Jørgen Nørrevang Jensen, ICES KML files with WFD, Eionet, and ICES Station dictionary stations