TCM data 2006: Data submissions, QA work and problems identified Jørgen Nørrevang Jensen ICES.

Slides:



Advertisements
Similar presentations
Station mapping Eionet-Water vs. Water Framework Directive (WFD) Hermann Peifer, EEA Jørgen Nørrevang Jensen, ICES Eionet Workshop for Marine and Coastal.
Advertisements

EMODNet Chemistry support to MSFD data reporting Examples from IT and Black Sea Giordano Giorgi (ISPRA) TG DIKE, 4 July 2013.
1 WISE SoE TCM data reporting - data processing and QC issues Event: 2013 Marine & Coastal Eionet Workshop, September Author: Jørgen Nørrevang Jensen,
Date/ event: Author: Overview of ETC Water data outputs 2010 Miroslav Fanta ETC Water data manager WISE TG Meeting Madrid Miroslav Fanta.
WISE SOE reporting on Transitional and Coastal waters Beate Werner.
Session 2 – WISE SoE TCM data processing and quality issues.
1 ‘Role of the Marine Conventions in Eurowaternet development’ European Environment Agency (EEA) Anita Künitzer.
DIKE TSG Workshop 4 July 2013 EEA regular dataflows: WISE-SoE Reporting on Transitional, Coastal and Marine Waters Constança Belchior - EEA.
European Commission DG Environment Marine Environment and Water Industry Unit Marine Strategy Framework Directive: Status of reporting WG DIKE 26 February.
Date/ event: 4-5 November 2009, marine and coastal Eionet Workshop, Copenhagen Conclusions.
Professionalising knowledge and data products It works!! Data –> Information flow for MSFD.
Annual Meeting, June , Split, Croatia WP3: QA/QC Validation – MSFD Interactions current status EMODnet Chemistry Partner contribution: ISPRA.
1 Event/ date: Working Group D meeting, 7 April 2011, Brussels Author: Dr Anita Künitzer/ Miroslav Fanta, CENIA 1 State of the Environment Reporting Miroslav.
Type the subject in footer (View|Header and Footer) 1 28/01/2016 EU CLRTAP Emissions Inventory Compilation 2015 TFEIP Meeting, 11/12 May 2015, Milano ETC/ACM.
Trine Christiansen(EEA) Neil Holdsworth (ICES and ETC/ICM) Regional and EU level data streams for D5 and D8 WG-DIKE, 30 September
Outcomes from EMODnet/MSFD coordination meetings A. Giorgetti, M. Lipizer, M. Vinci EMODnet Chemistry, 3 rd year meeting, June 8-9, 2016 Helsinki, Finland.
1 EUROPEAN TOPIC CENTRE ON WATER EUROWATERNET Towards an Index of Quality of the National Data in Waterbase.
Overview of the WISE SoE TCM data flow Data sources and handling
Data aggregation and products generation in the Mediterranean Sea
Marine Strategy Framework Directive: activities of WG DIKE
Working Group on Data, information and knowledge exchange
Working Party on Regional Statistics 1-2 October 2012
EU Water Framework Directive
Marine Strategy Framework Directive:
Kristina Dourmashkin Eurostat Unit E4
Marine Strategy Framework Directive:
Delivering electronic Natura 2000 data via Reportnet CDR
Delivering electronic Natura 2000 data via Reportnet CDR
Transmission, processing and publication of the HBS 2015 data
MSFD Scoreboard Status at 23 November 2012 Belgium Bulgaria Cyprus
Update on the status of RBMP reporting
Marine Strategy Framework Directive: Transposition and Implementation
ESF FINANCIAL EXECUTION ESF Technical Working Group Meeting June 2018
Regional Accounts
State of play of Urban Audit
LAMAS October 2017 Agenda Item 3.2 Labour Cost Indices state of play Daniel Iscru Hubertus Vreeswijk.
Introduction We acknowledge the contribution of the experts, RSCs and WG GES members to the work coordinated by JRC. General framework: JRC’s coordinated.
MSFD Article 12 assessment Follow-up on geographic issues
Marine Strategy Framework Directive: Transposition and Implementation
Marine Strategy Framework Directive: Status of reporting
EU Water Framework Directive
ESF FINANCIAL EXECUTION ESF Technical Working Group Meeting June 2018
NUTS Agenda: 5.1; Document 9
State of progress with transition to new Standard Data Form
2a. Status of WFD reporting
Item 7.1 Implementation of the 2016 Adult Education Survey
2b. Status of WFD reporting
Marine Strategy Framework Directive: Status of reporting
Marine Environment and Water Industry Unit
Summary of WISE electronic delivery
Marine Strategy Framework Directive: Status of reporting Art. 8/9/10
Progress SOE –drafting group
Marine Strategy Framework Directive: Transposition and Implementation
MSFD Article 11 reporting Monitoring programmes
Date/ event: EEA Drafting group meeting SoE guidance, Copenhagen
Update on the status of RBMP reporting
Summary of WISE electronic delivery
DG Environment, Unit D.2 Marine Environment and Water Industry
ESF FINANCIAL EXECUTION ESF Technical Working Group Meeting June 2018
Marine Strategy Framework Directive State of play and follow up
Item 7.2 – Overview of 2012 UOE Quality Reports
Legal and implementation issues update
Reporting of chemical monitoring data to ICES Overview and way forward
Marine Strategy Framework Directive: Status of reporting
Progress SOE –drafting group
The Convention on Long-range Transboundary Air Pollution
Action points EEA Document listing all the recent reports and the data/map viewers (and the related web links) on Forum Short and concise minutes of the.
2018 Freshwater data call Stéphane Isoard
Norwegian Institute for Water Research
DG Environment, Unit C.2 Marine Environment and Water Industry
Presentation transcript:

TCM data 2006: Data submissions, QA work and problems identified Jørgen Nørrevang Jensen ICES

TCM data sources Data submitted through the EIONET system Data submitted through the EIONET system Data from the ICES Data Centre (data from the various commissions, OSPAR, HELCOM, AMAP and voluntary contributions) Data from the ICES Data Centre (data from the various commissions, OSPAR, HELCOM, AMAP and voluntary contributions) MEDPOL Data and other data in a different format than specified in the EIONET system. MEDPOL Data and other data in a different format than specified in the EIONET system.

ICES Data Handling procedures Oceanographic data The oceanographic data submitted to ICES is received in nearly any kind of format provided that it is well structured and documented. Data are then converted to the ICES format The oceanographic data submitted to ICES is received in nearly any kind of format provided that it is well structured and documented. Data are then converted to the ICES format The data are checked by a wide range of QA- procedures before data are uploaded to the ICES database The data are checked by a wide range of QA- procedures before data are uploaded to the ICES database The procedures mention above implies a time-lag between the submission of data and the upload The procedures mention above implies a time-lag between the submission of data and the upload In case of serious errors/correction the countries are asked to either resubmit or confirm potential unit errors etc. This will further delay the upload of data to the ICES database In case of serious errors/correction the countries are asked to either resubmit or confirm potential unit errors etc. This will further delay the upload of data to the ICES database

ICES Data Handling procedures Data on contaminants in biota, sediment and seawater The data on contaminants are submitted in a specific format The data on contaminants are submitted in a specific format The data are checked for structural consistency and QA by a screening programme before the upload to the ICES database The data are checked for structural consistency and QA by a screening programme before the upload to the ICES database Based on the result of the screening data are either uploaded to the database or the submitter is asked to resubmit a corrected version Based on the result of the screening data are either uploaded to the database or the submitter is asked to resubmit a corrected version The procedures mentioned above implies in principle no time-lag between the submission and upload (provided that the data submitter has used the screening programme and these data are without errors) The procedures mentioned above implies in principle no time-lag between the submission and upload (provided that the data submitter has used the screening programme and these data are without errors)

TCM data: Overview of data submissions 2007 (1) Hazardous sub. Biota Hazardous subs. Sediment Hazardous subs. Seawater Nutrients & Oxygen Chlorophyll a EIONET stations Data on fishing fleet capacity from FAO, EUROSTAT or DG MARE Score (Smileys) ALAlbania 12 No BA Bosnia and Herzegovina 483 NA BEBelgium372136/ /568 53/81 Yes BGBulgaria 896 Yes HRCroatia No CYCyprus Yes DEGermany Yes DKDenmark Yes EEEstonia(650) 3319/ Yes ESSpain 568 Yes FIFinland Yes FRFrance Yes GB United Kingdom Yes GRGreece Yes 0 Data submitted via EIONET Data submitted via ICES Data submitted via MEDPOL

TCM data: Overview of data submissions 2007 (2) Hazardous sub. Biota Hazardous subs. Sediment Hazardous subs. Seawater Nutrients & Oxygen Chloro- phyll a EIONET stations Data on fishing fleet capacity from FAO, EUROSTAT or DG MARE Score (Smileys) IEIreland291 Yes ISIceland Yes ITItaly Yes LTLithuania Yes LVLatvia 1372/ Yes MTMalta Yes MEMontenegro No 0 NLNetherlands Yes NONorway Yes PLPoland / /54 36 Yes PTPortugal Yes 0 RORomania Yes SESweden / / Yes SISlovenia Yes TRTurkey No Data submitted via EIONET Data submitted via ICES Data submitted via MEDPOL

Spatial data coverage 2006 for CSI023 indicator

Spatial data coverage 2006 for CSI021 indicator

Temporal data coverage for CSI023 indicator (chlorophyll a) BE CY DE DK EE FI FR GB GR HR IT LT LV NL NO PL RU 104 SE SI TR 41

Temporal data coverage for CSI021 indicator (nutrients) (1) Al BA 812 BE BG CY DE DK EE FI FR GB GR HR

Temporal data coverage for CSI021 indicator (nutrients) (2) IE IS IT LT LV MT NL NO PL RO RU 104 SE SI TR 41

Temporal data coverage for contaminants in biota AL BE CY DE DK ES FI FR GB GR HR IE IS IT LT LV NL NO PL RO 80 SE SI TR

QA checking mistakes/errors found 1. DryWetRatio < 1 This is very likely a unit error – ratio given instead of % (Denmark and Croatia) Danish values corrected after correspondence with data submitter 2. NationalStationID not valid (measurements with no link to station) (for Estonia) 3. Basis (of determination) not filled in This information is mandatory and crucial for recalculation in relation to basis (D or W) (Croatia and Romania)

QA checking mistakes/errors found 4. Latitude and/or longitude out of range In this case most probably caused by a swap of latitude and longitude (Romania). Data corrected accordingly and data submitter notified and asked to confirm. 5. Concentrations NULL If an determinand has not been measured no records should be reported

QA checking mistakes/errors found 6. High values of concentrations (Croatia and Italy). Data submitter asked for clarification 7. Determinand names not according to codelist (Bulgaria, Croatia, Estonia, Italy, Latvia, Malta, Poland and Romania)

QA checking mistakes/errors found 8. Column names not according to EIONET template 9. SamplingDepth < 0 (Italy) Data corrected to positive sampling depth (Italy) Data corrected to positive sampling depth 10. Unit problems µg/kg is not the same as µg/kg. Unit converted to the correct format

Closing these gaps in space and time? Data from other sources – in a different format than the ICES or EIONET format: Data from other sources – in a different format than the ICES or EIONET format: 1. UNEP/MAP database copy 2. Collection of Black Sea data Stronger legal enforcement: Stronger legal enforcement: 1. WFD 2. MSFD Producing data products that makes these gaps obvious – might encourage countries to submit data Producing data products that makes these gaps obvious – might encourage countries to submit data

Suggestion for a change to the Smileys data submission scoring system: The present scoring system is based on the following rules: No data submission: 0 Delayed delivery of data: 1 Smiley. Submission of at least one data type: 2 Smileys Submission of at least 3 data types: 3 Smileys Bias in present system Easy to get 2 Smileys by just sending one set of data Data types are equally important Suggested change to the scoring system: No data submission: 0 Submission of at least one data type: 1 Smiley Submission of two or more data types including one data type that is basis for a CSI or a candidate CSI (in this case nutrients/chlorophyll-a and hazardous substances in biota): 2 Smileys Submissions of three or more data types including two or more data types that are the basis for a CSI or a candidate CSI (in this case nutrients/chlorophyll-a and hazardous substances in biota): 3 Smileys

Tasks and deadlines in 2008 for NRC Answer QA questions in relation to 2006 data (ASAP) Submissions of the 2007 EIONET data- business as usual (31 October 2008)

Questions for EIONET Marine and Coastal NRCs 1.Incomplete NRC contact person list. Could you endeavour to help your NFP to keep the list updated with the names of appropriate NRC contact persons? 2.In case you happen to be on the list of NRC contact persons without being the right person for data issues could you redirect us to the appropriate NRC contact for that? 3.In case that your country has not submitted any data directly or indirectly to EIONET-Water could your explain why this has not happened?

Questions for EIONET Marine and Coastal NRCs (continued) 4.Incomplete data series. Are you aware that this may be the case for your country and do you know why? 5.Could you endeavour to collaborate with the EEA- ETC/WTR (ICES as Marine Data Centre) to follow-up the results of the quality assurance checking of EIONET- Water data? 6.Could you agree with the EEA-ETC/WTR ideas to improve the Smileys scoring system for data submissions?

Thank you for your attention