Reporting of chemical monitoring data to ICES Overview and way forward

Slides:



Advertisements
Similar presentations
1 WISE SoE TCM data reporting - data processing and QC issues Event: 2013 Marine & Coastal Eionet Workshop, September Author: Jørgen Nørrevang Jensen,
Advertisements

/foredr/tfmm2 Nor wegian Institute for Air Research Regional monitoring programmes National programmes European Monitoring and Evaluation Programme.
MARTIN M. LARSEN & JESPER H. ANDERSEN PHD QA COORDINATOR & PHD PROJECT MANAGER CHASE VERSION 2.X MARTIN M. L., JESPER H. A. CHASE-ING HAZARDOUS SUBSTANCES.
Introduction to Systems Analysis and Design Trisha Cummings.
Data collection, extraction, and central collation Induction Event.
MEDIN Data Guidelines. Data Guidelines Documents with tables and Excel versions of tables which are organised on a thematic basis which consider the actual.
Controlled Vocabularies (Term Lists). Controlled Vocabs Literally - A list of terms to choose from Aim is to promote the use of common vocabularies so.
 A databases is a collection of data organized to make it easy to search and easy to retrieve in a useful, usable form.
California Outcomes Measurement System – Treatment
NORMAN Databases Collection of data for EMPODAT – key issues Environmental Institute, Koš, Slovakia.
Water.europa.eu Agenda item 7d Report on the quality assessment of the monitoring database Strategic Co-ordination Group November 2010 Madalina.
Annual Meeting, June , Split, Croatia WP3: QA/QC Validation – MSFD Interactions current status EMODnet Chemistry Partner contribution: ISPRA.
Using STORET Data to Characterize Your Watershed 1 Webcast on June 21, 2007 Randy E. Hill IT Project Manager, EPA Monitoring Branch Dwane Young IT Specialist,
NMCAG AQC APPROACHES Colin Allchin NMCAG Chair Rtd.
United Nations Oslo City Group on Energy Statistics OG7, Helsinki, Finland October 2012 ESCM Chapter 8: Data Quality and Meta Data 1.
Objectives Understand Corrective, Perfective and Preventive maintenance Discuss the general concepts of software configuration management.
MARTIN M. LARSEN & JESPER H. ANDERSEN PHD QA COORDINATOR & PHD PROJECT MANAGER CHASE VERSION 2.X MARTIN M. L., JESPER H. A. CHASE-ING HAZARDOUS SUBSTANCES.
Public Libraries Survey Data File Overview. What We’ll Talk About PLS: Public Libraries Survey State level data Public library data (Administrative Entities)
International Office for Water B. Fribourg-Blanc, WG-E (6), Brussels, 6/7/2009 slide 1 Agenda Item 5 : (a) Data collection, associated data treatments.
SWRCBSWRCBSWRCBSWRCB AB2886 Implementation Sacramento Training Sacramento Training August 13 & 14, 2001 Marilyn R. Arsenault ArsenaultLegg, Inc.
SWRCBSWRCBSWRCBSWRCB AB2886 Implementation San Jose Training San Jose Training July 30, 2001 Marilyn R. Arsenault ArsenaultLegg, Inc.
WG2A meeting 7-8 October 2004 Working Group 2A ECOSTAT Agenda item 9b Discussion on final Intercalibation register.
Thomas Gutberlet HZB User Coordination NMI3-II Neutron scattering and Muon spectroscopy Integrated Initiative WP5 Integrated User Access.
Overview of the GEMS Food programme to support chemical risk assessment Dr Philippe Verger.
1 EUROPEAN TOPIC CENTRE ON WATER EUROWATERNET Towards an Index of Quality of the National Data in Waterbase.
Moving away from the fish-eye view Integrating Surveys for the Ecosystem Approach 29 May 2013, Ingeborg de Boois (WGISUR)
Biological Monitoring Database in Greece Dr. Yorgos Chatzinikolaou Expert on ecological status assessment and monitoring, Athens, Greece
ICES – Web services & Data services Carlos Pinto, ICES Data Systems Analyst FixO3 Network – Workshop 16th April 2015.
GLOBAL CAPTURE AND MANAGEMENT OF DATA Devising the solution, delivering the promise proven solutions for creating time in a busy commercial world Corporate.
SOFTWARE TESTING TRAINING TOOLS SUPPORT FOR SOFTWARE TESTING Chapter 6 immaculateres 1.
DATA TYPES.
Overview of the WISE SoE TCM data flow Data sources and handling
Data aggregation and products generation in the Mediterranean Sea
An introduction to MEDIN Data Guidelines September 2016
EMODnet - Ingestion and safe-keeping of marine data
The Marketing Research Process
An introduction to MEDIN Data Guidelines.
Lecture 6. Information systems
Review Graph Directed Graph Undirected Graph Sub-Graph
‘Work of the EEA aimed at streamlining marine assessment processes’
EU Water Framework Directive
Mental Health Data Alliance, LLC (MHData) June 7th , 2018
Marine Strategy Framework Directive:
Introduction to Systems Analysis and Design
Hovedside.
An introduction to MEDIN Data Guidelines.
‘Basic approach: Reporting and data handling’
CLIENT RELATIONSHIP MANAGEMENT KEEPING TRACK OF REQUESTS THE EASY WAY
Use of handheld electronic devices for data collection in GeoStat
EU Water Framework Directive
Proof of concept 29 September 2010
European Commission DG Environment
LAMAS Working Group June 2017
Spreadsheets, Modelling & Databases
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: BODC Annual Meeting, June ,
Commission report on Art. 8 WFD Monitoring programmes
Jo King: OSPAR case study data flow comparability, streamlining and synergies of assessments of chemical loads and burdens The presentation summarises.
Quality assessment of the monitoring database on priority substances
Item 2.2 of the Agenda Remote access to confidential data for researchers: possible actions under the 7th Framework Programme Pascal JACQUES Unit B 5 15.
WISE - State of the art --- WISE - in the context of SEIS
EU Water Framework Directive
M. Kezunovic (P.I.) S. S. Luo D. Ristanovic Texas A&M University
2018 Freshwater data call Stéphane Isoard
Norwegian Institute for Water Research
Concept paper on the assessment of WFD River Basin Management Plans
Karmen Hren Statistical Office of Slovenia
DG Environment, Unit D.2 Marine Environment and Water Industry
European Marine Monitoring and Assessment
Partcipants - presentations
HELCOM automated indicator evaluation system
Presentation transcript:

Reporting of chemical monitoring data to ICES Overview and way forward Jørgen Nørrevang Jensen ICES Emphasize that this is a personal view not necessarily corresponding to the official ICES view!

What is ICES doing: Promoting and coordinating marine science in the Northeast Atlantic (20 member countries, more than 100 working groups, and a network of around 1600 scientist) Producing advice for client commissions (DG Fish, DG Env, OSPAR, HELCOM etc.) Serves as a data centre for marine data

Types of data in the ICES Data Centre Fish catch statistics data Fish survey data Oceanographic data Data on contaminants in biota, sediment and seawater Fish disease data Data on biological effects of contaminants Biological community data (phytoplankton, zooplankton, phytobenthos, and zoobenthos)

ICES serves as a data centre for: HELCOM OSPAR AMAP ETC water

The ideal situation Well structured data in one defined format with a high level of QA at all levels All the commission (HELCOM, OSPAR, AMAP, and EEA) data submitted in time Not achievable with the present resources for data handling and the legal status of data submissions

The present procedure for submissions of contaminant data Data are submitted in a defined format either in a fixed format (2.2) or in a CSV format (3.2) Data are screened prior to the entry of data into the database Data stored as flat ASCII files that are handled by SAS-software

The future procedure for submissions of contaminant data Data are submitted in a defined format (3.2) (or in a free format ?) Data are screened prior to the entry of data into the database Data stored in a relational database (DOME)

Lack of submissions in space and time Problems identified Lack of submissions in space and time

Fake data and data-files Problems identified Fake data and data-files 01050001278 0508250509541606073020EJ99 37F75NBFDBLIMA LIM015 IJ TS F0RBOT N KO 13 cruise : 13 station : 04050001I01 001 00217 001040 F 05 O 13 probe: I01 07050001I01 LI000285 10050001I01 LICB101A 71 E-09L 01 01 10050001I01 LICB105A 22 E-09L 01 01 10050001I01 LICB118A 10 E-08L 01 01 -------------- 2104CB10101 17zL48 E-09 2104CB10501 17zL46 E-09 2104CB11801 17zL57 E-09 01040001267 0409160509541606073020EJ99 37F75NBFDBLIMA LIM015 IJ TS F0RBOT N KO 04040001I01 001 00217 001040 F 05 O 07040001I01 LI000285 10040001I01 LICB101A 71 E-09L 01 01 10040001I01 LICB105A 22 E-09L 01 01 10040001I01 LICB118A 10 E-08L 01 01

Errors/incomplete data: Problems identified Errors/incomplete data: Errors in the national/regional database Missing information in the data submitted (e.g. basis of determination: dry weight or wet weight) Errors created in the transfer from national/regional databases to the ICES reporting format

A very detailed and cumbersome reporting format Problems identified A very detailed and cumbersome reporting format The process of “learning” the ICES format takes quite an effort If you are reporting only one data type a large amount of the fields are redundant Errors are introduced in the process of transforming data from national databases to the ICES format

A very detailed and cumbersome reporting format RECID 38 BIOLOGICAL COMMUNITY ABUNDANCE/BIOMASS RECORD Problems identified A very detailed and cumbersome reporting format

Problems identified Some errors are only discovered when looking at the data – making assessments/data products param=HCHG tissu=MU country=Sweden area=Kattegat N MEDC 3.00E-09 4.00E-09 5.00E-09 6.00E-09 7.00E-09 8.00E-09 9.00E-09 1.00E-08 1.10E-08 1.20E-08 1.30E-08 1.40E-08 1.50E-08 1.60E-08 1.70E-08 1.80E-08 1.90E-08 2.00E-08 2.10E-08 2.20E-08 2.30E-08 2.40E-08 2.50E-08 2.60E-08 2.70E-08 2.80E-08 2.90E-08 3.00E-08 3.10E-08 3.20E-08 3.30E-08 year 1988 1989 1990 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004

Problems identified The QA data from e.g. QUASIMEME is not easy accessible for the assessments The ideal solution having one file from QASIMEME with all the results (with anonymous lab codes) is not acceptable for QASIMEME QA data received in a large number of files that can have been changed The solution of letting submitters put in the QA results in the data submissions is not optimal because fake data can and have been entered

General considerations/assumptions: The further away from the primary data sources you get the more difficult/costly it gets to correct errors in the data The amount of resources allocated for data handling is very limited in comparison to the resource used for collecting the samples and making the chemical analyses The people dealing with the reporting of data are not the same as those making the assessment

Improvements – the way forward Introduction of a free format The primary QA should be the responsibility of the submitting institute The data checks in the ICES Data Centre should be focussed on structural things and data checks that are related to having the “whole” set of data Eliminates the errors created by transforming national data to the ICES format Eliminates the excuses for not submitting data

Improvements – the way forward QA data should be directly available from e.g. QASIMEME When the Marine Strategy is implemented as a directive there will be an legal enforcement to get the data into the ICES Data Centre Extended use of the data will in the long run results in more and better data

In essence: The data should be used - a functional database rather than a data cemetery will encourage the submission of data and increase the quality of the data