Marine Data Management within EMODNet Chemistry project: data aggregation, quality control and products preparation A.S. Iona 1, P. Karagevrekis 1, S.Balopoulou.

Slides:



Advertisements
Similar presentations
Mediterranean Sea Basin Checkpoint a user of EMODnet Chemistry N. Pinardi E. Clementi C. Panaroni INGV EMODnet Chemistry Data Products – Experts Workshop.
Advertisements

Guidelines for QC/QA from EMODNet Chemistry pilot Marina Lipizer, Istituto Nazionale di Oceanografia e di Geofisica Sperimentale–OGS Dipartimento OCE Kick-off.
11 MEDATLAS 2002: database and data management system for the long term monitoring of Mediterranean and Black seas EC-MAST Concerted Action (MAS3-CT /ERBIC20-CT
Status of advanced access and viewing services following SeaDataNet D5.6 and D8.7 By Dick M.A. Schaap – Technical Coordinator Barcelona – Spain, 19 – 20.
SeaDataNet, pan-European infrastructure for ocean and marine data management A key component of EMODNet A possible building block for GEOSS By Dick M.A.
WP2: Data products generation in Mediterranean Sea EMODNET Chemistry Data Products, Experts Workshop Split (Croatia), June 2014 Sissy Iona, HCMR-HNODC.
EMODnet Chemistry 2 2 nd Steering Committee CNR, Piazzale Aldo Moro 7, Roma (Italy), Aula Golgi (2nd floor), January 2014.
WP1: Data collection and metadata compilation in Mediterranean Sea EMODNET Chemistry 2, Kick-off meeting Trieste (Italy), 3-5 June 2013 Sissy Iona, HCMR-HNODC.
EMODnet Chemistry 2 Advanced services Progress by Deltares Service Contract MARE/2012/10 S By Dick M.A. Schaap – Technical Coordinator Istanbul.
EMODNET Chemistry 2 Steering Group Rome (Italy), January 2014 WP 1 : DATA COLLECTION AND METADATA COMPILATION IN ATLANTIC SEA.
EMODnet Chemistry 2: administrative issues, results and scheduling Alessandra Giorgetti, Lipizer Marina, Vinci Matteo, Alessandro Altenburger and Alberto.
SeaDataNet2 Plenary meeting, 19th-20th September 2012, Rhodes SeaDataNet2 Plenary meeting THE EMODNET CHEMISTRY LOT. FROM THE EXPERIENCE OF THE THREE YEARS.
4 th steering committee Amsterdam, Netherlands 2-3 December 2014 DATA QC AND PRODUCTS ON ATLANTIC AREA With IFREMER, RIHMI-WDC, IHPT and IEO contributions.
1 st year meeting SPLIT, Croatia June 2014 REPORT ON ATLANTIC AREA With IFREMER, RIHMI-WDC, IHPT and IEO contributions.
EMODNet Chemistry (MARE/2012/10) 1 st Expert Meeting introduction June 2014 Split, Croatia Matteo Vinci and Alessandra Giorgetti OGS, Trieste.
Needs for Data and Information Managing living and non-living resources, monitoring environmental changes in the sea and protecting the marine environment,
Emodnet Chemistry 2 Lot First Steering Committee Aula Magna Androna Baciocchi, Trieste university, 5th June 2013.
QC/QA and Diva Products in Mediterranean Sea EMODNET Chemistry 2 Meeting on ODV QC and Diva Products Ifremer Headquarter, Paris, 3 September 2014 Sissy.
From Emodnet Chemical Pilot to Emodnet Chemistry 2 Matteo Vinci, Istituto Nazionale di Oceanografia e di Geofisica Sperimentale – OGS – NODC group, Dipartimento.
Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
EMODnet Chemistry 2 Service Contract MARE/2012/10 S Progress of the CDI service By Dick M.A. Schaap – Technical Coordinator Istanbul – Turkey,
Emodnet Chemistry Lot Guidelines for data products.
From Emodnet Chemical Pilot to Emodnet Chemistry 2 Matteo Vinci and Alessandra Giorgetti, – OGS – NODC group, OCE - MODEG meeting, Copenhagen, 4 and 5.
Annual Meeting, June , Istanbul, Turkey WP2: Data aggregation and products generation in the Atlantic Sea: results and criticalities EMODnet.
EMODNET Preparatory Actions Third six-monthly progress meeting for ur-EMODNET preparatory actions, 29 November 2010 Progress Report Chemical Lot Alessandra.
Chemical lot - HOW: Infrastructure set up based on SeaDataNet V1 efficient distributed Marine Data Management Infrastructure; Principle of “ADOPTED AND.
EMODnet Chemistry 2 Service Contract MARE/2012/10 S How to make EMODnet Chemistry fit for purpose at system level By Dick M.A. Schaap – Technical.
EMODnet Chemistry: Next steps in the coming two years Alessandra Giorgetti (OGS, Italy) EMODNet Chemistry – First Expert Workshop, 19 June 2014.
– 7 th February 2012, Bruxelles - EMODnet -Progress Meeting- Chemistry Lot A. Giorgetti M. Vinci.
Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
Actions from previous meeting EMODnet Chemistry Alessandra Giorgetti (OGS, Italy) 3 rd EMODnet-MSFD Coordination Meeting 8-9 December 2015, DG MARE, Brussels.
EMODnet Chemistry 2 Technical progress and new challenges Service Contract MARE/2012/10 S By Dick M.A. Schaap – Technical Coordinator Venice,
Marine Strategy 2012, 14th-16th May 2012, Copenhagen Marine Strategy 2012 THE EMODNET CHEMISTRY LOT. AN OVERVIEW ON THE EXPERIENCE OF THE THREE YEARS PILOT.
EMODNet Chemistry (MARE/2012/10). The portal should collect the following groups of chemicals: - in 3 matrices: water column, biota, sediment. - in all.
EMODNET Preparatory Actions Progress meeting for ur-EMODNET preparatory actions, 24 November 2009 Presentation of Progress Chemical Lot Alessandra Giorgetti.
EMODnet Chemistry Partner contribution: RIHMI-WDC 2-nd annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation.
Data Product Catalogue for SeaDataNet and Emodnet Chemistry M. Treguer, T. Loubrieu, C. GUYOT, IFREMER.
EMODnet Chemistry 2: administration, results, SWOT-analysis Alessandra Giorgetti, Lipizer Marina, Vinci Matteo EMODnet Chemistry 2 – Third year plenary.
The SeaDataNet data products regional temperature and salinity historical data collections S. Simoncelli 1, C. Coatanoan 2, O. Bäck 3, H. Sagen 4, S.
Outcomes from EMODnet/MSFD coordination meetings A. Giorgetti, M. Lipizer, M. Vinci EMODnet Chemistry, 3 rd year meeting, June 8-9, 2016 Helsinki, Finland.
EDMODnet Chemistry, Baltic Sea - Oxygen, Chlorophyll and contaminants - General issues Magnus Wenzer, Lotta Fyrberg, Örjan Bäck Swedish Meteorological.
EMODnet Chemistry 2 Service Contract MARE/2012/10 S Progress of the CDI service By Dick M.A. Schaap – Technical Coordinator Helsinki – Finland,
Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
DATA AGGREGATION AND PRODUCTS GENERATION
EMODnet Chemistry 3 Upgrading of the portal and its services By
SEXTANT PRODUCTS CATALOGUE
Partner contribution:
Data aggregation and products generation in the Mediterranean Sea
By Dick M.A. Schaap – Coordinator
EMODnet Chemistry WP2: Data aggregation and products generation
WP3: Data aggregation and products generation NE Atlantic Sea
EMODnet Chemistry initiative
EMODnet Chemistry themes: EMODnet Chemistry objectives:
WP2 Products in Mediterranean Sea
Dick M.A. Schaap – Technical Coordinator SeaDataNet Training Workshop
Dick M.A. Schaap – Technical Coordinator
EMODnet Chemistry 3 Management and Coordination
Data aggregation and products generation
Data aggregation and products generation in the Mediterranean Sea
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: BODC Annual Meeting, June ,
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: ISPRA Annual Meeting, June ,
Data collection and metadata population – harvesting
Upgrading the portal and its services
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: Institute of Oceanography and Fisheries,
Generation of data products in the Norwegian and Barents Seas
SDN Data access search:
EMODnet Chemistry contribution to data publication
EMODnet Chemistry 3 Generation of data products in the Baltic Sea
Generation of data products in the Mediterranean Sea
– 7 th February 2012 , Bruxelles -
Presentation transcript:

Marine Data Management within EMODNet Chemistry project: data aggregation, quality control and products preparation A.S. Iona 1, P. Karagevrekis 1, S.Balopoulou 1, A. Giorgetti 2, Dick Schaap 3 (1) HCMR-IO/HNODC Greece, (2) OGS Italy, (3) MARIS Netherlands European Geosciences Union General Assembly 2015 Vienna, Austria, 12 – 17 April 2015

Outline Overview of EMODNet Chemistry Project Approach Parameters selection Regional processing Adoption of SeaDataNet infrastructure Methodology Data Aggregation and Quality Control Statistical Analysis and Products Results Next activities

EMODnet Chemistry Project (MARE/2012/10) Initiated in 2009 by DG-MARE as part of the EMODNet to improve Europe’s marine data infrastructure, increase the availability of high quality data and products and assemble them under a common framework. Second phase ( ) aiming to continue the development of the infrastructure for the collection, management, quality control and visualization of chemical data in the marine environment: – move from a prototype to an operational service with full coverage of all European sea-basins, a wider selection of parameters and improved resolution data products; – In support of EU policies (such as MSFD)

Improvements of 2 nd phase Enlarged Partnership: 32 partners + 14 sub- contractors = total of 46 participants (about twice in relation to the 1 st phase!); more chemical species group as well as new parameters for climate change (partial pressure of oxygen, carbon dioxide) and acidity (pH); Aims to cover all European Waters with a specific focus on coastal data New products and services: new tools to be developed for coastal visualization + data layers in support of the MSFD

Choice of Parameters The following groups of chemicals are being collected and provided by the EMODNet Chemistry portal: in 3 matrices: water column, biota, sediment in all European waters

Regional Approach Data collection, metadata compilation, harvesting and products generation are organized at Regional level. Five sub-regional seas of Europe, as specified in the Marine Strategy Framework Directive (MSFD DIKE 5/12/08) have been specified: - Greater North Sea (including Norwegian Sea and Celtic Sea) (AU-DCE, Denmark) - Atlantic Sea (including Atlantic Coast and Macaronesia) (Ifremer, France) - Baltic Sea (SMHI, Sweden) - Black Sea (NIMRD, Romania) - Mediterranean Sea (HCMR/HNODC, Greece)

Spatial distribution: Search by Matrix of Chemicals vs Regions

SeaDataNet Approach EMODnet Chemistry adopts SeaDataNet infrastructure - a key element for interoperability and harmonization between the EMODNET pilots, for data and products compatibility: SeaDataNet Standards for background data and metadata, and products Common Data Index (CDI) mechanism for access background data with data policy Ocean Data View (ODV) format for background data exchange ODV tool for data processing, aggregation and quality control SeaDataNet Security Services Data-Interpolating Variational Analysis (DIVA) software tool to produce gridded data products and error maps products from the background data as NetCDF files. SeaDataNet Products catalogue (SEXTANT system) and viewing services for discovery, access, visualization and downloading of data products

Data Validation Loop

Data Aggregation-Mediterranean Region Mediterranean regional data pool of nutrients (results-nitrates, phosphates, silicates), harvested by a robot system: – stations (of vertical profiles and time series) – 209 separate variable labels (231 in total) – 141 SDN parameter codes (P01 codes), and – 22 different units (P06 codes) – 25 Organizations/NODCs from 12 countries

Data Aggregation-Mediterranean Region Initially (first year): Manual aggregation – An example below of grouping of phosphate data (different methods, instruments, names, usage codes, units)

Automated Data Aggregation Today, a P35 vocabulary is set up to aggregate various P01 terms with a common meaning into a unified aggregated term with a unique unit (P06). P35 is populated by BODC with contributions from various experts; so far it includes 136 entries and is growing. The ODV software has been enhanced to use the P35 mapping to automate parameter aggregation when aggregating data sets from multiple sources.

Phosphate Data – PO4 ( profiles)

Silicates Data – SiO4 ( profiles)

Nitrate Data – NO3 ( profiles)

911 Monitoring Stations of NO3, PO4, SiO4

Regional QA/QC For data QA/QC activities and as a basis for the interpolated maps, we focus only on “good” originators data: – SeaDataNet QC flag scale= 0,1,2,6 Quality checks includes: – Duplicates detection and elimination – Outliers elimination (broad range control checks) – Empty stations elimination – Replacement of zero values with detection limits (upon agreement with the originator) Additional checks (not yet applied): – N:P ratio – Ratio of inorganic N or P to total

Methodology for Data Assembly and Products Regional data collection and statistical analysis highlighted 2 main subsets of data: - DIVA (Data-Interpolating Variational Analysis) horizontal maps in the 5 regions; Not homogeneous distribution in time and space (basin) Homogeneous distribution in time and space (basin) -Time series plots produced for coastal points repeated in time, datasets with fragmented coverage. Animations of 10-years moving window average Dynamic time series plots and coastal visualization tools available as WPS

horizontal maps specifications Parameters: NO3, NOx, Total Nitrogen, PO4, Total Phosphorus, SiO4, NH4 + Alkalinity, pH, Dissolved Oxygen and Chlorophyll-a Time period: 10 year periods with yearly step from 1960 to 2014 (46 periods of 10 year), by seasons Seasons: 4 defined per region (in the Mediterranean: winter =January to March, etc) Vertical layers: standard defined per region (IODE standard levels as adopted in the Mediterranean) 10 years moving windows to reveal long term variabilities (trends) and to overcome the data gaps 1960 until until 1970, etc Reference field Climatic seasonal mean from all available years (with detrending for removal of uneven spatial distribution in time) Without detrending (for not to exclude temporal trends)

Analysis Results & errors fields We mask areas of poor data coverage

Other results

Mean: Std: Horizontal distribution maps, produced with 10-year moving window for trend detection Mean summer NO3 at first 10 m, over the area N , E12-15

Next Activities Complete DIVA maps for nutrients and silicates with 10-year moving window, seasons, and vertical layers Include also the whole Mediterranean region with a fine grid resolution so as to focus with efficient accuracy to smaller regions Start regional data processing for contaminants, including the data validation loop

Thank you! Visit the portal at: