Data aggregation and products generation in the Mediterranean Sea

Slides:



Advertisements
Similar presentations
WP1 - Data collection and metadata compilation in sea regions Sissy Iona (HCMR/HNODC) EMODNET Chemistry th Steering Committee, 2-3 December 2014,
Advertisements

WP2: Data products generation in Mediterranean Sea EMODNET Chemistry Data Products, Experts Workshop Split (Croatia), June 2014 Sissy Iona, HCMR-HNODC.
Marine Data Management within EMODNet Chemistry project: data aggregation, quality control and products preparation A.S. Iona 1, P. Karagevrekis 1, S.Balopoulou.
WP1: Data collection and metadata compilation in Mediterranean Sea EMODNET Chemistry 2, Kick-off meeting Trieste (Italy), 3-5 June 2013 Sissy Iona, HCMR-HNODC.
EMODNET Chemistry 2 Steering Group Rome (Italy), January 2014 WP 1 : DATA COLLECTION AND METADATA COMPILATION IN ATLANTIC SEA.
EMODNET Chemistry 2 Kick-off meeting Trieste (Italy), 3-5 June 2013 WP 1 : DATA COLLECTION AND METADATA COMPILATION IN ATLANTIC SEA.
EMODnet Chemistry 2: administrative issues, results and scheduling Alessandra Giorgetti, Lipizer Marina, Vinci Matteo, Alessandro Altenburger and Alberto.
Questionnaire based on ISO/IEC 17025: Data and Metadata QA/QC EMODNet Chemistry collects data and a complete set of metadata, including information.
4 th steering committee Amsterdam, Netherlands 2-3 December 2014 DATA QC AND PRODUCTS ON ATLANTIC AREA With IFREMER, RIHMI-WDC, IHPT and IEO contributions.
1 st year meeting SPLIT, Croatia June 2014 REPORT ON ATLANTIC AREA With IFREMER, RIHMI-WDC, IHPT and IEO contributions.
Annual Meeting, June , Split, Croatia WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
EMODNet Chemistry (MARE/2012/10) 1 st Expert Meeting introduction June 2014 Split, Croatia Matteo Vinci and Alessandra Giorgetti OGS, Trieste.
QC/QA and Diva Products in Mediterranean Sea EMODNET Chemistry 2 Meeting on ODV QC and Diva Products Ifremer Headquarter, Paris, 3 September 2014 Sissy.
Annual Meeting, June , Split, Croatia WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
Annual Meeting, June , Split, Croatia WP3: QA/QC Validation – MSFD Interactions current status EMODnet Chemistry Partner contribution: ISPRA.
Expert Workshop, June , Split, Croatia Output from TG Data for MSFD implementation EMODnet Chemistry Giordano Giorgi - ISPRA.
Emodnet Chemistry Lot Guidelines for data products.
From Emodnet Chemical Pilot to Emodnet Chemistry 2 Matteo Vinci and Alessandra Giorgetti, – OGS – NODC group, OCE - MODEG meeting, Copenhagen, 4 and 5.
Annual Meeting, June , Istanbul, Turkey WP2: Data aggregation and products generation in the Atlantic Sea: results and criticalities EMODnet.
EDMODnet Chemistry - DIVA Products from the Baltic Region Örjan Bäck, Lotta Fyrberg, Martin Hansson, Magnus Wenzer Swedish Meteorological and Hydrological.
EMODnet Chemistry: Next steps in the coming two years Alessandra Giorgetti (OGS, Italy) EMODNet Chemistry – First Expert Workshop, 19 June 2014.
Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
Actions from previous meeting EMODnet Chemistry Alessandra Giorgetti (OGS, Italy) 3 rd EMODnet-MSFD Coordination Meeting 8-9 December 2015, DG MARE, Brussels.
EMODnet Chemistry 2 Technical progress and new challenges Service Contract MARE/2012/10 S By Dick M.A. Schaap – Technical Coordinator Venice,
EMODNet Chemistry (MARE/2012/10). The portal should collect the following groups of chemicals: - in 3 matrices: water column, biota, sediment. - in all.
IMS-METU Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry.
EDMODnet Chemistry, Baltic Sea - Oxygen, Chlorophyll and contaminants - General issues Magnus Wenzer, Lotta Fyrberg, Örjan Bäck Swedish Meteorological.
EMODnet Chemistry 2 Service Contract MARE/2012/10 S Progress of the CDI service By Dick M.A. Schaap – Technical Coordinator Helsinki – Finland,
DATA AGGREGATION AND PRODUCTS GENERATION
SeaDataNet tools NEMO, OCTOPUS, MIKADO
Partner contribution: IOF, Split Croatia
ODV format templates for nutrients, dissolved gases and contaminants in different matrixes (water, sediment, biota) OGS – Marina Lipizer EMODnet Chemistry.
SEXTANT PRODUCTS CATALOGUE
Partner contribution:
Kick-off meeting, May, 2017, Trieste, Italy
EMODnet Chemistry WP2: Data aggregation and products generation
Management - coordination
WP3: Data aggregation and products generation NE Atlantic Sea
EMODnet Chemistry initiative
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: IMGW OM – Wlodzimierz Krzyminski.
EMODnet Chemistry themes: EMODnet Chemistry objectives:
WP2 Products in Mediterranean Sea
EMODnet Chemistry MSFD Board of Experts
Dick M.A. Schaap – Technical Coordinator SeaDataNet Training Workshop
EMODnet Chemistry 3 Management and Coordination
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner 40: State Oceanographic Institute Alexander Korshenko,
Data aggregation and products generation
Data aggregation and products generation in the Mediterranean Sea
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: BODC Annual Meeting, June ,
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: ISPRA Annual Meeting, June ,
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: Latvian Institute of Aquatic Ecology.
Further population of metadata and data for contaminants
Status for the North Sea
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Institute of Marine Science and Management, Istanbul University.
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: Marine Hydrophysical Institute Annual.
EUTROPHICATION – NE ATLANTIC
Data collection and metadata population – harvesting
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: Institute of Oceanography and Fisheries,
Generation of data products in the Norwegian and Barents Seas
EMODnet Chemistry contribution to data publication
EMODnet Chemistry 3 Generation of data products in the Baltic Sea
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: data delivery Annual Meeting, June.
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: IHPT, Portugal Annual Meeting, June.
Requirements for the final reporting
Marine Biology Station Piran(NIB)
Generation of data products in the Mediterranean Sea
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: NEA Partner’s logo Annual Meeting,
Status on Products Catalogue service
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: Seppo Kaitala Finnish Environment.
EMODnet Chemistry 3 Project Management and Communication
Presentation transcript:

Data aggregation and products generation in the Mediterranean Sea EMODnet Chemistry 3, Kick-Off Meeting,   Trieste, Italy, 16-19 May 2017 Data aggregation and products generation in the Mediterranean Sea Sissy Iona, HCMR-HNODC

Outline Progress so far (EMODnet Chemistry 2, 2013-2016) Fertilizers, Chl-a, Oxygen Contaminants Next activities (EMODnet Chemistry 3, 2017-2019+2)

Data aggregation and products generation in Mediterranean Sea The activity included 4 steps: data harvesting by a robot harvester system and delivery to regional leaders regional data aggregation including parameter harmonisation (using ODV) regional quality control using and data validation (using ODV) development of regional data products (using DIVA), create metadata for products discovery

Regional data harvesting April 2014 => nutrients October 2014 => completed the 1st harvest nutrients, with additional data and metadata March 2016 => contaminants, Oxygen, Chl-a Harvests Nb of stations (CDIs) April 2014 29 583 October 2014 34 321 March 2016 96 349 Totals: 160253

22 Data Providers, 17 countries (80 data originators)

Data Aggregation & harmonization The ODV software was used for the automate parameter aggregation of data sets from the multiple sources e.g. more than 15 parameter codes for seawater dissolved oxygen in common use due to different units, collection methods, names, etc

Quality Controls Observations (fertilizers, Chl-a, Oxygen) Broad range control checks: High values Default not null values Negatives were excluded Zero values Duplications checks Comparison of each profile with a spatially averaged profiles, values outside the “mean ± 3 stdev” were rejected

An example of QC on Oxygen Wrong units

Feedback loop with data providers All corrections done to the data (mainly to flags) and metadata were sent to data providers in order to update their local data sets : improve Mediterranean data (both at local and regional level) Avoid doing the same errors at regional level at the next cycle of harvesting

Feedback loop with data providers All corrections done to the data (mainly to flags) and metadata were sent to data providers in order to update their local data sets : improve Mediterranean data (both at local and regional level) Avoid doing the same errors at regional level at the next cycle of harvesting Don’t forget to correct your files when you are notified to do so

Inventory – aggregated data distributions 27 894 profiles 7 628 profiles 21 875 profiles 23 101 profiles 5 393 profiles

Inventory – aggregated data distributions 14 563 profiles 5 623 profiles 23 102profiles 74 562 profiles 23 105 profiles

horizontal interpolation Analysis settings based on data distributions and project needs: Seasons for Mediterranean: 0103, 0406, 0709, 1012 Time frame: 10-years running averages Vertical resolution: IODE standards depths Correlation length: averaged seasonal profiles (depending on data distributions) S/N=3 (constant in all depths) Mean of values as background field Both open sea profiles and coastal monitoring stations (time series) were used and applied data weighting both to profiles and to time series (to reduce the influence of close measurements) Logarithmic transformation applied to the data prior to the analysis to avoid negative results

products Parameter Years Seasons Depth interval Phosphates 1960 - 2013 4 0 - 1500 Total P 1984 - 2007 0 - 1000 Nitrates Nitrites 1965 - 2013 Nitrate+Nitite 1986 - 2013 Ammonium 1977 - 2013 Total N 1990 - 2004 Silicates Oxygen 1971 – 2013 0 - 2500 Chl-a 1972 - 2013

Horizontal distribution Water depth (m): surface 5 10 20 30

Products on Ocean browser service 1980 1990 a b Spring surface distribution of phosphate (µmol/l) for the decades 1975-1984 (a), 1985-1994 (b), 1995- 2004 (c), and 2004-2013 (d). 10-year running mean centred on the year indicated 2000 2009 c d

Influence of coastal data and river inputs

Influence of coastal data and river inputs Usage of variable Correlation Length depending on the depth in the next updates

Contaminants, 3rd harvest, Mar. 2016 6718 CDIs received (3rd harvest Mar.2016) With 1065 user parameters names, 935 P01 terms 6178 CDIs imported successfully at ODV format problems, wrong extensions, wrong primary variable, empty files 5878 CDIS aggregated at 220 P35 terms as priority variables according to the EMODnet Chemistry aggregations rules*, Oct. 2016 Nb of CDIs Water column Biota Sediment Totals 4 483 329 5 380 *(www.emodnet-chemistry.eu/default/products/documents/EMODnet_Chemistry_AggregationRules.pdf)

Contaminants distribution (water, sediment, biota)

Contaminants - Summaries in Mediterranean

Contaminants - Summaries in Mediterranean

Contaminants distributions

Contaminants distributions

Contaminants distributions

Next Activities Regional leaders, under WP3: Generation of data products WP 3.1: Generating harmonised, aggregated and validated data collections and DIVA maps of eutrophication (M14) WP 3.2: Generating harmonised, aggregated and validated data collections and DIVA maps on contaminants (M20) WP 3.3: Generating validated data collections and maps for marine litter and beach litter (M12)

Next Activities Partners (start from M1) and as a follow up of this training: overview/correct the present CDIs for possible inconsistencies add extra info about qa-qc processes, laboratory methods, include info if it is from a monitoring activity and don’t forget to include also CSR references populate more nutrients, contaminants, oxygen, chlorophyll data and the new type: marine litter