Generation of data products in the Mediterranean Sea

Slides:



Advertisements
Similar presentations
WP1 - Data collection and metadata compilation in sea regions Sissy Iona (HCMR/HNODC) EMODNET Chemistry th Steering Committee, 2-3 December 2014,
Advertisements

Overview of the data collection in the Mediterranean Stavroula Balopoulou (HCMR-HNODC), Sissy Iona (HCMR-HNODC)
EDMODnet Chemistry - DIVA Products from the Baltic Region Örjan Bäck, Lotta Fyrberg, Martin Hansson, Magnus Wenzer Swedish Meteorological and Hydrological.
WP2: Data products generation in Mediterranean Sea EMODNET Chemistry Data Products, Experts Workshop Split (Croatia), June 2014 Sissy Iona, HCMR-HNODC.
Marine Data Management within EMODNet Chemistry project: data aggregation, quality control and products preparation A.S. Iona 1, P. Karagevrekis 1, S.Balopoulou.
WP1: Data collection and metadata compilation in Mediterranean Sea EMODNET Chemistry 2, Kick-off meeting Trieste (Italy), 3-5 June 2013 Sissy Iona, HCMR-HNODC.
EMODnet Chemistry 2 Advanced services Progress by Deltares Service Contract MARE/2012/10 S By Dick M.A. Schaap – Technical Coordinator Istanbul.
EMODNET Chemistry 2 Steering Group Rome (Italy), January 2014 WP 1 : DATA COLLECTION AND METADATA COMPILATION IN ATLANTIC SEA.
EMODNET Chemistry 2 Kick-off meeting Trieste (Italy), 3-5 June 2013 WP 1 : DATA COLLECTION AND METADATA COMPILATION IN ATLANTIC SEA.
EMODnet Chemistry 2: administrative issues, results and scheduling Alessandra Giorgetti, Lipizer Marina, Vinci Matteo, Alessandro Altenburger and Alberto.
4 th steering committee Amsterdam, Netherlands 2-3 December 2014 DATA QC AND PRODUCTS ON ATLANTIC AREA With IFREMER, RIHMI-WDC, IHPT and IEO contributions.
1 st year meeting SPLIT, Croatia June 2014 REPORT ON ATLANTIC AREA With IFREMER, RIHMI-WDC, IHPT and IEO contributions.
EMODNet Chemistry (MARE/2012/10) 1 st Expert Meeting introduction June 2014 Split, Croatia Matteo Vinci and Alessandra Giorgetti OGS, Trieste.
Needs for Data and Information Managing living and non-living resources, monitoring environmental changes in the sea and protecting the marine environment,
QC/QA and Diva Products in Mediterranean Sea EMODNET Chemistry 2 Meeting on ODV QC and Diva Products Ifremer Headquarter, Paris, 3 September 2014 Sissy.
EMODnet Chemistry 2 Service Contract MARE/2012/10 S Progress of the CDI service By Dick M.A. Schaap – Technical Coordinator Istanbul – Turkey,
Expertsmeeting SPLIT, Croatia June 2014 REPORT ON ATLANTIC AREA With IFREMER, RIHMI-WDC, IHPT and IEO contributions.
Emodnet Chemistry Lot Guidelines for data products.
Annual Meeting, June , Istanbul, Turkey WP2: Data aggregation and products generation in the Atlantic Sea: results and criticalities EMODnet.
EDMODnet Chemistry - DIVA Products from the Baltic Region Örjan Bäck, Lotta Fyrberg, Martin Hansson, Magnus Wenzer Swedish Meteorological and Hydrological.
EMODnet Chemistry: Next steps in the coming two years Alessandra Giorgetti (OGS, Italy) EMODNet Chemistry – First Expert Workshop, 19 June 2014.
– 7 th February 2012, Bruxelles - EMODnet -Progress Meeting- Chemistry Lot A. Giorgetti M. Vinci.
Actions from previous meeting EMODnet Chemistry Alessandra Giorgetti (OGS, Italy) 3 rd EMODnet-MSFD Coordination Meeting 8-9 December 2015, DG MARE, Brussels.
EMODnet Chemistry 2 Technical progress and new challenges Service Contract MARE/2012/10 S By Dick M.A. Schaap – Technical Coordinator Venice,
EMODNet Chemistry (MARE/2012/10). The portal should collect the following groups of chemicals: - in 3 matrices: water column, biota, sediment. - in all.
EMODnet Chemistry Partner contribution: RIHMI-WDC 2-nd annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation.
EMODnet Chemistry 2: administration, results, SWOT-analysis Alessandra Giorgetti, Lipizer Marina, Vinci Matteo EMODnet Chemistry 2 – Third year plenary.
The SeaDataNet data products regional temperature and salinity historical data collections S. Simoncelli 1, C. Coatanoan 2, O. Bäck 3, H. Sagen 4, S.
EDMODnet Chemistry, Baltic Sea - Oxygen, Chlorophyll and contaminants - General issues Magnus Wenzer, Lotta Fyrberg, Örjan Bäck Swedish Meteorological.
EMODnet Chemistry 2 Service Contract MARE/2012/10 S Progress of the CDI service By Dick M.A. Schaap – Technical Coordinator Helsinki – Finland,
DATA AGGREGATION AND PRODUCTS GENERATION
SeaDataNet tools NEMO, OCTOPUS, MIKADO
EMODnet Chemistry 3 Upgrading of the portal and its services By
Partner contribution: IOF, Split Croatia
Partner contribution:
Data aggregation and products generation in the Mediterranean Sea
EMODnet Chemistry WP2: Data aggregation and products generation
WP3: Data aggregation and products generation NE Atlantic Sea
Meeting on ODV QC and DIVA Products
EMODnet Chemistry initiative
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: IMGW OM – Wlodzimierz Krzyminski.
EMODnet Chemistry themes: EMODnet Chemistry objectives:
WP2 Products in Mediterranean Sea
EMODnet Chemistry MSFD Board of Experts
Data aggregation and product generation in the North SEA
Dick M.A. Schaap – Technical Coordinator
1st Annual Meeting, Roskilde, Denmark, 6 – 7 February 2018
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner 40: State Oceanographic Institute Alexander Korshenko,
Data aggregation and products generation
Data aggregation and products generation in the Mediterranean Sea
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: BODC Annual Meeting, June ,
Data aggregation and products generation in the Norwegian and Barents Seas Ann Kristin Østrem Institute of Marine Research, Norway.
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: ISPRA Annual Meeting, June ,
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: Latvian Institute of Aquatic Ecology.
Status for the North Sea
EUTROPHICATION – NE ATLANTIC
Data collection and metadata population – harvesting
Upgrading the portal and its services
Generation of data products in the Norwegian and Barents Seas
SDN Data access search:
EMODnet Chemistry contribution to data publication
EMODnet Chemistry 3 Generation of data products in the Baltic Sea
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: data delivery Annual Meeting, June.
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: IHPT, Portugal Annual Meeting, June.
Requirements for the final reporting
Marine Biology Station Piran(NIB)
Steering Committee Meeting Amsterdam, Dec 2014
Status on Products Catalogue service
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: Seppo Kaitala Finnish Environment.
– 7 th February 2012 , Bruxelles -
Presentation transcript:

Generation of data products in the Mediterranean Sea EMODnet Chemistry 3 Final Meeting, Madrid, Spain, 29th – 31st January, 2019 Generation of data products in the Mediterranean Sea S.Iona, M. Tsompanou HCMR, sissy@hnodc.hcmr.gr mtsompanou@hcmr.gr

Products in Mediterranean Sea Harmonised, aggregated and validated data collections for: eutrophication contaminants Basin DIVA maps for nutrients, chlorophyll and oxygen. High resolution DIVA maps for nutrients near rivers mouths (not yet).

28 CDI partners, 19 countries, 96 originators

Eutrophication data Nov. 2017, eutrophication data harvest, by MARIS, using a robot Harvester system. Nov. 2017, Data aggregation: in case of Mediterranean the aggregation was done by R. Schlitzer, with the latest ODV5.0 beta in communication with the coordinators & regional leader on which P35 terms to include. Mar. 2018, Quality control and data validation using ODV5. Oct. 2018, Creation of the interpolated basin maps, using DIVA (v4.7.2) and the corresponding metadata for the Sextant product catalogue service (DOIs included).

Eutrophication data 4 aggregated collections: Non-Restricted Data Profiles (54%) Time series (6%) Restricted Data Profiles (36%) Time series (4%)

Eutrophication Profiles - geographical distribution Parameters Number of profiles Number of points Period Ammonium [umol/l] 7215 41721 1970-2016 Chlorophyll-a [mg/m^3] 17267 5505117 1971-2017 Dissolved oxygen concentration [umol/l] 48482 7348096 1911-2017 Nitrate [umol/l] 13792 108923 1928-2016 Nitrate plus nitrite [umol/l] 1523 14742 1975-2013 Nitrite [umol/l] 12975 91858 1960-2016 pH 15189 228259 1930-2015 Phosphate [umol/l] 15758 117267 Silicate [umol/l] 13892 106650 1950-2016 Total nitrogen [umol/l] 1032 2316 1983-2015 Total phosphorus [umol/l] 1383 3196 1978-2016 Non restricted profiles: 60876 Parameters Number of profiles Number of points Period Ammonium [umol/l] 6955 21463 1987-2015 Chlorophyll-a [mg/m^3] 9048 296995 1986-2015 Dissolved oxygen concentration [umol/l] 25983 2168057 Nitrate [umol/l] 6040 25905 1987-2014 Nitrate plus nitrite [umol/l] 5845 27863 Nitrite [umol/l] 8633 34503 1985-2015 pH 11137 262204 1986-2014 Phosphate [umol/l] 13386 59825 Silicate [umol/l] 11141 54473 Total nitrogen [umol/l] 2114 3032 1997-2013 Total phosphorus [umol/l] 2924 5297 1990-2011 Restricted profiles: 40650

Eutrophication Times Series- geographical distribution Parameters Number of positions Number of points Period Ammonium [umol/l] 3612 47001 1974-2015 Chlorophyll-a [mg/m^3] 1537 119672 Dissolved oxygen concentration [umol/l] 4638 218067 Nitrate [umol/l] 3293 30467 1978-2015 Nitrate plus nitrite [umol/l] 2259 10764 Nitrite [umol/l] 3284 30418 pH 3684 137526 Phosphate [umol/l] 3728 49299 Silicate [umol/l] 2454 39454 Total alkalinity [mEquiv/l] 1981 5996 1978-2008 Total nitrogen [umol/l] 1001 3611 1980-1999 Total phosphorus [umol/l] 2665 28409 Non restricted Time series: 6415 Restricted Time series: 3921 Parameters Number of positions Number of points Period Ammonium [umol/l] 3146 5335 2000-2015 Chlorophyll-a [mg/m^3] 1 4932 2016 Dissolved oxygen concentration [umol/l] 3616 48624 Nitrate [umol/l] 3155 5420 Nitrate plus nitrite [umol/l] 2748 3637 2000-2010 Nitrite [umol/l] 3103 pH 2995 5397 Phosphate [umol/l] 3099 5298 Silicate [umol/l] 3140 5357 Total alkalinity [mEquiv/l] 471 1748 Total nitrogen [umol/l] 3062 5013 2000-2014 Total phosphorus [umol/l] 3014 4965

Eutrophication data – Quality Control The most common format error: 2 parameters with same code and different unit NUMBER ODV FILES COMMENTS 248 Header line. 'WC_dissO2’ is not in the semantic header. 94 Header line. 'PON' is not in the semantic header. 36 Header line. 'POC' is not in the semantic header. 31 No data found. 1 Multiple LOCAL_CDI_ID; no depth values. Header line (line=21). 'AKTH' is not in the semantic header. same code (P01) different units (P06) Columns headers & metadata columns in same row 375 ODV files were not initially imported in ODV, but in contact with the originators, more than 90% corrected and imported to the collections

Eutrophication data – Quality Control Checks for: Zero values => Flag = 6 or 4 Negative values => Flag = 4 Out of range values => Flag = 4 “Stuck” values => Flag = 4 Null values => Flag = 4 Values with flag = 0 Nitrate < Nitrite

Eutrophication data - QC feedback loop In total: 19 from 23 of EDMO CDI partners needed correction 15 partners have responded and corrected/are correcting their data: OGS, Italy CNR (ISMAR), Italy HCMR, Greece IEO, Spain MI, Ireland IFREMER, France RIHMI-WDC, Russian Fed. IMS, Turkey UMT.IOI.POU, Malta IMBK, Montenegro NIB, Slovenia IOLR, Israel ORION, OC-UCY, Cyprus ISRAMAR, Israel IOF, Croatia Still: 2 partners to respond contact persons from CNR-ISMAR-SP, ISAC to be identified by the RL

Eutrophication data – Quality Control At the vertical profiles, in more than 2,000,000 measurements points the Quality Flags (QFs) were corrected.

DIN Product Calculated from NO3 + NO2 + NH4 or NOX + NH4 (or DIN existed in original data) Profiles Parameters Number of profiles Ammonium [umol/l] 14170 Nitrate [umol/l] 18634 Nitrate plus nitrite [umol/l] 7239 Nitrite [umol/l] 20506 DIN original [umol/l] 3928 DIN [umol/l] 15337 TimeSeries Parameters Number of profiles Ammonium [umol/l] 6743 Nitrate [umol/l] 6448 Nitrate plus nitrite [umol/l] 4992 Nitrite [umol/l] 6387 DIN original [umol/l] 122 DIN [umol/l] 6663 12

Basin DIVA maps for Eutrophication 5 DIVA (v4.7.2) products in Mediterranean, moving 6 years averages: log(data)-exp(analysis)" transformation applied to the data prior to the analysis. S/N=1 Background field: the data mean value is subtracted from the data. Correlation length was optimized and filtered vertically and a seasonally-averaged profile was used. 1∕8° × 1∕8° output regular grid resolution. Parameter From year – to year Nb of seasons Depth interval (m) Phosphates 1968-1973 to 2011-2016 4 0-1500 Silicate 1965-1970 to 2011-2016 Dissolved oxygen 1971-1976 to 2012-2017 0-2000 DIN 1990-1995 to 2011-2016 0-1100 Chlorophyll-a 1990-1995 to 2012-2017 0-1000

ec.oceanbrowser.net/emodnet/

Contaminant data The process workflow included: Oct. 2018, Contaminant data harvest, by MARIS, using a robot Harvester system. Received ≈ 10.000 odv txt files. Due to wrong primary variables, we manually separated the odv txt files in matrices (Water, Sediment, Biota). Corrected format errors. Data harmonization using the new version of ODV (V5) dedicated to harmonization. Quality control: only negative and null values.

Contaminant data * Same P01 with different local name and different unit ** One P01 with one local name and one agreed unit

Biota Contaminant, 598 CDIs, 1979-2017 Initial P01: P01 before Harmonization, Total P01: Total P01 after Harmonization, Harm. P01: P01 which was harmonized after Harmoniazation, Non Harm. P01: P01 which was not harmonized after Harmonization. Non harmonized P01 is P01 which were not in emodnet chemistry contaminant scope, were last minute correction of the partners and will be add in next face. 8/26/2019

Water Contaminant, 2667 CDIs, 1974-2015

Sediment Contaminant data Profile data, 3979 cdis, 1961-2016 Time series data, 3485 cdis, 1981-2017

QC- Format Errors in Contaminants Format errors in 9 from 19 partners: txt files which are zip files files without data header files without or wrong primary variable (sediment data with water depth/pressure instead of sediment depth –COREDIST) biota data in wrong file type (profile instead of timeseries) wrong units and/or P01

QC- data and QF errors in Contaminants QF errors in 2 from 19 partners QC checked applied to the data: missing and negative values (according to the group decisions) Results: 472 values from 141 CDIs with values 999.99 with flag 6 negative values with flag 1 New flag = 4

QC feedback loop in Contaminants 7 from 9 partners have responded and corrected/are correcting their data OGS – CNR IEO IOF ORION, OC-UCY ISRAMAR – IOLR IFREMER – BRGM NIB Still 1 provider to be contacted contact person from RIHMI-RAS, EDMO 4483 to be identified by the RL