1. 1st Annual Meeting, Roskilde, Denmark, 6 – 7 February 2018
EMODnet Chemistry 3 Data aggregation and products generation in the Black Sea
1st Annual Meeting, Roskilde, Denmark, 6 – 7 February 2018
Luminita Buga
NIMRD

2. Summary Updated Black Sea data collection – eutrophication
Data aggregation & QC
Data coverage (space & time)
TO DOs
2/5/2019

3. Updated Black Sea data collection – eutrophication
MSFD Black Sea AREA
Black Sea data collection
(20 November, 2017)
57575 files in ODV format
extended metadata files (data.csv)
Non-restricted
(SDN License / unrestricted)
47295
(82%)
Restricted
(by negotiation / academic / moratorium)
10280
(18%)
41 CDI-Originators
24 CDI-Partners
2/5/2019

4. Updated Black Sea data collection eutrophication
Originator (EDMO Code)
No.of CDIs 1
Odessa Branch of SOI (State Oceanographic Institute) (931)
3675 2
Ukrainian Hydrometeorological Institute - Marine Branch (841)
21581 3
P.P.Shirshov Institute of Oceanology, RAS (685)
608 4
Institute of Biology of the Southern Seas, NAS of Ukraine (840)
868 5
Ukrainian scientific center of Ecology of Sea (UkrSCES) (1167)
4299 6
Marine Hydrophysical Institute (727)
2385 7
Bulgarian National Oceanographic Data Centre(BGODC), Institute of Oceanology (692)
812 8
National Institute for Marine Research and Development Grigore Antipa" (697)"
4157 9
Iv.Javakhishvili Tbilisi State University, Centre of Relations with UNESCO Oceanological Research Centre and GeoDNA (UNESCO) (693)
220 10
Laboratory of Marine Ecology-Central Laboratory of General Ecology (192)
603 11
Institute of Fishery Resources (IFR) (191)
257 12
Sinop University, Fisheries Faculty (733)
343 13
Institute of Marine Sciences, Middle East Technical University (696)
2375 14
IFREMER / GM-MARINE GEOSCIENCES (485) 15
Institute of Oceanology, Bulgarian Academy of Sciences (IO-BAS) (1843)
149 16
IFREMER (1054) 24 17
Odessa National I.I.Mechnikov University (1169)
889 18
Scientific - Research Firm GAMMA" (1265)"
238 19
Ankara University (2176) 20
Specialized Center for Hydrometeorology and Monitoring of Environment of Black and Azov Seas (SC HME BAS) (2761) 21
Karadeniz Technical University, Faculty of Marine Sciences (732)
240 22
Danube Delta Biosphere Reserve Authority (2178) 23
Georgian Institute of Water Management of Georgian Technical University (2122) 68
Georgian Institute of Hydrometeorology of Georgian Technical University (2121) 53 25
CEREGE (560) 26
Hellenic Centre for Marine Research, Institute of Oceanography (HCMR/IO) (164) 50 27
North-Caucasus Regional Administration of Hydrometeorology of Roshydromet (910)
5346 28
Tuapse Hydrometeorological Bureau, North-Caucasus Centre (942)
409 29
Donskaya offing station North-Caucasus HMS (871)
657 30
Mariupol Marine Hydrometeorological Station, Ukrainian HMS (901) 31
Nothern Regional Administration of Hydrometeorology of Roshydromet (913) 32
Kuban offing station, North-Caucasus HMS (891)
226 33
Istanbul University, Institute of Marine Science and Management (802)
100 34
National Environmental Agency of the Ministry of Environment Protection and Natural Resources (2267) 62 35
Scientific Research Institute of Ecological Problems (USRIEP) (1168) 36
National Science Foundation (NSF) (1381) 37
Navy Main Administration of Navigation and Oceanography, Ministry of Defence (907) 79 38
State Oceanographic Institute, Sebastopol Branch (SB SOI) (1680) 57 39
Dokuz Eylul University, Institute of Marine Science and Technology (801) 76 40
State Oceanographic Institute (SOI) (723)
6507 41
Taurida V.I. Vernadsky National University (2227) 55
Updated Black Sea data collection eutrophication
2/5/2019

5. Updated Black Sea data collection eutrophication
CDI-partner (EDMO Code)
No. of CDIs 1
All-Russia Research Institute of Hydrometeorological Information - World Data Centre (RIHMI-WDC) National Oceanographic Data Centre (NODC) (681)
10830 2
Marine Hydrophysical Institute (727)
2444 3
Bulgarian National Oceanographic Data Centre(BGODC), Institute of Oceanology (692)
961 4
National Institute for Marine Research and Development Grigore Antipa" (697)"
4161 5
Iv.Javakhishvili Tbilisi State University, Centre of Relations with UNESCO Oceanological Research Centre and GeoDNA (UNESCO) (693)
345 6
National Institute of Meteorology and Hydrology, Bulgarian Academy of Sciences (961)
603 7
Institute of Fishery Resources (IFR) (191)
257 8
Sinop University, Fisheries Faculty (733)
343 9
Institute of Marine Sciences, Middle East Technical University (696)
2375 10
IFREMER / IDM / SISMER - Scientific Information Systems for the SEA (486) 46 11
P.P.Shirshov Institute of Oceanology, RAS (685)
429 12
Odessa National I.I.Mechnikov University (1169)
889 13
Scientific - Research Firm GAMMA" (1265)"
234 14
Ukrainian Hydrometeorological Institute - Marine Branch (841)
21483 15
Ankara University (2176) 24 16
Karadeniz Technical University, Faculty of Marine Sciences (732)
240 17
Institute of Biology of the Southern Seas, NAS of Ukraine (840)
821 18
Hellenic Centre for Marine Research, Hellenic National Oceanographic Data Centre (HCMR/HNODC) (269) 50 19
Istanbul University, Institute of Marine Science and Management (802)
100 20
National Environmental Agency of the Ministry of Environment Protection and Natural Resources (2267) 62 21
Ukrainian scientific center of Ecology of Sea (UkrSCES) (1167)
4293 22
PANGAEA - Data Publisher for Earth & Environmental Science (3234) 23
Dokuz Eylul University, Institute of Marine Science and Technology (801) 76
State Oceanographic Institute (SOI) (723)
6507
2/5/2019

6. Data aggregation Non-Restricted & Restricted imported together
ODV >> keep P01 and P35
Parameter list: ammonium, chlorophyll-a, oxygen (dissolved & saturation), nitrate, nitrite, nitrate plus nitrite, phosphate, silicate, total nitrogen, total phosphorus, pH, alkalinity
Keep T, S if present
2/5/2019

7. ODV import ocean_depth_profiles ocean_pressure_profiles time_series
sediment_depth_profiles
2/5/2019

8. Problems during ODV import
Mismatches between semantic header and header
Wrong date format
Empty files
Empty columns and/or extra columns
Missing quality flag column for variable
Missing values for Depth
Locations on land
Duplicates: Multiple LOCAL_CDI_Id in one ODV file
Mismatches between Local_CDI_Id in ODV file >> Local_CDI_Id in coupling
ocean_depth _profiles
54474
ocean_pressure_profiles
2418
time_series 11
sediment_depth_profiles
386
excluded from import
286
TOTAL
57575
Errors were corrected (when possible) and s start to be send to partners.
Much less errors than EMD Chemistry 2
2/5/2019

9. Data aggregation
Ocean_depth_profiles and ocean_pressure-profiles exported separate as SDN Aggregated ODV Collection and collections merged
Errors during aggregation: Wrong/invalid P01 / P06 codes
QF for depth / parameters = 0 (no quality control)
QF for depth or parameters = 8 (interpolated value); = A (value phenomenon uncertain)
value = 0 with QF ≠ 6 but QF = 0 / QF = 1 / QF = 8 / QF = 4
depth QF =3 / QF =4
Parameters value = 0 and confirmed by partners as being missing >> QF=5
s to partners >> further Data Quality Control depending on the answers
2/5/2019

10. Data aggregation (as per 6th February, 2018)
Not aggregated units
'PHOS [ug/l]' not used for 'SDN:P35::EPC00007 [umol/l]'.
Conversion 'SDN:P06::UPGL' > 'SDN:P06::UPOX' not known.
NTRI [ug/l]' not used for 'SDN:P35::EPC00006 [umol/l]'.
'NTRA [ug/l]' not used for 'SDN:P35::EPC00004 [umol/l]'.
'pH [umol/m^2/d]' not used for 'SDN:P35::EPC00168 [pH units]'.
Conversion 'SDN:P06::UUUD' > 'SDN:P06::UUPH' not known.
'pH [m]' not used for 'SDN:P35::EPC00168 [pH units]'.
Conversion 'SDN:P06::ULAA' > 'SDN:P06::UUPH' not known.
'ALKY [mg/l]' not used for 'SDN:P35::EPC00131 [mEquiv/l]'.
Conversion 'SDN:P06::UMGL' > 'SDN:P06::MEQL' not known.
'TotAlk/l [S/m]' not used for 'SDN:P35::EPC00131 [mEquiv/l]'.
Conversion 'SDN:P06::UECA' > 'SDN:P06::MEQL' not known.
'TotAlk/l_Pot [S/m]' not used for 'SDN:P35::EPC00131 [mEquiv/l]'.
'TotAlk/l_Pot [m]' not used for 'SDN:P35::EPC00131 [mEquiv/l]'.
Conversion 'SDN:P06::ULAA' > 'SDN:P06::MEQL' not known.
Corrected
from UPGL to UGPL
To be checked
~6000 profiles
Waiting the answer
To be checked
2/5/2019

11. Number of profiles / year
No QC / all QF
Number of profiles / year
2/5/2019

12. Data aggregation & QC (as per 6th February, 2018)
After QC
Depth < 0 / QF =4
Before QC
Wrong P06
All QF=0 >> QF=1
Initial QF = 1
Selection:
QF=1
QF=2
QF=6
QF=8
QF=A
O2 =0
Wrong values
O2 < 0
O2 = 0 and QF≠6
Dissolved Oxygen
Number of vertical profiles:
44116
2/5/2019

13. Data aggregation & 1st QC
Data aggregation & QC (as per 6th February, 2018)
Data aggregation & 1st QC
Phosphate
Before QC
After QC
All QF=0 >> QF=1
Selection:
QF=1
QF=2
QF=6
QF=8
QF=A
Number of vertical profiles:
30707
2/5/2019

14. Data aggregation & 1st QC
Data aggregation & QC (as per 6th February, 2018)
Data aggregation & 1st QC
Ammonium
Before QC
After QC
All QF=0 >> QF=1
Selection:
QF=1
QF=2
QF=6
QF=8
QF=A
NH4 < 0 and QF=1
NH4 = 0 and QF≠6
No QControled YET!
Number of vertical profiles:
21531
2/5/2019

15. Number of vertical profiles:
Data aggregation & QC (as per 6th February, 2018)
Nitrates
Before QC
After QC
All QF=0 >> QF=1
Selection:
QF=1
QF=2
QF=6
QF=8
QF=A
NO3 = 0 and QF≠6
No QControled YET!
Number of vertical profiles:
16840
2/5/2019

16. Number of vertical profiles:
Data aggregation & QC (as per 6th February, 2018)
Chlorophyll a
Before QC
After QC
All QF=0 >> QF=1
Selection:
QF=1
QF=2
QF=6
Concentration of chlorophyll-a … by in-situ chlorophyll fluorometer and manufacturer's calibration applied
Marmara Sea
No QControled YET!
Number of vertical profiles:
3355
2/5/2019

17. Number of vertical profiles:
Data aggregation & QC (as per 6th February, 2018)
Alkalinity
Before QC
After QC
Selection:
QF=1
QF=2
QF=6
Wrong P06 / waiting answers from partners
Number of vertical profiles:
14292
2/5/2019

18. Data aggregation & QC (as per 6th February, 2018)
Station history of all changes in QFs
At depth 1257 and 1258 from QF=1 to QF=3
Local_CDI_Id
EDMO Code
Parameter
[40798: FI _00013_H10 486]
Water body chlorophyll-a Depth [m] = {1257.5: :1} -> 3
[40786: FI _00001_H10 486]
Water body chlorophyll-a Depth [m] = {1257.5: : : :1} -> 3
[39744: ]
Water body nitrate Depth [m] = {0:1} -> 3
[56297: ]
Water body nitrate Depth [m] = {75:1} -> 3
[56296: ]
[11231: 15AK _ ]
Water body nitrate Depth [m] = {87:1} -> 3
[464: 02_DUS_S10089_D2010_10_14_T ]
Water body nitrite Depth [m] = {4:1} -> 3
[46165: ]
Water body phosphate Depth [m] = {400:1} -> 3
[6684: ViktorBugaev_Cruise_10104_Station_ ]
Water body phosphate Depth [m] = {1849:1} -> 3
Water body phosphate Depth [m] = {1505:1} -> 3
2/5/2019

19. Data aggregation & QC (as per 6th February, 2018)
Variable
No. of vertical profiles * 1
Water body dissolved oxygen concentration [umol/l]
44116 2
Water body dissolved oxygen saturation [%]
8547 3
Water body nitrate [umol/l]
16840 4
Water body nitrate plus nitrite [umol/l]
2678 5
Water body nitrite [umol/l]
27620 6
Water body phosphate [umol/l]
30707 7
Water body silicate [umol/l]
27128 8
Water body ammonium [umol/l]
21531 9
Water body chlorophyll-a [mg/m^3]
3355 10
Water body pH [pH units]
32105 11
Water body total alkalinity [mEquiv/l]
14292 12
Water body total nitrogen [umol/l]
10917 13
Water body total phosphorus [umol/l]
11762
* No. of final QControled vertical profiles might be slightly different
2/5/2019

20. TO DOs Thank you for your attention!
Send s to partners with all the corrections done in ODV format
Finish data quality control based on the answers from partners
Send to central buffer the QControled Black Sea updated data collection – separated Restricted and Non –Restricted
Send to the partners all the changes in QFs (Station history for every EDMO)
DIVA analysis for focused parameters (ammonium, chlorophyll-a, oxygen itrate plus nitrite, phosphate, silicate, total nitrogen?, total phosphorus?) depending on data coverage (time and space)
Thank you for your attention!
2/5/2019