EMODnet Chemistry 2 Service Contract MARE/2012/10 S12.656742 Progress of the CDI service By Dick M.A. Schaap – Technical Coordinator Helsinki – Finland,

Slides:



Advertisements
Similar presentations
Annual Meeting, June , Split, Croatia WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
Advertisements

Status of CDI service (connections, NetCDF introduction, CDI ingestion service and set-up of CDI ingestion pilot) By Dick M.A. Schaap – Technical Coordinator.
Status of advanced access and viewing services following SeaDataNet D5.6 and D8.7 By Dick M.A. Schaap – Technical Coordinator Barcelona – Spain, 19 – 20.
2 nd Training Workshop 4 – 5 June 2007 Common Data Index - CDI By Dick M.A Schaap Technical Coordinator SeaDataNet.
Status of upgrading CDI service (user interface, harvesting via GeoNetwork, CDI interoperability options following SeaDataNet D8.7) By Dick M.A. Schaap.
EMODnet Chemistry 2 Service Contract MARE/2012/10 S…………… By Dick M.A. Schaap – Technical Coordinator Trieste – Italy, 3 – 5 June 2013, Kick Off Meeting.
Marine Data Management within EMODNet Chemistry project: data aggregation, quality control and products preparation A.S. Iona 1, P. Karagevrekis 1, S.Balopoulou.
WP1: Data collection and metadata compilation in Mediterranean Sea EMODNET Chemistry 2, Kick-off meeting Trieste (Italy), 3-5 June 2013 Sissy Iona, HCMR-HNODC.
EMODnet Chemistry 2 Advanced services Progress by Deltares Service Contract MARE/2012/10 S By Dick M.A. Schaap – Technical Coordinator Istanbul.
Annual Meeting, June , Split, Croatia EMODnet Chemistry IMS-METU WP1: Data collection and metadata compilation in sea regions: current status.
EMODNET Chemistry 2 Steering Group Rome (Italy), January 2014 WP 1 : DATA COLLECTION AND METADATA COMPILATION IN ATLANTIC SEA.
EMODnet Chemistry 2: administrative issues, results and scheduling Alessandra Giorgetti, Lipizer Marina, Vinci Matteo, Alessandro Altenburger and Alberto.
SeaDataNet2 Plenary meeting, 19th-20th September 2012, Rhodes SeaDataNet2 Plenary meeting THE EMODNET CHEMISTRY LOT. FROM THE EXPERIENCE OF THE THREE YEARS.
EMODNet Chemistry (MARE/2012/10) 1 st Expert Meeting introduction June 2014 Split, Croatia Matteo Vinci and Alessandra Giorgetti OGS, Trieste.
From Emodnet Chemical Pilot to Emodnet Chemistry 2 Matteo Vinci, Istituto Nazionale di Oceanografia e di Geofisica Sperimentale – OGS – NODC group, Dipartimento.
Annual Meeting, June , Split, Croatia WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
EMODnet Chemistry 2 Service Contract MARE/2012/10 S Progress of the CDI service By Dick M.A. Schaap – Technical Coordinator Istanbul – Turkey,
Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
EMODnet Chemistry 2 Service Contract MARE/2012/10 S Technical developments of the EMODNet Chemistry portal By Dick M.A. Schaap – Technical Coordinator.
Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
EMODnet Chemistry 2 Service Contract MARE/2012/10 S How to make EMODnet Chemistry fit for purpose at system level By Dick M.A. Schaap – Technical.
Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner contribution: NIOZ Royal Netherlands Institute for.
EMODnet Chemistry 2 Technical progress and new challenges Service Contract MARE/2012/10 S By Dick M.A. Schaap – Technical Coordinator Venice,
Marine Strategy 2012, 14th-16th May 2012, Copenhagen Marine Strategy 2012 THE EMODNET CHEMISTRY LOT. AN OVERVIEW ON THE EXPERIENCE OF THE THREE YEARS PILOT.
EMODNet Chemistry (MARE/2012/10). The portal should collect the following groups of chemicals: - in 3 matrices: water column, biota, sediment. - in all.
EMODNET Preparatory Actions Progress meeting for ur-EMODNET preparatory actions, 24 November 2009 Presentation of Progress Chemical Lot Alessandra Giorgetti.
Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
IMS-METU Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry.
Download Manager software Training Workshop Ostend, Belgium, 20 th May 2014 D.M.A. Schaap - Technical Coordinator.
New call Operation, development and maintenance of EMODnet Alessandra Giorgetti, Lipizer Marina, Vinci Matteo EMODNet Chemistry 2 – Third year plenary.
Metadata V1 By Dick M.A. Schaap – technical coordinator Oostende, June 08.
Outcomes from EMODnet/MSFD coordination meetings A. Giorgetti, M. Lipizer, M. Vinci EMODnet Chemistry, 3 rd year meeting, June 8-9, 2016 Helsinki, Finland.
Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
DATA AGGREGATION AND PRODUCTS GENERATION
EMODnet Chemistry 3 Upgrading of the portal and its services By
Partner contribution:
Data aggregation and products generation in the Mediterranean Sea
EMODnet Chemistry WP2: Data aggregation and products generation
WP3: Data aggregation and products generation NE Atlantic Sea
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: IMGW OM – Wlodzimierz Krzyminski.
WP2 Products in Mediterranean Sea
Dick M.A. Schaap – Technical Coordinator SeaDataNet Training Workshop
Dick M.A. Schaap – Technical Coordinator
Partner contribution: IMBK, Montenegro
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner 40: State Oceanographic Institute Alexander Korshenko,
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: BODC Annual Meeting, June ,
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: ISPRA Annual Meeting, June ,
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: Latvian Institute of Aquatic Ecology.
Further population of metadata and data for contaminants
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Institute of Marine Science and Management, Istanbul University.
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: Marine Hydrophysical Institute Annual.
Data collection and metadata population – harvesting
Upgrading the portal and its services
Updating the existing advanced viewing services
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: Institute of Oceanography and Fisheries,
Generation of data products in the Norwegian and Barents Seas
EMODnet Chemistry contribution to data publication
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: data delivery Annual Meeting, June.
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: IHPT, Portugal Annual Meeting, June.
Generation of data products in the Mediterranean Sea
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: NEA Partner’s logo Annual Meeting,
Status on Products Catalogue service
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: Seppo Kaitala Finnish Environment.
WP1: Data collection compared to initial data inventory
Presentation transcript:

EMODnet Chemistry 2 Service Contract MARE/2012/10 S Progress of the CDI service By Dick M.A. Schaap – Technical Coordinator Helsinki – Finland, 8 June 2016, 3rd Plenary Progress Meeting

Chemistry CDI Data Discovery and Access Service Dedicated CDI service for EMODNet Chemistry scope Three search interfaces for human users, upgraded as part of the project: Quick Search with dynamic drilling down of search results; Extended Search with more flexibility for combining search options, including free search; Variables Vs Marine Regions with an interactive Matrix of variables in specific marine regions.

Chemistry CDI Data Discovery and Access Service

Chemistry CDI Service – filter EMODNet Chemistry 2 project has a scope of chemical substances, included in P36 Vocabulary: Pesticidides and biocides Antifoulants Pharmaceuticals Heavy metals Hydrocarbons Radionuclides Fertilisers Organic matter(e.g. from sewers or mariculture) Chlorophyll Partial pressures of dissolved gases Acidity (from pH, pCO2, Total Inorganic Carbon, alkalinity) Others Mapping between P36 and P02 Vocabularies as basis for the Matrix search Gives overview of virtual subsets of SeaDataNet CDI to EMODNet Chemistry CDI collection

Chemistry CDI Service – present coverage (7 June 2016) CDI records and data sets (June 2014: ; June 2015: ) European waters (N80 W-30; N20 E45) CDI records and data sets (June 2014: ; June 2015: ) 64 Data Centres (65, 62) 32 Countries (32, 31) 311 Originators (291, 248) 1868 – 2016 years 84% unrestricted (84, 82) 16% to be negotiated (16, 18)

Improvements of the CDI User Interface In cooperation with BODC an L04 Vocabulary has been set up with matrices (atmosphere, water, sediment, biota) and its relations with the P02 Vocabularies The L04 Vocabulary has been integrated into the CDI User Interface Now still to do: integrate also P36 Vocabulary in the CDI User Interfaces together with L04 and P02 L04 = matrices P36 = chemical groups P02 = discovery parameters

Buffer CMS + Central User Interfacing CDI User Interfaces CDI Robot harvester Specific data buffers CDI User Interface + Shopper: Access regulated via AAA Agreed Settings Dynamic Maintenance Robot CMS to configure Robot harvesting profiles MARIS master RSM system extended with administering robot transactions and via central interfaces API

Central User Interface with logon (AAA service) following authorisation in buffer CMS profiles logon Overview of authorized buffers Central buffer UI incl direct shopping

Request Status Manager (RSM) service extended with administering of Central buffer interfaces Logon as user/provider/master New functions for central buffer shopping

Discovery and harvesting of data sets for regional product groups – March 2016 Robot harvester had gathered CDI records and data sets for contaminants (ca ) and other (oxygen, chlorophyll,..) (ca ) in the given regions

Discovery and harvesting of data sets for regional product groups – March 2016 Processing by the Regional Coordinators again revealed a lot of shortcomings of data sets Therefore there is a feedback loop ongoing to data providers for improvement Still a lot of outstanding actions needed by data providers Direct contact between regional coordinators, CDI-Support (Flavian) and data providers => All data providers concerned are urged to undertake action !!

Outstanding actions for data providers - partly Region Organisatio n EDMO codeIncorrect ODV filesNumber of files True duplicates? The ODV files were corrected? N. AtlanticPANGAEA3234There are no values for the declared measurement parameters 116NoNo, they were deleted N. AtlanticPANGAEA3234warning vocab versionin progress N. AtlanticIPMA3288warning vocab versionNoNo, not yet contacted N. AtlanticIPMA3288Usage of incorrect primary variable instead of pressure. EDMO code is not set to 3288 (92 files).Wrong local_cdi_id (53 files) No N. AtlanticBODC43Incorrect primary variable used in the ODV files 29NoYes for 21 of them N. AtlanticBODC43warning vocab versionNoNo, not yet contacted N. AtlanticIFREMER486invalid extra-character in the cruise name 33NoYes N. AtlanticBSH96wrong column header with a missing blank betwwen the name parameter and unit 1 ( _ODV.txt)NoNo, not yet contacted N. AtlanticBRGM1022Wrong extension of ODV files/folders :.txt instead of.zip 319NoNo, not yet contacted N. AtlanticRIHMI681warning vocab versionNoNo, not yet contacted N. AtlanticIEO353warning vocab versionNoNo, not yet contacted Black SeaIU-IMS802Yes, incorrect usage of P01 vocabulary entry to EDMO 802 (AHMET EDİP MÜFTÜOĞLU) on ; corrections done ( from AHMET EDİP MÜFTÜOĞLU) OK 105No

Work on P35 for new groups MARIS prepared an index of all used P01 terms in the 2 buffers for contaminants and other parameters. This was merged with the existing P35 – P01 mapping to reveal the P01 terms that had not yet a P35 term OGS together with the regional coordinators has made a priority list for completing P35 This has been followed up by BODC => P35 is now ready for use by regional coordinators as part of the harmonisation – aggregation process