EMODnet Chemistry 2 Service Contract MARE/2012/10 S Progress of the CDI service By Dick M.A. Schaap – Technical Coordinator Istanbul – Turkey, 15 June 2015, 2nd Plenary Progress Meeting

CDI service for discovery and unified access of data Already 105 data centres connected and more underway

CDI Data Discovery and Access Service Based up ISO19115 content standard and ISO XML Schema, fully INSPIRE compliant Dedicated tools and facilities for generating CDI entries, format associated data sets and populating the CDI service Shopping basket mechanism for discovery, access request, and downloading of data sets from distributed data centres Downloading in harmonised SeaDataNet formats: SDN ODV ASCII, and soon SDN NetCDF (CF) Adopted in many projects and ongoing improvements Operational governance scheme

Chemistry CDI Data Discovery and Access Service Dedicated CDI service for EMODNet Chemistry scope Three search interfaces for human users, upgraded as part of the project: Quick Search with dynamic drilling down of search results; Extended Search with more flexibility for combining search options, including free search; Variables Vs Marine Regions with an interactive Matrix of variables in specific marine regions.

Chemistry CDI Data Discovery and Access Service

Chemistry CDI Service – filter EMODNet Chemistry 2 project has a scope of chemical substances: Pesticidides and biocides Antifoulants Pharmaceuticals Heavy metals Hydrocarbons Radionuclides Fertilisers Organic matter(e.g. from sewers or mariculture) Chlorophyll Partial pressures of dissolved gases Acidity (from pH, pCO2, Total Inorganic Carbon, alkalinity) Others Mapping between new EMODNet Chemistry 2 groups and P02 Vocabulary done Sets filter for virtual subset of SeaDataNet CDI to EMODNet Chemistry CDI collection

Chemistry CDI Service – present coverage (14 June 2015) CDI records and data sets (June 2014: ) European waters (N80 W-30; N20 E45) CDI records and data sets (June 2014: ) 65 Data Centres (62) 32 Countries (31) 291 Originators (248) 1868 – 2015 years 84% unrestricted (82) 16% to be negotiated (18)

Discovery and harvesting of data sets for regional product groups EMODNet Chemistry 2 project is generating chemistry products per MSFD sea region Discovery and harvesting of data sets per MSFD region for specific chemical parameters is done in an almost full automatic method by: using a Robot harvester via the shopping mechanism to discover and retrieve specific data sets from distributed data centres to compile and maintain specific aggregate data sets as internal central data buffers that are transferred to regional groups for further processing and products generation.

Buffer CMS + Central User Interfacing CDI User Interfaces CDI Robot harvester Specific data buffers CDI User Interface + Shopper: Access regulated via AAA Agreed Settings Dynamic Maintenance Robot CMS to configure Robot harvesting profiles MARIS master RSM system extended with administering robot transactions and via central interfaces API

Central User Interface with logon (AAA service) following authorisation in buffer CMS profiles logon Overview of authorized buffers Central buffer UI incl direct shopping

Request Status Manager (RSM) service extended with administering of Central buffer interfaces Logon as user/provider/master New functions for central buffer shopping

Discovery and harvesting of data sets for regional product groups – 1 st year Robot harvester had gathered circa CDI records and data sets for nutrients in the given regions These sets were transferred to the EMODNet regional groups per region

Processing of the 1 st harvest by the Regional Coordinators revealed a lot of shortcomings of data sets This was handled by a feedback loop to data providers for improvement A second harvesting and delivery of regional data sets for nutrients took place in November 2014 Robot harvester gathered now circa CDI records and data sets for nutrients in the given regions Delivery took place via AWI of regional ODV collections of metadata enriched ODV files See reports of Regional Coordinators for follow-up Discovery and harvesting of data sets for regional product groups – repeated in November 2014

New buffer initiated with buffer-6 for contaminants in April 2015 All data centres requested to cooperate in case of ‘restricted’ data sets Discovery and harvesting of data sets for regional product groups – contaminants 14 June 2015: CDIs harvested from 27 data centres from 20 countries; ca remaining