EMODnet Chemistry 2 Technical progress and new challenges Service Contract MARE/2012/10 S12.656742 By Dick M.A. Schaap – Technical Coordinator Venice,

Slides:



Advertisements
Similar presentations
EMODnet Chemistry 2 3 rd Steering Committee Hotel Park, Split (Croatia), 20 June 2014.
Advertisements

Status of CDI service (connections, NetCDF introduction, CDI ingestion service and set-up of CDI ingestion pilot) By Dick M.A. Schaap – Technical Coordinator.
Status of advanced access and viewing services following SeaDataNet D5.6 and D8.7 By Dick M.A. Schaap – Technical Coordinator Barcelona – Spain, 19 – 20.
EDMED and EDIOS Roy Lowry, Karen Vickers (Technical) Lesley Rickards, Liz Bradshaw (Content) British Oceanographic Data Centre.
2 nd Training Workshop 4 – 5 June 2007 Common Data Index - CDI By Dick M.A Schaap Technical Coordinator SeaDataNet.
Status of upgrading CDI service (user interface, harvesting via GeoNetwork, CDI interoperability options following SeaDataNet D8.7) By Dick M.A. Schaap.
EMODnet Chemistry 2 2 nd Steering Committee CNR, Piazzale Aldo Moro 7, Roma (Italy), Aula Golgi (2nd floor), January 2014.
EMODnet Chemistry 2 Service Contract MARE/2012/10 S…………… By Dick M.A. Schaap – Technical Coordinator Trieste – Italy, 3 – 5 June 2013, Kick Off Meeting.
Marine Data Management within EMODNet Chemistry project: data aggregation, quality control and products preparation A.S. Iona 1, P. Karagevrekis 1, S.Balopoulou.
WP1: Data collection and metadata compilation in Mediterranean Sea EMODNET Chemistry 2, Kick-off meeting Trieste (Italy), 3-5 June 2013 Sissy Iona, HCMR-HNODC.
EMODnet Chemistry 2 Advanced services Progress by Deltares Service Contract MARE/2012/10 S By Dick M.A. Schaap – Technical Coordinator Istanbul.
EMODnet Chemistry 2: administrative issues, results and scheduling Alessandra Giorgetti, Lipizer Marina, Vinci Matteo, Alessandro Altenburger and Alberto.
SeaDataNet2 Plenary meeting, 19th-20th September 2012, Rhodes SeaDataNet2 Plenary meeting THE EMODNET CHEMISTRY LOT. FROM THE EXPERIENCE OF THE THREE YEARS.
EMODNet Chemistry (MARE/2012/10) 1 st Expert Meeting introduction June 2014 Split, Croatia Matteo Vinci and Alessandra Giorgetti OGS, Trieste.
Emodnet Chemistry 2 Lot First Steering Committee Aula Magna Androna Baciocchi, Trieste university, 5th June 2013.
From Emodnet Chemical Pilot to Emodnet Chemistry 2 Matteo Vinci, Istituto Nazionale di Oceanografia e di Geofisica Sperimentale – OGS – NODC group, Dipartimento.
Design central EMODnet portal Objectives, Technical Proposal and Consultation Process.
Annual Meeting, June , Split, Croatia WP3: QA/QC Validation – MSFD Interactions current status EMODnet Chemistry Partner contribution: ISPRA.
EMODnet Chemistry 2 Service Contract MARE/2012/10 S Progress of the CDI service By Dick M.A. Schaap – Technical Coordinator Istanbul – Turkey,
OceanBrowser viewing service, overview and upgrades Alexander Barth (1), Charles Troupin (2), Aida Alvera Azcárate (1), Jean-Marie Beckers (1) (1) University.
Emodnet Chemistry Lot Guidelines for data products.
From Emodnet Chemical Pilot to Emodnet Chemistry 2 Matteo Vinci and Alessandra Giorgetti, – OGS – NODC group, OCE - MODEG meeting, Copenhagen, 4 and 5.
EMODnet Chemistry 2 Service Contract MARE/2012/10 S Technical developments of the EMODNet Chemistry portal By Dick M.A. Schaap – Technical Coordinator.
Annual Meeting, June , Istanbul, Turkey WP2: Data aggregation and products generation in the Atlantic Sea: results and criticalities EMODnet.
Chemical lot - HOW: Infrastructure set up based on SeaDataNet V1 efficient distributed Marine Data Management Infrastructure; Principle of “ADOPTED AND.
EMODnet Chemistry 2 Service Contract MARE/2012/10 S How to make EMODnet Chemistry fit for purpose at system level By Dick M.A. Schaap – Technical.
EMODnet Chemistry: Next steps in the coming two years Alessandra Giorgetti (OGS, Italy) EMODNet Chemistry – First Expert Workshop, 19 June 2014.
SeaDataNet Harmonizing and optimizing the metadatabases and controlled vocabularies, incl maintenance & retrieval systems.
EMODnet Chemistry 2 6 th Steering Committee ISPRA–Venice Lagoon Service (Italy), 3-4 December 2015.
Actions from previous meeting EMODnet Chemistry Alessandra Giorgetti (OGS, Italy) 3 rd EMODnet-MSFD Coordination Meeting 8-9 December 2015, DG MARE, Brussels.
Marine Strategy 2012, 14th-16th May 2012, Copenhagen Marine Strategy 2012 THE EMODNET CHEMISTRY LOT. AN OVERVIEW ON THE EXPERIENCE OF THE THREE YEARS PILOT.
EMODNet Chemistry (MARE/2012/10). The portal should collect the following groups of chemicals: - in 3 matrices: water column, biota, sediment. - in all.
EMODNET Preparatory Actions Progress meeting for ur-EMODNET preparatory actions, 24 November 2009 Presentation of Progress Chemical Lot Alessandra Giorgetti.
Data Product Catalogue for SeaDataNet and Emodnet Chemistry M. Treguer, T. Loubrieu, IFREMER.
Download Manager software Training Workshop Ostend, Belgium, 20 th May 2014 D.M.A. Schaap - Technical Coordinator.
Metadata V1 By Dick M.A. Schaap – technical coordinator Oostende, June 08.
The SeaDataNet data products regional temperature and salinity historical data collections S. Simoncelli 1, C. Coatanoan 2, O. Bäck 3, H. Sagen 4, S.
Outcomes from EMODnet/MSFD coordination meetings A. Giorgetti, M. Lipizer, M. Vinci EMODnet Chemistry, 3 rd year meeting, June 8-9, 2016 Helsinki, Finland.
EDMODnet Chemistry, Baltic Sea - Oxygen, Chlorophyll and contaminants - General issues Magnus Wenzer, Lotta Fyrberg, Örjan Bäck Swedish Meteorological.
EMODnet Chemistry 2 Service Contract MARE/2012/10 S Progress of the CDI service By Dick M.A. Schaap – Technical Coordinator Helsinki – Finland,
DATA AGGREGATION AND PRODUCTS GENERATION
How to include additional information in ODV and CDI formats
EMODnet Chemistry 3 Upgrading of the portal and its services By
SEXTANT PRODUCTS CATALOGUE
Data aggregation and products generation in the Mediterranean Sea
EMODnet Chemistry WP2: Data aggregation and products generation
Management - coordination
WP3: Data aggregation and products generation NE Atlantic Sea
Flanders Marine Institute (VLIZ)
WP2 Products in Mediterranean Sea
Dick M.A. Schaap – Technical Coordinator SeaDataNet Training Workshop
Design central EMODnet portal Objectives and Technical description Initial draft prepared by the Flanders Marine Institute.
Dick M.A. Schaap – Technical Coordinator
EMODnet Chemistry 3 Management and Coordination
Data aggregation and products generation
Data aggregation and products generation in the Mediterranean Sea
WP4 EMODNet Visualiation techniques using OGC-WPS
Improvements in database of data products and services
EMODNET Preparatory Actions Hydrographic and Seabed Mapping
Further population of metadata and data for contaminants
New Round of Regional data collections Deltares
Data collection and metadata population – harvesting
Upgrading the portal and its services
Updating the existing advanced viewing services
SDN Data access search:
EMODnet Chemistry contribution to data publication
WP4 EMODNet Visualiation techniques
Generation of data products in the Mediterranean Sea
EMODnet Chemistry 3 Reporting
Status on Products Catalogue service
Presentation transcript:

EMODnet Chemistry 2 Technical progress and new challenges Service Contract MARE/2012/10 S By Dick M.A. Schaap – Technical Coordinator Venice, Italy, 3 December 2015, SC meeting

Requests for extending the CDI User Interfaces Outcome of discussions with Regional Sea Conventions Include areas of Regional Sea Conventions as extra search item: Polygons received for HELCOM and OSPAR; how about Barcelona and Bucharst Conventions? Inclusion can be done like MARIS has done earlier for Sea Areas (C19) with geographic analysis and labelling of all CDIs (initially for 1.8 M) and integration in CDI import process Only for the EMODnet Chemistry CDI interfaces Distinct between ‘monitoring’ and ‘research’ data in CDI interface: Complex because of mix at several institutes Not feasible to maintain this centrally unless CDIs are labelled by providers. Option: using EDMERP to describe monitoring activities as existing attribute in CDI model Include medium (water, seabed and biota) as extra search item: BODC has implemented S26 Vocabulary which maps ‘medium’ to ‘P02’ terms => can be integrated by MARIS in interfaces Other wishes?

Advanced services The validated and aggregated buffers of data sets are input for the products and advanced services: Interpolated maps as produced with DIVA software Time series graphics for all collected data sets via WPS (Deltares) OceanBrowser viewer (Ulg) as common service for viewing the DIVA maps and giving access to the time series graphics Sextant catalogue (Ifremer) to document all products with metadata

Spatial distribution and density by GeoServer layers in OceanBrowser Speed of acquiring locations enhanced No WFS anymore, but a combination of WPS/WMS Density information available by colours

Spatial distribution and density Speed of acquiring observations of particular parameter improved Enhanced plotting

OGC services WFS, WPS ODV Metadata enriched ODV files Oceanbrowser Data architecture Step 1 Step 2 Step 3 Step 4

Data model for metadata enriched ODV collections into PostgreSQL/PostGIS database (hosted at CINECA)

Committing ODV data collections to the database Creation of data model Reading QA/QC’d files from regional coordinators Adding vocabularies, EDMO, Local_CDI_ID, So far one version of collection loaded for the nutrients parameters Loading of additional parameters for same CDIs – ODVs will give no problem in present set-up Regional coordinators must make sure that their ODV collections from the new harvests (early November and early December 2015) will only contain additional parameters! Updating of existing parameters needs discussion, also considering version management

Structure of Request What services GetCapabilities Query all observations using cdi Cdi_Get_Parameters Query all observations using bbox Bbox_Get_Parameters Plot a map in binary mimetype Cdi_Plot_Maps Plot a profile in binary mimetype Cdi_Plot_Profiles Plot a timeseries Cdi_Plot_Timeseries Plot a map in binary mimetype bbox_Plot_Maps Plot a profile in binary mimetype bbox_Plot_Profiles Plot a timeseries bbox_Plot_Timeseries Plot a timeprofile Cdi_Plot_Timeprofile Plot a timeprofile bbox_Plot_Timeprofile

Status of data uploads number of CDI’s at 11 June 2015

Status of data uploads number of CDI’s at 26 November 2015

Status of data uploads by number of observation values at 11 June 2015

Status of data uploads by number of observation values at 26 November 2015

Next technical challenges – management of the database Need for input-output management tools with interfaces: Existing is a set of scripts for input => evaluation if these are fully fit for new data sets, corrected data sets, updated data sets and versioning Integrate input scripts into a CMS as workflow manager for non-database experts For managing content by non-database experts it is also required to develop a user interface on the database, including relations with the CDI system MARIS and Deltares will have a meeting early next year to discuss the data model, rules and interface development

New harvesting rounds 11 November 2015: new harvested data sets delivered for each of the 5 regions for other parameters (acidity, chlorophyll, organic matter, oxygen and dissolved gasses) And comparison delivered of new / old / updated files of new harvest against the previous of 28 October 2014 Greater North Sea (ca ); Baltic (ca ); North Atlantic (ca ); Mediterranean (ca ); Black Sea (ca )

New harvesting rounds This week 4 December 2015: n ew harvested data sets will be delivered for each of the 5 regions for contaminants And comparison will be delivered of new / old / updated files of new harvest against the previous of 28 October 2014 Greater North Sea (ca ); Baltic (ca 3.000); North Atlantic (ca 1.000); Mediterranean (ca 5.500); Black Sea (ca )