Tools for generation of SDN NetCDF (CFPOINT) files

Slides:



Advertisements
Similar presentations
OBSERVATIONS & PRÉVISIONS CÔTIÈRES 3 rd SeaDataNet training course – Ostende – June 2008 Tools for data management in the frame.
Advertisements

OBSERVATIONS & PRÉVISIONS CÔTIÈRES Training Workshop – Ostende – October 2009 REFORMATTING TOOLS Med2MedSDN and NEMO M. Fichaut.
ECOOP Data Management System (T2.2/WP2) Declan Dunne 13 th February 2008, Athens.
Online data access in the SeaDataNet V1 system by Dick M.A. Schaap – technical coordinator Bologna, September 08.
Online data access in the SeaDataNet V1 system by Dick M.A. Schaap – technical coordinator Oostende, June 08.
OBSERVATIONS & PRÉVISIONS CÔTIÈRES 3 rd SeaDataNet training course – Ostende – June 2008 MIKADO tool M. Fichaut, V. Tosello, M.
Groom-gliders data-management workshop Brest, December 2012 Groom gliders data management n In 2012 : vertical profiles from 26 platforms.
Cruise Summary Report Content Management SDN2 1. Training Workshop - Ostend, Belgium.
Training course – Ostende – 2-6 July 2012 Training Workshop – Ostende – 1-4 March 2010 Practical work on NEMO Converting files M. Fichaut.
Status of CDI service (connections, NetCDF introduction, CDI ingestion service and set-up of CDI ingestion pilot) By Dick M.A. Schaap – Technical Coordinator.
MEDATLAS 2002.
Pan-European infrastructure for Ocean & Marine Data management An EU Integrated research Infrastructure Initiative (I3) MIKADO : Java tool for XML Creation.
SDN2 First Training Course, Oostende IODE-PO, 2-6 July 2012 Metadata Directories Management Sissy Iona, HCMR/HNODC.
Status of advanced access and viewing services following SeaDataNet D5.6 and D8.7 By Dick M.A. Schaap – Technical Coordinator Barcelona – Spain, 19 – 20.
2 nd Training Workshop 4 – 5 June 2007 Common Data Index - CDI By Dick M.A Schaap Technical Coordinator SeaDataNet.
Status of upgrading CDI service (user interface, harvesting via GeoNetwork, CDI interoperability options following SeaDataNet D8.7) By Dick M.A. Schaap.
EMODNET Chemistry 2 Steering Group Rome (Italy), January 2014 WP 1 : DATA COLLECTION AND METADATA COMPILATION IN ATLANTIC SEA.
OBSERVATIONS & PRÉVISIONS CÔTIÈRES 3 rd SeaDataNet training course – Ostende – June 2008 NEMO reformatting tool v1 M. Fichaut.
7 th TTG meeting – Trieste – 3-4 March, 2015 SeaDataNet tools, new developments IFREMER : M. Fichaut, A. Briand, M. Larour, T. Loubrieu, V. Tosello ALTRAN.
Training course – Ostende – 2-6 July 2012 Introduction to the 1 st training session of SeaDataNet 2 M. Fichaut, IFREMER, France.
SeaDataNet2 Plenary meeting, 19th-20th September 2012, Rhodes SeaDataNet2 Plenary meeting THE EMODNET CHEMISTRY LOT. FROM THE EXPERIENCE OF THE THREE YEARS.
Distributed system development, including standards and interoperability By Dick M.A. Schaap – technical coordinator Bologna, September 08.
SeaDataNet A Pan-European Infrastructure for Ocean and Marine Data Management: Achievements and challenges.
Synthesis of the technical activity and State of development of the on-line system V1 By Dick M.A. Schaap – technical coordinator Madrid, March 09.
NERC DataGrid Vocabulary Server Access Vocabulary Workshop, RAL, February 25, 2009.
Common Data Index CDI V1 How to proceed By Dick M.A. Schaap – technical coordinator Madrid, March 09.
TTG, March 2014, Barcelona WP3: Capacity building and training.
OBSERVATIONS & PRÉVISIONS CÔTIÈRES SeaDataNet annual meeting, Madrid, March 2009 How to prepare data for integration in SeaDataNet.
OBSERVATIONS & PRÉVISIONS CÔTIÈRES Synthesis of the data management activities (NA) S. Iona (HCMR), R. Lowry (BODC), F. Nast (BSH),
Chemical lot - HOW: Infrastructure set up based on SeaDataNet V1 efficient distributed Marine Data Management Infrastructure; Principle of “ADOPTED AND.
SeaDataNet Harmonizing and optimizing the metadatabases and controlled vocabularies, incl maintenance & retrieval systems.
Marine Strategy 2012, 14th-16th May 2012, Copenhagen Marine Strategy 2012 THE EMODNET CHEMISTRY LOT. AN OVERVIEW ON THE EXPERIENCE OF THE THREE YEARS PILOT.
EMODNET Preparatory Actions Progress meeting for ur-EMODNET preparatory actions, 24 November 2009 Presentation of Progress Chemical Lot Alessandra Giorgetti.
Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research ODV – New Developments.
Training course 2, Ostende, May 2014 IFREMER work-flow for production of CDIs data Michèle Fichaut, IFREMER, SISMER M. Fichaut, IFREMER.
Download Manager software Training Workshop Ostend, Belgium, 20 th May 2014 D.M.A. Schaap - Technical Coordinator.
Pan-European infrastructure for Ocean & Marine Data management An EU Integrated research Infrastructure Initiative (I3) How to implement CDI ? M. Fichaut,
2 nd training course – Ostende – May, 2014 What’s new in NEMO 1.5?
Metadata generation, control and updating Peter Thijsse - MARIS.
3rd Training Workshop June 2008, Ostende Management of CSR Anne Che-Bohnenstengel, BSH  Metadata Formats  Defined Vocabularies  Content Management.
Data management dedicated for assessing and modeling of the Mediterranean and Black Seas ecosystem changes (SESAME integrated project). Isaac Gertman,
Metadata V1 By Dick M.A. Schaap – technical coordinator Oostende, June 08.
The SeaDataNet data products regional temperature and salinity historical data collections S. Simoncelli 1, C. Coatanoan 2, O. Bäck 3, H. Sagen 4, S.
Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research Ocean Data View Achievements and Future Developments.
Validation of Metadata XML files SeaDataNet Training, June 2008 Presented by with contributions from Karen Vickers (BODC) Presented by Michèle Fichaut.
CDI Data Discovery and Access Service Dick Schaap (MARIS) – SeaDataNet Technical Coordinator RDA – Paris - Sept 2015.
MIKADO – Generation of ISO – SeaDataNet metadata files
SeaDataNet tools NEMO, OCTOPUS, MIKADO
Introduction to the 1st training session of SeaDataNet 2
NEMO – Reformating tool
GML in CDI and CSR ISO using Ends&Bends
Practical work on NEMO Converting files
SeaDataNet tools NEMO, MIKADO, VALIDATOR
Using Ocean Data View for EMODnet Chemistry Reiner Schlitzer
OCTOPUS – SeaDataNet Format conversion tool
Service Section Technical Training Dec 2005.
Status of ODV developments
ISRAMAR Work Flow for SeaDataNet
Dick M.A. Schaap – Technical Coordinator SeaDataNet Training Workshop
MIKADO: Generation of CDI ISO19139 XML files
Vanessa Tosello (IFREMER), Flavian Gheorghe (MARIS)
Hovedside.
Ocean Data View Reiner Schlitzer
Dynamic visualization of odv files via WPS
Data aggregation and products generation
Practical work on NetCDF - CFPOINT
Ocean Data View Spreadsheet Format Reiner Schlitzer
Ocean Data View Reiner Schlitzer
New Round of Regional data collections Deltares
Updating the existing advanced viewing services
Presentation transcript:

Tools for generation of SDN NetCDF (CFPOINT) files M. Fichaut, IFREMER Michèle Fichaut, IFREMER, SISMER

New format definition implies Upgrading of the existing tools NEMO Download manager Development of new tools Format converters OdvSDN2CFPOINT MedSDN2CFPOINT

Upgrading of NEMO software NEW SeaDataNet Vocabulary NVS 2.0 Collection of ASCII files SeaDataNet files CDI summary CSV file Coupling table Export ODV MEDATLAS NETCDF Above sea level data IMPROVED NEW Format version IMPROVED

Upgrading of NEMO software NEW Upgrading of NEMO software since v1.5.0 released in July 2013 Current version: v1.5.3

NEMO for NetCDF Same principles than for ODV and MEDATLAS input ASCII file(s) Description in NEMO Output as NetCDF file mono-station or multi-stations

NetCDF format mono or multi-station NEW NetCDF format mono or multi-station for vertical profiles, time- series and trajectories Nouveau Radio bouton pour NetCDF mono ou multistations

NetCDF cruise metadata NEW NetCDF cruise metadata Nouvelle cruise description pour NetCDF, moins de metadonnées que pour MEDATLAS, pour ODV écran inexsistant

SDN NetCDF format Cruise information Reference Name Ship Mandatory NEW CSR ISO-19139 available Cruise information Reference Name Ship Mandatory

NEW SDN NetCDF format Cruise information Location is a C19 vocabulary

NetCDF special features for data description Not Mandatory but recommended P07 vocab Mandatory Free text NEW NetCDF special features for data description

Upgrading of DM software Download manager v1.4.4 Still under test Next release planned on 26 May 2014 Able to Generate NetCDF on the fly from data in database Reformat SDN ODV or SDN MEDATLAS files to SDN NetCDF files on the fly Split multi-station SDN NetCDF files into mono-station SDN NetCDF file

Possible conversions with DM 1.4.4 Input format: Format at which files are stored in the data centre Output format: Format at which the DM delivers the data mono: 1 LOCAL_CDI_ID multi: n LOCAL_CDI_IDs Input format Modus Output format (always mono) Name Type CFPOINT mono 1 multi 3 MEDATLAS ODV Database -- 2 Input format Modus Output format (always mono) Name Type CFPOINT mono 1 multi 3 MEDATLAS ODV Database -- 2

To deliver your files under several formats It is mandatory to have all possible formats in the CDI metadata: var37 and var38 of MIKADO possible values: Var 37 : Format name Var 38: Format version CFPOINT 1.0 MEDATLAS 2.0 ODV 0.4

Then formats are available for downloading

New tools for format conversion (1) OdvSDN2CFPOINT v1.0.3 Converts files at SDN ODV format  to files at SDN NetCDF format 1, n ODV mono-station  1,n NetCDF mono-station 1 to n ODV multi-station  1,n NetCDF mono-station 1 to n ODV multi-station  1,n NetCDF multi-station Java tool, needs Java > 1.6

New tools for format conversion (2) MedSDN2CFPOINT v1.0.4 Converts files at SDN MEDATLAS format  to files at SDN NetCDF format 1, n MEDATLAS mono-station  1,n NetCDF mono-station 1 to n MEDATLAS multi-station  1,n NetCDF mono-station 1 to n MEDATLAS multi-station  1,n NetCDF multi-station Java tool, needs Java > 1.6

Same user interface for the 2 tools

Option menu

Option - Settings

Option – Vocabulary update

Main screen : input and output directories Input : ODV Output: NetCDF Choose output mono or multi station files While converting, generation of a coupling file is possible

Running the conversion Input files counter

Running the conversion Conversion ends with success

Running the conversion Conversion ends with errors

See the log file : look up for ERROR ERROR 30: SDN parameter object PSSTZZ01 not found in BODC list

PSSTZZ01 has been deprecated It is recommended to use TEMPPR01 in stead of PSSTZZ01