EGO – COST - Groom-gliders Kiel meeting Kiel, June 2014 Data-management activity n Within Groom and with COST support, the glider data- management group.

Slides:



Advertisements
Similar presentations
Groom-gliders data-management workshop Brest, December 2012 Groom gliders data management n In 2012 : vertical profiles from 26 platforms.
Advertisements

National facility concerned with looking after and distributing marine data Part of NOC National Marine Facilities Serve science, education and industry,
Groom-gliders Trieste data-management meeting Trieste, June 2013 T&S real-time QC n 1. Platform identification : valid wmo ID n 2. Impossible date test.
EGO Glider School October 2007 Calanova, Mallorca, Spain Welcome! Org. IMEDEA.
An OPeNDAP server for CORIOLIS data centre Context and functions Architecture and technical description Planned improvements T. Loubrieu, A. Forest (IFREMER)
FP7-Infra : Design studies for European Research Infrastrutures 1st October 2011 – 31st December 2014 Duration 39 months – Periods : 2 (month.
FP7-Infra : Design studies for European Research Infrastrutures 1st October 2011 – 31st December 2014 Duration 39 months – Periods : 2 (month.
Wilhelm PetersenI HZGI 2013, June 18/19th I UPMC I Paris JERICO MID TERM REVIEW WP 3 Harmonizing technological.
U.S. IOOS ® National Glider Network Zdenka Willis Director, US IOOS Program Office Presented to the GROOM General Assembly – 5 June
Pierre Jaccard1 MyOcean Quality Control for Ferryboxes MyOcean Tutorial, NERSC, Bergen.
Bio-optical Gliders and Profiling floats in the Mediterranean ARGO SCIENCE WORKSHOP – MARCH 13 – 18, 2006 Fabrizio D’Ortenzio 1, Katarzyna Niewiadomska.
Kick-Off Seadatanet – Heraklion – 7-11 June Atlantic and global products C. Coatanoan, F. Gaillard, E. Autret, T. Loubrieu.
10th Argo data management 2009 Toulouse User’s manual comment Here is a list of comments received on User’s manual version 2.2 since August 28 th. Jean-Philippe.
Ocean glider data management: Argo concepts, GROOM, OGC sensor observation services Justin Buck + many collaborators British.
Work Package 2 / 3 TECHNOLOGICAL & PROCEDURAL HARMONISATION FixO3 General Assembly 14 th to the 16 th October 2014, Heraklion-CRETE ESTOC, PLOCAN,
FP7-Infra : Design studies for European Research Infrastrutures 1st October 2011 – 30th september 2014 Duration 36 months – Periods : 2 (month.
NRT data stream from the gliders Slocum and Spray to Coriolis EGO meeting Paris 2-3/10/06.
John T. Gunn, AVDS Manager Earth & Space Research 1910 Fairview Ave. E., Suite 210 Seattle, WA Ph: ; 1 st Joint GOSUD/SAMOS.
JCOMM in situ Observing Platform Support Centre JCOMMOPS
Glider data (*.*bd files) via Iridium or rsync from WHOI, Umaine or UMaryland Disk NetCDF/Acquire WMO ID IOOS Glider DAC ERDDAP OPeNDAP sequence or download.geoJson,.json.nc,.ncCF,.ncCFMA.csv,.tsv,
SAMOS-GOSUD Meeting. Boulder 2-4 May Potential collaboration between the Coriolis project and the Samos initiative L. Petit de la Villéon. Ifremer-France-
ODINBLACKSEA Meeting, Ostende October BULGARIAN ACADEMY OF SCIENCES INSTITUTE OF OCEANOLOGY BGODC 2010 BULGARIAN NATIONAL OCEANOGRAPHIC DATA.
Final General Assembly – Paris, France – September 19, 2014 FP7-Infra : Design studies for European Research Infrastrutures 1st October 2011.
MyOcean2 First Annual Meeting – April 2013 WP 15 THEMATIC & ASSEMBLY CENTRE for In Situ MyOcean2 First Annual Meeting – Cork /16-17 April 2013.
GROOM Annual meeting Data Management issues Trieste 4-5 June 2013 Quoi de Neuf à Coriolis en 2008 ? GMMC Octobre 2008 S Pouliquen & Coriolis team.
Topics describe the Data Buoy Cooperation Panel (DBCP) –aims, –achievements and –Challenges network status developments of data buoy technology JCOMM.
International Argo structure Argo TC M. Belbeoch Accra, Ghana.
Marine Data Representation systems T. Loubrieu, G. Maudire, S. Pouliquen, T. Carval, IFREMER, E. Charpentier, WMO Scott D. Woodruff, NOAA.
Argo workshop in Ghana, December Argo data status & data access.
EuroGOOS Annual Meeting 2009/10/ /10/08 2b: Contribution of open ocean observatories to GEO Data Core – Biodiversity, Ecosystems and Health Richard.
Argo & New Telecom. Systems Technical Workshop Introduction and Summary. ADMT#11 October 2010, Hamburg/Germany.
IOOS National Glider Data Assembly Center
Silver Spring HRMM Workshop April Global Ocean Surface Underway Data project (GOSUD) Theirry Carval – Coriolis Ifremer Bob Keely – MEDS Thierry.
© Crown copyright Met Office Wind Profilers: Transitioning to Operations in Europe (Operational Acceptance) Tim Oakley Met Office, Exeter, UK.
Welcome to SeaDataNet Technical Task Team Meeting + a few basic questions that the co-ordinator expects to get a preliminary answer before the Kick-Off.
An Introduction to the Argo Data Sytem South Pacific Workshop 11 – 14 October 2005 Mark Ignaszewski FNMOC.
The APEX Truncated Negative Pressure Drifts (TNPDs)
10 th Argo data management 2009 Toulouse What is new at GDACs ?
Global Collecting Centres ETMC-5 Activities of the GCCs Geneva 2015 Activities of the GCCs ETMC-5 22 nd – 25 th June 2015, Geneva, Switzerland.
XBT FALL RATE EQUATION WORKSHOP National Oceanic and Atmospheric Administration Atlantic Oceanographic and Meteorological Laboratory, Miami, FL March 10-12,
Geneva, April 2007 GTSPP by Bob Keeley (Canada) and Charles Sun (U.S.A)
Short-term scientific Missions (STSM) STSM manager: Agnieszka Beszczynska-Moeller (Poland)
1 The Argo project 21st Century in-situ Ocean Observing System M. Belbeoch, Argo Technical Coordinator with inputs from D. Roemmich, Argo Steering Team.
EMODNet Physics + My Ocean – SeaDataNet Dick Schaap (MARIS) – Brussels – 1 March 2013.
GOSUD 5 th meeting Boulder, USA 2-4 May, Status GOSUD Meeting 2-4 May, 2006 Review of progress has been extracted from the Annual Report prepared.
CTD Data Processing Current BIO Procedure. Current Processing Software Matlab Migrating to R & Python Code Version Control SVN Migrating to GitHub.
Sensor Web Enablement (SWE) developments for fixed monitoring platforms and research vessels By Dick M.A. Schaap – SeaDataNet Technical Coordinator with.
SeaDataNet Technical Task Group meeting JRA1 Standards Development Task 1.2 Common Data Management Protocol (for dissemination to all NODCs and JRA3) Data.
IOOS National Glider Data Assembly Center
WP5.1 Ground Segment Description with contributions from all partners
Argo & Google Ocean.
Jon Turton (JCOMM OCG Vice-Chair)
IOOS National Glider Data Assembly Center
JCOMM in-situ Observations Programme Support Centre www. jcommops
ATom data management plan:
Data processing of current estimates
FP7-Infra : Design studies for European Research Infrastrutures
Argo Delayed-Mode Salinity Data
Metadata files updates
Outline RTQC goals to achieve Description of current proposal Tests
How to handle multiple vertical references
Dick M.A. Schaap – Technical Coordinator SeaDataNet Training Workshop
JCOMM in-situ Observations Programme Support Centre www. jcommops
International Argo Data Management Team
Coding issues BUFR Binary Universal code Form for the Representation of meteorological data Binary Table driven code form (BUFR, CREX) Efficient compression.
JCOMM in-situ Observations Programme Support Centre www. jcommops
Education and Training Statistics Working Group – 2-3 June 2016
EMODNet Physics + My Ocean – SeaDataNet
Generation of data products in the Norwegian and Barents Seas
Argo Information Centre & Argo Users
Presentation transcript:

EGO – COST - Groom-gliders Kiel meeting Kiel, June 2014 Data-management activity n Within Groom and with COST support, the glider data- management group is building a system for gliders to : –provide a single access point to European gliders data & metadata –improve data coherency and documentation in term of format, quality, processing chain –build a capability to serve both operational (within a few hours) and research (best quality after calibration and validation) users n This system is developed in coherency –with other glider systems developments (IMOS in Australia, IOOS in USA) –with other JCOMM networks (Argo, OceanSITES, …) –with IODE standards (SeaDataNet/EU, QUARTOD/USA, GOSUD, GTSPP…).

EGO – COST - Groom-gliders Kiel meeting Kiel, June 2014 Data management activity n In 2013, more than vertical profiles from 41 gliders were distributed to operational models

EGO – COST - Groom-gliders Kiel meeting Kiel, June 2014 Data flow n The real-time and delayed mode data flow system was agreed in October 2012 in Paris

EGO – COST - Groom-gliders Kiel meeting Kiel, June 2014 Data flow n The list of DAC/Glider Operators/PIs is summarized in the following table CountryDACGlider OperatorDelayed Mode PI UKBODCUEA, SAMS, NOC CEFAS, BAS UEA, SAMS, NOC, CEFAS, BAS FranceCORIOLIS LOCEAN, LOV, MIO, LEGOS, LPO, DT-INSU LOCEAN, LOV,MIO, LEGOS, LPO Italy CMRE OGS/CORIOLISOGS Germany HZG CORIOLISGEOMAR,AWI SPAIN CORIOLISPLOCAN SOCIBSOCIB, CSIC NorwayUiB/IMRUiB CyprusOC-UCY GreeceCORIOLISHCMRTo Be Defined FinlandTo Be Defined IrelandBODC?MI PolandCORIOLISIOPAS

EGO – COST - Groom-gliders Kiel meeting Kiel, June 2014 Data format n The Glider data and metadata NetCDF format is now defined and described in the user‘s manual V1.1 This is a common data exchange format – networks/EGO-gliders/EGO-Glider-data-management/A-NetCDF- implementation-for-glider-observationshttp:// networks/EGO-gliders/EGO-Glider-data-management/A-NetCDF- implementation-for-glider-observations n The matlab real-time processing chain to provide quality controlled metadata, time-series and vertical profiles is available for Slocum and Seaglider platforms

EGO – COST - Groom-gliders Kiel meeting Kiel, June 2014 Data processing for a glider deployment

EGO – COST - Groom-gliders Kiel meeting Kiel, June 2014 Data processing for a glider deployment n The deployment configuration and metadata are stored in a simple JSON file : an ASCII list of items, human and computer readable n Examples: ftp://ftp.ifremer.fr/ifremer/glider/v2ftp://ftp.ifremer.fr/ifremer/glider/v2

EGO – COST - Groom-gliders Kiel meeting Kiel, June 2014 Data processing n The collaborative development of the matlab data processing is shared between BODC, CMRE and Ifremer –Version 1 delivered to GROOM in Spring 2014 on the SVN repository –Issues are tracked on Mantis n The procedure to distribute Glider data on GTS in TESAC format is documented –BODC and Coriolis distribute glider data on GTS –BODC is working with WMO partners on a BUFR template for gliders and Argo floats. n Coriolis distributes glider data to MyOcean EU project

EGO – COST - Groom-gliders Kiel meeting Kiel, June 2014 Deployment recommendations n For Slocum recommendation to keep the history of the mission changes was proposed by GEOMAR and agreed by partners. –The list of variables(sbdlist) that needs to be transmitted and their sampling periods. The sbdlist also advises on some technical parameters to be sent back to shore (navigation, battery info…). For the science sensor (TBDLIST) the recommendation for CTD recommend at list one measurement every 60s n Geomar also prepared recommendations on pressure correction on Slocum when the two pressure sensors (one for navigation and one for the CTD ) disagree for identified reason detailed in the papers.

EGO – COST - Groom-gliders Kiel meeting Kiel, June 2014 Quality control n Recommendation for automatic real time QC for Temperature/Salinity/Oxygen/Chlorophyll have been discussed and the documentation will be available before summer This work is shared with EU Argo E-AIMS project. n For Delayed mode, QC working group have been set up per parameters. The activity started and will have to continue after the end of the GROOM project as the issues are complex.

EGO – COST - Groom-gliders Kiel meeting Kiel, June 2014 Current derived from Glider navigation n The calculation of current derived from glider navigation is described in the document : « Recommendations for processing depth-averaged currents estimated from underwater gliders”, Lucas Merckelbach and Bartolome Garau n It is not yet implemented in the GROOM matlab code

EGO – COST - Groom-gliders Kiel meeting Kiel, June 2014 Conclusion n The glider data and metadata user’s manual is available – networks/EGO-gliders/EGO-Glider-data-management/A-NetCDF- implementation-for-glider-observationshttp:// networks/EGO-gliders/EGO-Glider-data-management/A-NetCDF- implementation-for-glider-observations n The matlab data processing is ready for use –Example : deployed-in-Norwegian-sea-a-first-implementation-of-EGO-data- processinghttp:// deployed-in-Norwegian-sea-a-first-implementation-of-EGO-data- processing n The real-time QC code is developed but still tested n The delayed mode QC for oxygen and chlorophyll should be very close to Argo floats delayed mode –Argo delayed mode QC for oxygen is available and applicable to gliders –Delayed mode QC for chlorophyll : the first step of chlorophyll A concentration processing is now documented for Argo floats