Argo QC with an emphasis on the North Atlantic Justin Buck British Oceanographic Data Centre Joseph Proudman Building 6 Brownlow Street Liverpool L3 5DA,

Slides:



Advertisements
Similar presentations
Use of VOS data in Climate Products Elizabeth Kent and Scott Woodruff National Oceanography Centre, Southampton NOAA Earth System Research Laboratory.
Advertisements

Configuration management
Configuration management
Groom-gliders data-management workshop Brest, December 2012 Groom gliders data management n In 2012 : vertical profiles from 26 platforms.
Groom-gliders Trieste data-management meeting Trieste, June 2013 T&S real-time QC n 1. Platform identification : valid wmo ID n 2. Impossible date test.
Pierre Jaccard1 MyOcean Quality Control for Ferryboxes MyOcean Tutorial, NERSC, Bergen.
Argo Project Status Report B. Owens, D. Roemmich, S. Riser, G. Johnson, S. Garzol Ocean Climate Observation Annual System Review Silver Spring October.
Kick-Off Seadatanet – Heraklion – 7-11 June Atlantic and global products C. Coatanoan, F. Gaillard, E. Autret, T. Loubrieu.
Argo a year ago. 500 floats. Regional coverage only.
Argo Real-time Quality Control Process NOAA/AOML: Y.-H. DANESHZADEH, R. MOLINARI, R. SABINA, C. SCHMID CIMAS/UM: E. FORTEZA, X. XIA, H. YANG.
Hernan E. Garcia (U.S. NODC, IODE Group of Experts on Biological and Chemical Data Management and Exchange Practices) EDM Workshop 2014, Silver Spring,
QARTOD III Scripps Institution of Oceanography La Jolla, CA Quality Control, Quality Assurance, and Quality Flags Mark Bushnell, NOAA/NOS/CO-OPS November.
Operational Quality Control in Helsinki Testbed Mesoscale Atmospheric Network Workshop University of Helsinki, 13 February 2007 Hannu Lahtela & Heikki.
2 nd international Conference for GODAR-WESTPAC JODC, Japan Coast Guard, Tokyo 2004.
Ostende GLOSS Course 2006 GLOSS (and MedGLOSS, GCOS etc.) Philip L. Woodworth Permanent Service for Mean Sea Level.
First Data Management Training Workshop, February, 2007, Oostende, Belgium 1 Quality control checks description First Data Management Training Workshop.
Quality Control Standards for SeaDataNet Review status at 1 st Annual Meeting (March 2007) Review developments over last year Current status Future work.
Argo September 2004 The status of the Argo project What is Argo trying to do How is it doing it? What have we achieved so far? What has happened since.
Submitting data to (and getting data from!) BODC Adam Leadbetter British Oceanographic Data Centre Joseph Proudman Building 6 Brownlow Street Liverpool.
Argo & AIC Development Argo TC DBCP #22 La Jolla, California.
JCOMM Observation Programmes Support Centre – Argo Information Centre January 2015 Argo Status Argo TC, M. Belbeoch.
Editing RT QC flag in delayed mode ? Virginie Thierry DMQC 4 Toulouse, 28 septembre 2009.
Zenghong Liu & Jianping Xu State Key Lab of Satellite Ocean Environment Dynamics The Second Institute of Oceanography, SOA GOVST-V , Beijing.
Inter-comparison and Validation Task Team Breakout discussion.
SAMOS-GOSUD Meeting. Boulder 2-4 May Potential collaboration between the Coriolis project and the Samos initiative L. Petit de la Villéon. Ifremer-France-
Data Buoy Cooperation Panel Hester Viola
© Crown copyright Met Office The EN QC system for temperature and salinity profiles Simon Good.
Data Quality Control and Quality Monitoring Jitze van der Meulen,  WMO AMDAR PANEL.
EGO – COST - Groom-gliders Kiel meeting Kiel, June 2014 Data-management activity n Within Groom and with COST support, the glider data- management group.
Argo Status 3000 floats in November 2007 ! Commitments for 2008&2009 seem ok Global array issues QC and delayed mode processing Pressure errors New products.
1 Mexico Regional AMDAR Workshop November 2011 Data Quality Monitoring and Control (QM / QC) Axel Hoff Convenor of WMO AMDAR Panel‘s Science and Technical.
Page 1© Crown copyright Report of the Global Collecting Centres Elanor Gowland, GCC UK SOT-IV, 16 th - 21 st April 2007.
GROOM Annual meeting Data Management issues Trieste 4-5 June 2013 Quoi de Neuf à Coriolis en 2008 ? GMMC Octobre 2008 S Pouliquen & Coriolis team.
Topics describe the Data Buoy Cooperation Panel (DBCP) –aims, –achievements and –Challenges network status developments of data buoy technology JCOMM.
International Argo structure Argo TC M. Belbeoch Accra, Ghana.
Argo workshop in Ghana, December North Atlantic Regional Centre S Pouliquen, V Thierry, C Coatanoan, F Gaillard, PM Poulain & al.
Argo workshop in Ghana, December Argo data status & data access.
Quality Control for the World Ocean Database GSOP Quality Control Workshop June 12, 2013.
© Crown copyright Met Office The EN4 dataset of quality controlled ocean temperature and salinity profiles and monthly objective analyses Simon Good.
Silver Spring HRMM Workshop April Global Ocean Surface Underway Data project (GOSUD) Theirry Carval – Coriolis Ifremer Bob Keely – MEDS Thierry.
Towards Optics-Based Measurements in Ocean Observatories - The Argo program E. Boss (H. Claustre, K. Johnson) What is Argo? Optical measurements on profiling.
Developments at the US GDAC ADMT #10 – Toulouse, France 30 September - 2 October 2009 Mark Ignaszewski FNMOC ADMT September – 2 October 2009.
An Introduction to the Argo Data Sytem South Pacific Workshop 11 – 14 October 2005 Mark Ignaszewski FNMOC.
The APEX Truncated Negative Pressure Drifts (TNPDs)
The Argo Project: An International Partnership Dean Roemmich, International Argo Steering Team The role of partnerships in: Creating Argo Coordination.
10 th Argo data management 2009 Toulouse What is new at GDACs ?
Global Collecting Centres ETMC-5 Activities of the GCCs Geneva 2015 Activities of the GCCs ETMC-5 22 nd – 25 th June 2015, Geneva, Switzerland.
Hernan E. Garcia (U.S. NODC, IODE Group of Experts on Biological and Chemical Data Management and Exchange Practices) 2nd IQuOD Workshop 2014, Silver Spring,
JCOMM Observation Programmes Support Centre – Argo Information Centre September 2015 Argo Status Argo TC, M. Belbeoch.
Summary of issues and conclusions from DMQC-4 1.Pressure Issues, especially Surface pressure offset, Druck microleak, APEXs that truncate negative pressures.
PreSAC Progress on NEMOVAR. Overview of NEMOVAR status First NEMOVAR experiments Use of NEMOVAR analyses to initialize ocean only forecasts Missing.
Geneva, April 2007 GTSPP by Bob Keeley (Canada) and Charles Sun (U.S.A)
1 The Argo project 21st Century in-situ Ocean Observing System M. Belbeoch, Argo Technical Coordinator with inputs from D. Roemmich, Argo Steering Team.
Surface pressure PROVOR/ARVOR floats Coriolis DAC V. Thierry DMQC 4 – Toulouse – September 2009.
Argo Programme – activities in Japan – Keisuke Mizuno (JAMSTEC) Argo is a global array of 3,000 free-drifting profiling floats that measure temperature.
Andrea Kaiser-Weiss, Melbourne Joint GHRSST Workshop, 6 th March 2012 Experiences with SST profiles from near-surface Argo measurements A. Kaiser-Weiss.
Update on the GHRSST Users Manual GDS2.0 rev04.4 Book Captains: Chris Jeffery 1 and Jorge Vazquez Content Brief overview of the GHRSST project Background.
GOSUD 5 th meeting Boulder, USA 2-4 May, Status GOSUD Meeting 2-4 May, 2006 Review of progress has been extracted from the Annual Report prepared.
CTD Data Processing Current BIO Procedure. Current Processing Software Matlab Migrating to R & Python Code Version Control SVN Migrating to GitHub.
SeaDataNet Technical Task Group meeting JRA1 Standards Development Task 1.2 Common Data Management Protocol (for dissemination to all NODCs and JRA3) Data.
TAIYO KOBAYASHI and Shinya Minato
Argo & Google Ocean.
On the use of the CRC for decoding Argo data
M. Belbéoch, 8 June 2018 Global Argo Status M. Belbéoch,
Status on anomalies detected with altimetry
Enhanced File Consistency Checking
Argo Delayed-Mode Salinity Data
Outline RTQC goals to achieve Description of current proposal Tests
International Argo Data Management Team
Present Status of APEX Float Technology
Presentation transcript:

Argo QC with an emphasis on the North Atlantic Justin Buck British Oceanographic Data Centre Joseph Proudman Building 6 Brownlow Street Liverpool L3 5DA, UK

Outline QC of Argo data Overview of processing steps Real-time QC Near- real-time QC Delayed mode QC Global consistency checks (GDAC level) Status of the QC of Argo in the North Atlantic (NA) Status of profiles in the North Atlantic Feed back from the NA Argo Regional Centre Other points Sources of information on Argo QC

Argo processing stages Flow chart describing the real time data flow through BODC Delayed mode processing fits in the visual screening loop

Real-time QC Automated process, all data put through these tests before real-time versions of data submitted to GTS and GDACs Tests agreed internationally by the Argo Data Management Team (ADMT) Summarised in the Argo QC manual ( documentation/Argo-Quality-Control-manual-October-2009 pages 5-16 ) documentation/Argo-Quality-Control-manual-October-2009 pages 5-16 A new ‘jump test’ to be implemented by BODC in coming year with results going to ADMT in 2010 and potential for implementation by all countries Process also applies calibrations where appropriate (e.g. real time pressure correction)

Argo QC flags FlagDescription 0No QC was performed 1Good data 2Probably good data 3Bad data that are potentially correctable 4Bad data 5Value changed (not applicable to calibration changes where flag should be 1-4) 8Interpolated value 9Missing value A full description on the usage of Argo QC flags is in the Argo QC manual.

Real-time QC OrderTest no.DescriptionOrderTest no.Description 119Deepest pressure test 1110Top and Bottom Spike Test : removed 21Platform identification 1211Gradient Test 32Impossible date1312Digit Rollover Test 43Impossible location 1413Stuck Value Test 54Position on land1514Density Inversion 65Impossible speed1615Grey List 76Global range1716Gross salinity or temperature sensor drift 87Regional range18 Frozen profile 98Pressure increasing 1917Visual QC (near- real-time) 109Spike test

Near-real-time Profiles from UK floats are screened in near-real-time by BODC, this practice does vary by data centre though.

Delayed-mode QC (DMQC) Target date is within 6-12 moths of a profile being acquired Should include a re-screen of the profiles Uses a more refined pressure correction to profiles than is applied in real time Methods well defined and documented in the Argo QC manual However, some centres (including BODC) have a long standing backlog in their DMQC

Owens Wong (OW) DMQC software Used for the DMQC of salinity, and assumes the temperature good Quoted accuracy in salinity after data has passed through OW can be as good as 0.01 (psu, non-dimensional)

Global consistency checks SSH from altimetry Vs DHA derived from Argo profiles ftp://ftp.ifremer.fr/ifremer/argo/etc/argo-ast9-item13-AltimeterComparison/figures

Global consistency checks Float inter-comparison run by Ifremer Uses ARIVO climatology and OW software

North Atlantic Argo status North Atlantic 20S-80N, 75W-15E, time span 2004-date, holdings at USGODAE GDAC as of 26-Nov-2009 Total number of Argo profiles Total number of delayed mode profiles BODC has not started DMQC of its NA floats yet because of time/funding constraints Pressure issues See ADMT10 and DMQC3 workshop meeting reports ( and-reports) and-reports Several types of pressure issue Drifts (~5-10 dBar) Truncated negative pressures (i.e. Unknown drifts) Druck micro-leak failures Aim is for all data centres to have these resolved before the Argo Science team meeting in early 2010

North Atlantic Argo status Table showing number of delayed mode profiles by year (source US GODAE Argo GDAC as of 26-Nov-2009) YearTotal number of profiles Number of delayed mode profiles % profiles through DMQC % % % % % 2009* % * The reason the percentage is lower in 2009 is profiles are not officially eligible for DMQC until 6 months after collection

NA Argo Regional Centre (ARC) Run by Coriolis, France (Contacts are Sylvie Pouliquen/Virginie Thierry) NA ARC activities that are particularly relevant to this discussion are: Ensure consistency of the Argo data from the North Atlantic, independent of float provider, using statistical tools to detect potential outliers and provide feedback to DACs and PIs Product delivery: The main product of the RDAC will be a consistent Argo delayed mode dataset for the North Atlantic. However some scientific products such as temperature and salinity weekly analysis, improved mean sea state of the ocean for Argo period, currents calculated from floats,.... will be made available though NA-ARC with clear documentation.

NA Argo Regional Centre (ARC) Sylvie Pouliquen’s comments on Argo QC in the North Atlantic are as follows: ARCs are not yet doing all the consistency checks that we would like to be performed: APEX pressure correction are not applied yet by all groups neither in Real time nor in delayed mode but all teams are working on it and ADMT10 recommendation will be implemented in the coming months. SOLO problem is partially corrected by WHOI but WHOI is working on delayed mode processing Consistency checks are applied at Coriolis are done on real-time data but there is work to be done on delayed mode data

Sources of information Argo Data Management Team (ADMT) Includes: QC Documentation Status statistics from produced by the French GDAC North Atlantic Argo Regional Centre Atlantic-ARChttp:// Atlantic-ARC

The PRES_ERROR field question The issue of what to set the PRES_ERROR field to was discussed at length during ADMT10. This was with respect to floats where the pressure has drifted considerably. The accuracy of the sensor is 2.4 dBar (typically used as the error in floats without issues), but as a community we would like to highlight this float has drifted significantly. What as part of the user community would you like/expect the PRES_ERROR field to be set to in such cases?