Argo Real-time Quality Control Process NOAA/AOML: Y.-H. DANESHZADEH, R. MOLINARI, R. SABINA, C. SCHMID CIMAS/UM: E. FORTEZA, X. XIA, H. YANG.

Slides:



Advertisements
Similar presentations
Better Data, Better Science! [ Better Science through Better Data Management ] Todd D. OBrien NOAA – NMFS - COPEPOD.
Advertisements

Groom-gliders data-management workshop Brest, December 2012 Groom gliders data management n In 2012 : vertical profiles from 26 platforms.
Groom-gliders Trieste data-management meeting Trieste, June 2013 T&S real-time QC n 1. Platform identification : valid wmo ID n 2. Impossible date test.
DOI assignment within the ARGO international project Fred Merceur, Ifremer DataCite Annual Conference in Nancy, France, August 2014.
Pierre Jaccard1 MyOcean Quality Control for Ferryboxes MyOcean Tutorial, NERSC, Bergen.
Argo Project Status Report B. Owens, D. Roemmich, S. Riser, G. Johnson, S. Garzol Ocean Climate Observation Annual System Review Silver Spring October.
TMSI/IDM/SISMER Sept 2000 SISMER SISMER Systèmes d’Informations Scientifiques pour la Mer F-NODC Quality Control Procedure at IFREMER Argo data management.
Kick-Off Seadatanet – Heraklion – 7-11 June Atlantic and global products C. Coatanoan, F. Gaillard, E. Autret, T. Loubrieu.
Argo a year ago. 500 floats. Regional coverage only.
© Crown copyright Met Office The EN dataset Simon Good and Claire Bartholomew.
Argo QC with an emphasis on the North Atlantic Justin Buck British Oceanographic Data Centre Joseph Proudman Building 6 Brownlow Street Liverpool L3 5DA,
National Data Buoy Center Presented to the QARTOD III Workshop November 2, 2005 Wave Data Quality Control Chung-Chu Teng.
Argo Products at the Asia-Pacific Data-Research Center Konstantin Lebedev, Sharon DeCarlo, Peter Hacker, Nikolai Maximenko, James Potemra, Yingshuo Shen.
1 Surface Circulation Pathways Generally, warm currents move poleward and cool currents move equatorward.
QARTOD III Scripps Institution of Oceanography La Jolla, CA Quality Control, Quality Assurance, and Quality Flags Mark Bushnell, NOAA/NOS/CO-OPS November.
Generalized Surface Circulation
JEFS Status Report Department of Atmospheric Sciences University of Washington Cliff Mass, Jeff Baars, David Carey JEFS Workshop, August
2 nd international Conference for GODAR-WESTPAC JODC, Japan Coast Guard, Tokyo 2004.
10th Argo data management 2009 Toulouse User’s manual comment Here is a list of comments received on User’s manual version 2.2 since August 28 th. Jean-Philippe.
First Data Management Training Workshop, February, 2007, Oostende, Belgium 1 Quality control checks description First Data Management Training Workshop.
Quality Control Standards for SeaDataNet Review status at 1 st Annual Meeting (March 2007) Review developments over last year Current status Future work.
IQuOD An International Quality Control Effort Tim Boyer EDM workshop September 10, 2014.
Work Package 2 / 3 TECHNOLOGIAL & PROCEDURAL HARMONISATION FixO3 General Assembly 14 th to the 16 th October 2014, Heraklion-CRETE Maureen Pagnani, BODC/NOC,
SOCAT Surface Ocean CO 2 ATlas Are Olsen 1, Benjamin Pfeil 1, Dorothee Bakker 2, Maria Hood 3, Nicolas Metzl 4, Christopher Sabine 5, Alex Kozyr 6
Activities of the South Atlantic Argo Regional Center (SA ARC) Silvia Garzoli, Bob Molinari, Claudia Schmid (NOAA/AOML), Huiqin Yang (CIMAS/UM)
Global Interannual Upper Ocean Heat Content Variability Gregory C. Johnson (NOAA/PMEL), John M. Lyman (UH/JIMA & NOAA/PMEL), Josh K. Willis (NASA/JPL),
The role of gliders in sustained observations of the ocean Deliverable 4.1 or WP 4.
Editing RT QC flag in delayed mode ? Virginie Thierry DMQC 4 Toulouse, 28 septembre 2009.
Zenghong Liu & Jianping Xu State Key Lab of Satellite Ocean Environment Dynamics The Second Institute of Oceanography, SOA GOVST-V , Beijing.
D rifter D ata A ssembly C enter DBCP-17 Perth, Australia October 2001 Quality Control Procedures Applied to Drifter Data by Mayra Pazos.
Calibration and Validation Studies for Aquarius Salinity Retrieval PI: Shannon Brown Co-Is: Shailen Desai and Anthony Scodary Jet Propulsion Laboratory,
© Crown copyright Met Office The EN QC system for temperature and salinity profiles Simon Good.
From Ocean Sciences at the Bedford Institute of Oceanography Temperature – Salinity for the Northwest.
Topics describe the Data Buoy Cooperation Panel (DBCP) –aims, –achievements and –Challenges network status developments of data buoy technology JCOMM.
Argo workshop in Ghana, December North Atlantic Regional Centre S Pouliquen, V Thierry, C Coatanoan, F Gaillard, PM Poulain & al.
Argo workshop in Ghana, December Argo data status & data access.
Quality Control for the World Ocean Database GSOP Quality Control Workshop June 12, 2013.
IOOS National Glider Data Assembly Center
The “Ambrose” (New York Bight) Jet: Climatology and Simulations of Coastally Enhanced Winds Brian A. Colle School of Marine and Atmospheric Sciences, Stony.
© Crown copyright Met Office The EN4 dataset of quality controlled ocean temperature and salinity profiles and monthly objective analyses Simon Good.
Silver Spring HRMM Workshop April Global Ocean Surface Underway Data project (GOSUD) Theirry Carval – Coriolis Ifremer Bob Keely – MEDS Thierry.
Towards Optics-Based Measurements in Ocean Observatories - The Argo program E. Boss (H. Claustre, K. Johnson) What is Argo? Optical measurements on profiling.
1 NODC Quality Control : Automatic Checks - reveal systematic errors in incoming data and metadata - eliminate most non-representative data from consideration.
An Introduction to the Argo Data Sytem South Pacific Workshop 11 – 14 October 2005 Mark Ignaszewski FNMOC.
Density Structure Surface Processes Temperature Salinity Pressure.
The APEX Truncated Negative Pressure Drifts (TNPDs)
Class 8. Oceans Figure: Ocean Depth (mean = 3.7 km)
10 th Argo data management 2009 Toulouse What is new at GDACs ?
Summary of QARTOD and Recent Workshops on QA/QC March 9-10, 2006.
Summary of issues and conclusions from DMQC-4 1.Pressure Issues, especially Surface pressure offset, Druck microleak, APEXs that truncate negative pressures.
Water Properties Surface Tension Viscosity Changes in State.
Application of HYCOM in Eddy- Resolving Global Ocean Prediction Community Effort: Community Effort: NRL, Florida State, U. of Miami, GISS, NOAA/NCEP, NOAA/AOML,
N ational C limatic D ata C enter Development of the Global Historical Climatology Network Sea Level Pressure Data Set (Version 2) David Wuertz, Physical.
Argo Programme – activities in Japan – Keisuke Mizuno (JAMSTEC) Argo is a global array of 3,000 free-drifting profiling floats that measure temperature.
CTD Data Processing Current BIO Procedure. Current Processing Software Matlab Migrating to R & Python Code Version Control SVN Migrating to GitHub.
The SeaDataNet data products regional temperature and salinity historical data collections S. Simoncelli 1, C. Coatanoan 2, O. Bäck 3, H. Sagen 4, S.
Validation strategy MARCDAT-III meeting - Frascati, Italy - May 2011 The validation phase to compare all the algorithms together and to select the best.
RTOFS Monitoring and Evaluation Metrics Avichal Mehra MMAB/EMC/NCEP/NWS.
Seasonal mean Arctic Ocean climatology calculated from the archived data (ADAM: Arctic ocean Data Archive for Model validation & data assimilation) beta-version.
SeaDataNet Technical Task Group meeting JRA1 Standards Development Task 1.2 Common Data Management Protocol (for dissemination to all NODCs and JRA3) Data.
On the use of the CRC for decoding Argo data
M. Belbéoch, 8 June 2018 Global Argo Status M. Belbéoch,
Status on anomalies detected with altimetry
Argo Delayed-Mode Salinity Data
Outline RTQC goals to achieve Description of current proposal Tests
Marine Meteorology Quality Control at the Florida State University
TRAINING OF FOCAL POINTS on the CountrySTAT SYSTEM based on FENIX
Heat Transport by the Atmosphere and ocean
International Argo Data Management Team
Data aggregation and products generation
Presentation transcript:

Argo Real-time Quality Control Process NOAA/AOML: Y.-H. DANESHZADEH, R. MOLINARI, R. SABINA, C. SCHMID CIMAS/UM: E. FORTEZA, X. XIA, H. YANG

Guiding Philosophy of the international real-time DACs PROVIDE TO THE INTERNATIONAL OPERATIONAL AND RESEARCH OCEANIC COMMUNITIES PROFILES OF TEMPERATURE AND SALINITY RESULTING FROM ARGO FLOATS THAT MEET THE FOLLOWING CRITERIA:  DATA HAVE BEEN MANAGED IN A UNIFORM MANNER  DATA ARE FREE  DATA ARE READILY ACCESSIBLE  DATA ARE AVAILABLE WITHIN A TIMELY MANNER  DATA HAVE BEEN QUALITY CONTROLLED TO REMOVE THE MOST EGREGIOUS ERRORS  COST OF REAL TIME QUALITY CONTROL IS REASONABLE

Number of profiles quality controlled per year

Positions of the floats that have delivered data within the last 30 days Atlantic Data Coverage

How an Argo float works

Data flow

Real-time processing system

Delayed-mode processing system

Automatic quality control 1.Platform Identification 2.Impossible Date (valid & not before 1997) 3.Impossible Location (-180 to 180, -90 to 90) 4.Position on Land (ETOPO5) 5.Impossible Speed (<=3m/s) 6.Global Range (-2.5 to 40C, 0 to 41 psu) 7.Regional Range (Red Sea, Mediterranean Sea) 8.Pressure Increasing 9.Spike (| V2 - (V3 + V1)/2 | - | (V3 - V1) / 2 ) Documents are at

Regional Range tests, definitions Red Sea  Temperature in range 21.7 to 40.0 o C  Salinity in range 0.0 to 41.0 Mediterranean Sea  Temperature in range 10.0 to 40 o C  Salinity in range 0.0 to 40.0

temperature Spike test examples Multiple-value spikes can be a problem. level temperature salinity

Automatic quality control 10.Top and Bottom Spike (no top spike test, bottom spike test currently under development) 11.Gradient (| V2 - (V3 + V1)/2 |) 12.Digit Rollover test (part of decoders) 13.Stuck Value (e.g. all values of T the same) 14.Density Inversion (gradient must be >=0) 15.Grey List (decided by PI & Operator) 16.Gross Salinity or Temperature Sensor Drift Test (checks if values in the deep ocean change too much, dT >1 o C, dS >0.5 psu) Documents are at

Bottom spike examples Currently no test is available to detect this problem.

Gradient test examples If spikes are not excluded prior to application, then the test may flag some good points as bad. salinity level

Density inversion test examples Flags wrong point because of three bad values around a good one. Current version: top to bottom.

Density inversion test examples One flag at wrong point because of three bad values around a good one. New version: top to bottom and bottom to top.

Automatic quality control 17.Visual QC: at AOML currently triggered by failure of any of the other tests on the profile data (except for grey list test). Additionally triggered by climatology/reanalysis test. 18.Frozen profile (>=5 almost identical consecutive profiles). 19.Deepest pressure test: pressure may not exceed nominal profile pressure given in the meta file by more than 10%. Documents are at

Visual quality control Two cases of bad profiles that can not be detected by the standard Argo QC tests. For these a climatology test that triggers a visual QC can be very helpful. level temperature salinity

Blue circles indicate that T (top) or S (bottom) failed the test. Results of frozen profile test Profile number pressure

Quality control statistics

US Argo DAC web page at AOML