GTSPP Global Temperature and Salinity Profile Project “A cooperative international program designed to develop and maintain.

Slides:



Advertisements
Similar presentations
Better Data, Better Science! [ Better Science through Better Data Management ] Todd D. OBrien NOAA – NMFS - COPEPOD.
Advertisements

TMSI/IDM/SISMER Sept 2000 SISMER SISMER Systèmes d’Informations Scientifiques pour la Mer F-NODC Quality Control Procedure at IFREMER Argo data management.
Argo a year ago. 500 floats. Regional coverage only.
Argo Real-time Quality Control Process NOAA/AOML: Y.-H. DANESHZADEH, R. MOLINARI, R. SABINA, C. SCHMID CIMAS/UM: E. FORTEZA, X. XIA, H. YANG.
© Crown copyright Met Office The EN dataset Simon Good and Claire Bartholomew.
Argo QC with an emphasis on the North Atlantic Justin Buck British Oceanographic Data Centre Joseph Proudman Building 6 Brownlow Street Liverpool L3 5DA,
Hernan E. Garcia (U.S. NODC, IODE Group of Experts on Biological and Chemical Data Management and Exchange Practices) EDM Workshop 2014, Silver Spring,
1 NODC, Russia GISC & DCPC developers meeting Langen, 29 – 31 March E2EDM technology implementation for WIS GISC development S. Sukhonosov, S. Belov.
National Data Buoy Center Presented to the QARTOD III Workshop November 2, 2005 Wave Data Quality Control Chung-Chu Teng.
QARTOD III Scripps Institution of Oceanography La Jolla, CA Quality Control, Quality Assurance, and Quality Flags Mark Bushnell, NOAA/NOS/CO-OPS November.
AMVER SEAS 2K is a Windows based real–time ship and environmental data acquisition and transmission system. The AMVER software creates a series of reports.
2 nd international Conference for GODAR-WESTPAC JODC, Japan Coast Guard, Tokyo 2004.
11 MEDATLAS 2002: database and data management system for the long term monitoring of Mediterranean and Black seas EC-MAST Concerted Action (MAS3-CT /ERBIC20-CT
1 NATS 101 Lecture 3 Climate and Weather. 2 Review and Missed Items Pressure and Height-Exponential Relationship Temperature Profiles and Atmospheric.
National Oceanic and Atmospheric Administration
First Data Management Training Workshop, February, 2007, Oostende, Belgium 1 Quality control checks description First Data Management Training Workshop.
Quality Control Standards for SeaDataNet Review status at 1 st Annual Meeting (March 2007) Review developments over last year Current status Future work.
IQuOD An International Quality Control Effort Tim Boyer EDM workshop September 10, 2014.
Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research Ocean Data View - Available Data Collections and Data Model.
CLIMAT (CLIMAT TEMP) History: 1935 – IMO (International Meteorological Organization) that mean monthly values of the main climatological elements at certain.
CSIRO Marine Research Commonwealth Scientific and Industrial Research Organisation, Australia.
Quality Control for models/reanalysis James A. Carton Gennady A. Chepurin University of Maryland 2nd IQuOD Workshop June 4, 2014.
Needs for Data and Information Managing living and non-living resources, monitoring environmental changes in the sea and protecting the marine environment,
Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research Ocean Data View.
JCOMM Data Buoy Cooperation Panel October 16, 2006 National Data Buoy Center 2006 Review: A Year of Growth Paul F. Moersdorf, PhD, Director.
Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
John T. Gunn, AVDS Manager Earth & Space Research 1910 Fairview Ave. E., Suite 210 Seattle, WA Ph: ; 1 st Joint GOSUD/SAMOS.
Editing RT QC flag in delayed mode ? Virginie Thierry DMQC 4 Toulouse, 28 septembre 2009.
XBT Fall Rate Workshop AOML, Miami, FL March 10 – 12, Managing XBT Data in the Global Temperature–Salinity Profile Program (GTSPP) Data Base Charles.
Marine Core Service MY OCEAN Potential contribution of Observatories to GMES Marine Core Service, MyOcean Fabrice HERNANDEZ IRD/Mercator Ocean, France.
© Crown copyright Met Office The EN QC system for temperature and salinity profiles Simon Good.
1 Mexico Regional AMDAR Workshop November 2011 Data Quality Monitoring and Control (QM / QC) Axel Hoff Convenor of WMO AMDAR Panel‘s Science and Technical.
Web-based Optimal Interpolation of the Hydrographic data sets from Various Sources for the East Sea Kaplunenko Dmitry*, Ro Young Jae** and Kim Eung** *V.I.
From Ocean Sciences at the Bedford Institute of Oceanography Temperature – Salinity for the Northwest.
Argo workshop in Ghana, December North Atlantic Regional Centre S Pouliquen, V Thierry, C Coatanoan, F Gaillard, PM Poulain & al.
Observing System Monitoring Center (OSMC) Status Update April 2005 Steve Hankin – PMEL (co-PI) Kevin Kern – NDBC (co-PI)
Quality Control for the World Ocean Database GSOP Quality Control Workshop June 12, 2013.
EC-Marine Science & Technology Programme Concerted Action (MAS3-CT /ERBIC20-CT ) MEDAR/MEDATLAS 2002 and future initiatives Mediterranean.
© Crown copyright Met Office The EN4 dataset of quality controlled ocean temperature and salinity profiles and monthly objective analyses Simon Good.
Annual Meeting, June , Istanbul, Turkey WP2: Data aggregation and products generation in the Atlantic Sea: results and criticalities EMODnet.
Silver Spring HRMM Workshop April Global Ocean Surface Underway Data project (GOSUD) Theirry Carval – Coriolis Ifremer Bob Keely – MEDS Thierry.
Developments at the US GDAC ADMT #10 – Toulouse, France 30 September - 2 October 2009 Mark Ignaszewski FNMOC ADMT September – 2 October 2009.
MEDAR 2002 Database and Network The MEDAR Group MEDAR/MEDATLAS II Mediterranean Data Archaeology and Rescue of Temperature, Salinity and Bio-chemical Parameters.
1 NODC Quality Control : Automatic Checks - reveal systematic errors in incoming data and metadata - eliminate most non-representative data from consideration.
An Introduction to the Argo Data Sytem South Pacific Workshop 11 – 14 October 2005 Mark Ignaszewski FNMOC.
The APEX Truncated Negative Pressure Drifts (TNPDs)
Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
10 th Argo data management 2009 Toulouse What is new at GDACs ?
Hernan E. Garcia (U.S. NODC, IODE Group of Experts on Biological and Chemical Data Management and Exchange Practices) 2nd IQuOD Workshop 2014, Silver Spring,
IQuOD Project Proposal To produce and make publically available, the highest-quality standard possible historical subsurface ocean temperature (salinity)
Geneva, April 2007 GTSPP by Bob Keeley (Canada) and Charles Sun (U.S.A)
Distributed Data Servers and Web Interface in the Climate Data Portal Willa H. Zhu Joint Institute for the Study of Ocean and Atmosphere University of.
SCD Research Data for Ocean Observatories Steering Committee June 18, 2001 Steven Worley Scientific Computing Division Data Support Section.
AOML: Acknowledgements: Steve Cook Science support: Molly Baringer and Silvia Garzoli Data support: Gary Soneira, Derrick Snowden and Joaquin Trinanes.
NOAA National Climatic Data Center Dr. Karsten Shein Climatologist NOAA/NESDIS/NCDC 151 Patton Ave. Asheville, NC
GOSUD 5 th meeting Boulder, USA 2-4 May, Status GOSUD Meeting 2-4 May, 2006 Review of progress has been extracted from the Annual Report prepared.
CTD Data Processing Current BIO Procedure. Current Processing Software Matlab Migrating to R & Python Code Version Control SVN Migrating to GitHub.
The SeaDataNet data products regional temperature and salinity historical data collections S. Simoncelli 1, C. Coatanoan 2, O. Bäck 3, H. Sagen 4, S.
Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research Ocean Data View and itsRole in SeaDatanet and its Role in SeaDatanet.
SeaDataNet Technical Task Group meeting JRA1 Standards Development Task 1.2 Common Data Management Protocol (for dissemination to all NODCs and JRA3) Data.
Data Browsing/Mining/Metadata
Data aggregation and products generation in the Mediterranean Sea
Data and Products Service
XBT Data Acquisition System Intercomparison
Argo Delayed-Mode Salinity Data
Creating Marine Data Section Plots in ODV
Ocean Data View Reiner Schlitzer
GODAE Quality Control Pilot Project
Data aggregation and products generation
Ocean Data View Reiner Schlitzer
Presentation transcript:

GTSPP Global Temperature and Salinity Profile Project “A cooperative international program designed to develop and maintain a global ocean T-S resource with data that are as up-to-date and of the highest quality as possible.” “The primary goal of the GTSPP is to make these data quickly and easily accessible to users. ”

GTSPP PARTNERS MEDS: Canada / Marine Environmental Data Service Real-Time data assembly, QC, Duplicate management NODC: NOAA / National Oceanographic Data Center Continuously managed database Delayed mode data QC Data Matching (Real-time / Delayed / Best Copy) Data available as monthly files (Web Database Access soon) AOML: NOAA / Atlantic Oceanographic & Meteorological Laboratory Scientific QC, Atlantic Ocean SIO: Scripps Institution of Oceanography Scientific QC, Pacific Ocean (In the future at IPRC/APDRC) CSIRO: Australia / Commonwealth Scientific, Industrial and Research Organization Scientific QC, Indian Ocean IFREMER: France / Institut français de recherche pour l'exploitation de la mer) TOGA Data QC

GTSPP QC METADATA 1. Quality Flags Position, Date-time, Record (whole record) Surface Parameter, Surface Code (each group) Depth/Pressure, Profile Parameter (each level) 2. History groups Up to 99 per station 3. Surface codes (Automated Tests) MEDS: QCP$, QCF$ NODC: QNP$, QNF$, QTE#, QPS# SIO: QSP$, QSF$

GTSPP QC FLAG FIELDS STATION RECORD QUALITY FLAGS Q_PosStation Position Quality Q_Date_TimeDate-Time Quality Q_RecordWorst Quality flag in the station PARAMETER GROUP (EACH LEVEL) Depres_QDepth/Pressure quality Prof_Q_Parm Data Quality SURFACE GROUP QUALITY FLAGS Q_ParmSurface Parameter Quality SRFC_Q_Parm Surface Code Quality

GTSPP QC FLAG VALUES DATA QUALITY CODES (IGOSS) 0 - no quality control (QC) was performed on this element 1 - QC was performed; element appears to be correct 2 - QC was performed; element appears inconsistent with other elements. 3 - QC was performed; element appears to be doubtful 4 - QC was performed; element appears to be erroneous 5 - the value was changed as a result of QC reserved for future use 9 - the value of this element is missing

GTSPP HISTORY GROUPS FIELDCHAR DEFINITION Ident_Code02Organization that created history PRC_Code04Computer program Version04Version of program PRC_Date08Date of action (YYYYMMDD) Act_Code02Action performed on parameter Act_Parm04Parameter code of changed parameter Aux_ID08Locator (e.g. depth) of parameter Previous_Val10Value of parameter before change 42Total Character Length of History Group

GTSPP QC Act_Codes (1) NODC CFChange a quality flag ED Edit a parameter value FB Flag to the Bottom FR Flag Range QC Quality Control IFREMER DA Delete Top of a profile DB Delete Bottom of a profile DL Delete interval in a profile ED Edit a parameter value QC Quality Control MEDS CF Change a quality flag CV Change value FB Flag to the Bottom FR Flag Range QC Quality Control S4 Whole profile flagged.

GTSPP QC Act_Codes (2) SIO CF Change a quality flag CT Constant temperature FS Fine structure error ML Mixed layer error NG No good trace OE Other error (SIO Code) QC Quality Control SF Surface feature error TG Temp gradient error TI Temp inversion error TO Temp/depth offset UR Under resolved AOML CF Change a quality flag CT Constant temperature FS Fine structure error ML Mixed layer error NG No good trace QC Quality Control SF Surface feature error TG Temp gradient error TI Temp inversion error TO Temp/depth offset UR Under resolved

GTSPP QC Act_Codes (3) CSIRO BB Bad Bottle data BD Bathy data which is rejected CL Contact Lost CS Surface Spike CT Constant temperature DE Depth Error, CSIRO Code DP Duplicate Drop, CSIRO Code DR Driver Error, Sippican MK-9 DU Duplicate Drop, CSIRO Code EF Eddy / Front / Current ER Early Recording error FS Fine structure error, PET fault GL Gradient Long (inversion) GS Gradient Short (spike) HB Hit Bottom HF High Frequency Interference IP Input record history group IV Inversion Confirmed LE Leakage, appears as "jitter" MB MBT data rejected, CSIRO Code MS Meso-scale feature, CSIRO Code NG No good trace NT No Trace NU Inversion Confirmed (nub) PE Position error Corrected PF Pet (PROTECNO) Fault PI Probable Inversion PS Fine Structure (Step-Like) QC Quality Control RE Repeat Drop SA Surface Anomaly SF Surface feature error SP Spike ST Fine Structure (Step-Like) TA Temperature anomaly accepted TD Temperature Difference TE Time error corrected if possible. TG Temperature gradient error TI Temperature inversion error TO Temperature/depth offset TP Test Probe UR Under resolved WB Wire Break WS Wire Stretch

GTSPP SURFACE CODES Surface Codes with Hexadecimal QC Codes: MEDS (IG05 = MEDS profile QC software) QCP$ 41E1FFDF 0 QCF$ NODC (qcPr = NODC GTSPP QC Profiles software) QNP$ e 0 QNF$ NODC (qced = NODC qc editor) QNP$ 0002F9775E 0 QTE# QPS# SIO (SIPP = SIO Editing Post-Processing software) QSP$ F 0 QSF$

GTSPP / SIO TESTS SIO QSF$ QSP$ F 0 Binary digits (L to R) = MTLSQ M = Marginal Seas test (0 = No Marginal Seas) T = Too many depth levels (> 1499) (0 = ok) L = Levitus climatology test of SST (0 = ok) S = is the first level within 50 M of surface (0 = yes) Q = is the profile quality flag for the station as received less than 3 (0 = yes)

GTSPP / QC TESTS (1) AUTOMATED TESTS AT MEDS AND NODC Stage 1: Location and Identification Tests 1.1Platform Identification 1.2Impossible Date/Time 1.3Impossible Position 1.4Position on Land 1.5Impossible Speed 1.6Impossible Sounding

GTSPP / QC TESTS (2) Stage 2: Profile Tests 2.1 Global Impossible Parameter Values 2.2 Regional Impossible Parameter Values 2.3 Increasing Depth 2.4 Global Profile Envelope 2.5 Constant Profile 2.6 Freezing Point 2.7 Spike 2.8 Top and Bottom Spike 2.9 Gradient 2.10 Density Inversion 2.11 Bottom 2.12 Temperature Inversion

GTSPP / QC TESTS (3) Stage 3: Climatology Tests 3.1 Levitus Seasonal Statistics 3.2 Emery and Dewar Climatology 3.3 Asheville Climatology 3.4 Levitus Monthly Climatology 3.5 Levitus Annual Climatology Stage 4: Profile Consistency Tests 4.1 Waterfall Stage 5: Visual Inspection 5.1 Cruise Track 5.2 Profiles

QCED MAIN WINDOW

QCED CRUISE TRACK

QCED WATERFALL

QCED PROFILE

QCED TIME/POSITION EDIT

KATRINA