Summary of QARTOD and Recent Workshops on QA/QC March 9-10, 2006

QA and QC Quality Assurance (QA) steps that you take beforehand (sensors calibration, maintenance intervals, robust data communication)‏ Quality Assurance (QA) steps that you take beforehand (sensors calibration, maintenance intervals, robust data communication)‏ Quality Assessment steps you take to characterize error and uncertainty (define calibration drifts, error stats or s/n ratios)‏ Quality Assessment steps you take to characterize error and uncertainty (define calibration drifts, error stats or s/n ratios)‏ Quality Control (QC) steps you take after assessment to support the delivery of high quality data (format checksum, timely arrival, threshold checks, nearest neighbor, climatology, and model checks, generation of data flags, verification of user satisfaction)‏ Quality Control (QC) steps you take after assessment to support the delivery of high quality data (format checksum, timely arrival, threshold checks, nearest neighbor, climatology, and model checks, generation of data flags, verification of user satisfaction)‏

QARTOD Workshops QARTOD I – December 2003 –General QA/QC flags be defined –Specific test used for QA/QC be defined –Pros and cons of existing standards discussed QARTOD II – February/March 2005 –Discipline specific metadata needs identified –Waves, in-situ currents, remote currents

Q-III Intended Goals Fast and accurate assessment of the quality of the data streaming from the IOOS partner system Fast and accurate assessment of the quality of the data streaming from the IOOS partner system Operational data aggregation and assembly from distributed data source Operational data aggregation and assembly from distributed data source Trustworthy and consistent quality descriptions for every observation distributed Trustworthy and consistent quality descriptions for every observation distributed Develop quality descriptions for parameters such as waves, currents, wind, sea surface temperature and salinity. Develop quality descriptions for parameters such as waves, currents, wind, sea surface temperature and salinity.

Actually Accomplished Build upon work done at QARTOD-II for waves, in situ currents, remote currents and add CTDs and Chlorophyll work groups Build upon work done at QARTOD-II for waves, in situ currents, remote currents and add CTDs and Chlorophyll work groups Identify/refine specific tests Identify/refine specific tests Identify specific QC details that need to be captured as part of the metadata in each breakout group Identify specific QC details that need to be captured as part of the metadata in each breakout group

Breakout Groups Waves Waves In-situ currents (ADCP)‏ In-situ currents (ADCP)‏ CTDs CTDs Remote currents (HF Radar)‏ Remote currents (HF Radar)‏ (Chlorophyll)‏ (Chlorophyll)‏

In-situ Currents (ADCP) Group Created and refined lists of parameters, metadata, and checks (pass, caution, fail) that are required and then recommended. Created and refined lists of parameters, metadata, and checks (pass, caution, fail) that are required and then recommended. SEACOOS data dictionary and SEACOOS ontology on MMI used extensively in metadata controlled vocabulary that was generated in this breakout. SEACOOS data dictionary and SEACOOS ontology on MMI used extensively in metadata controlled vocabulary that was generated in this breakout.

Required and Recommended parameters (ADCP)‏ Level 1 Red (required)‏ Pitch/Roll/Heading UVW (Vertical velocity/ Horizontal Velocity)‏ Echo Amplitude/Intensity Echo Amplitude/Intensity Correlation Magnitude Correlation Magnitude

Required and Recommended parameters (ADCP)‏ Level 2 Yellow (recommended)‏ Bit status (Built In Test) - diagnostics Battery voltage (V1 & V2) two batteries Water temperature Pressure Timestamp Std deviation of speeds Transmit current - amount of current transmitted per ping, related to battery voltage Correlation coefficient - derived parameter from correlation magnitude, across beams Speed of sound (derived)‏ signal to noise level Surface (or bottom) reflection/ detection Percent solutions - number of beams used Percent good pings (PGP)‏ Error velocity - four beam disagreement indicator check sum

CTD Group Built on Salinity Workshop and early QARTOD where temperature was addressed. Built on Salinity Workshop and early QARTOD where temperature was addressed. Methods of collection (profiling from ship, moored, profiling floats, fixed platforms, gliders, expendables)‏ Methods of collection (profiling from ship, moored, profiling floats, fixed platforms, gliders, expendables)‏ Directly measured (cond, temp, press)‏ Directly measured (cond, temp, press)‏ Derived parameters (salinity, depth, density)‏ Derived parameters (salinity, depth, density)‏ Other potential parameters other sensors that can be on CTDs (dissolved oxygen, optical sensors, position). Other potential parameters other sensors that can be on CTDs (dissolved oxygen, optical sensors, position). No brainer test (range, climatology, gradient, spiking routines, comparison)‏ No brainer test (range, climatology, gradient, spiking routines, comparison)‏ Other tests Other tests Required and recommended tests for each measured parameter Required and recommended tests for each measured parameter Definitions (climatology, range tests, gradient tests, nearest neighbor, etc)‏ Definitions (climatology, range tests, gradient tests, nearest neighbor, etc)‏ Next Steps (need follow up meeting, identify other participants for follow up, review and cross reference salinity workshop report)‏ Next Steps (need follow up meeting, identify other participants for follow up, review and cross reference salinity workshop report)‏

Remote Currents (HF Radar) Group HFR Holy Grail is to help verify and test ocean circulation model nowcasts and forecasts HFR Holy Grail is to help verify and test ocean circulation model nowcasts and forecasts If no QA/QC, congress will pull funding for IOOS HF Radar If no QA/QC, congress will pull funding for IOOS HF Radar Level 1 Errors: Influence radial velocity (spectral freq, SNR, Geophysical contribution, eg spatial variability)‏ Level 1 Errors: Influence radial velocity (spectral freq, SNR, Geophysical contribution, eg spatial variability)‏ Level 2 Errors: Influence total velocity (geometry of site, number and variability of radials w/in total velocity)‏ Level 2 Errors: Influence total velocity (geometry of site, number and variability of radials w/in total velocity)‏ Goal is to have standard algo’s for NOAA operations. Goal is to have standard algo’s for NOAA operations. Interactive session and informal talks on fundamental sources of uncertainty Interactive session and informal talks on fundamental sources of uncertainty Need more error analyses Need more error analyses Need documentation from vender for error estimate and SNR. Collaborate with vendors. Need documentation from vender for error estimate and SNR. Collaborate with vendors. Next steps: specific QC tests and metadata still need to be hashed out. Next steps: specific QC tests and metadata still need to be hashed out.

QARTOD web site

Future of QARTOD Do we need QARTOD-IV? Do we need QARTOD-IV? –Address quality assurance practices –Sharing libraries/cookbooks of tests and procedures (develop community algorithm library)‏ –How to disseminate metadata (SOAP/ XML used in salinity exercise)‏ –Relationship of QARTOD with Ocean.US DMAC WHOI might be able to host Q-IV in either May or September, 2006 WHOI might be able to host Q-IV in either May or September, 2006

Salinity Data Best Practices Workshop Concept grew directly out of QARTOD II Concept grew directly out of QARTOD II Focused specifically on one IOOS core variable Focused specifically on one IOOS core variable Data quality, metadata, and transport Data quality, metadata, and transport Small group with dissemination to wider audience for feedback Small group with dissemination to wider audience for feedback Process as important as the immediate results Process as important as the immediate results Should be a “portable” process for others to implement Should be a “portable” process for others to implement

Salinity Data Management Best Practices Workshop Goals Implement a process to create “best practices” for managing in-situ real-time and near-real-time salinity data Implement a process to create “best practices” for managing in-situ real-time and near-real-time salinity data Capture the best practices in a written document and submit to Ocean.US/DMAC with the intent of having them adopted for use and improvement by the IOOS community Capture the best practices in a written document and submit to Ocean.US/DMAC with the intent of having them adopted for use and improvement by the IOOS community Document the “process” for these workshops and share freely so that other groups might address other IOOS core variables Document the “process” for these workshops and share freely so that other groups might address other IOOS core variables

Salinity Data Best Practices Workshop Results Data quality discussion produced required and recommended criteria tests and agreement on flags Data quality discussion produced required and recommended criteria tests and agreement on flags Metadata discussion produced required and recommended elements list Metadata discussion produced required and recommended elements list Transport discussions produced agreement to develop a “light” SOAP XML schema (working group in progress on this task)‏ Transport discussions produced agreement to develop a “light” SOAP XML schema (working group in progress on this task)‏ Workshop report URL: Workshop report URL:

Salinity Data Best Practices Workshop URL