Why do we lose analyzer data? Monitor malfunction DAS malfunction Power outages Environmental problems Wildlife damage Vandalism Operator error.

Slides:



Advertisements
Similar presentations
EPA Methods 3A, 6C, 7E, 10 & 20 Corrections to May 15, 2006 Final Rule That Updated the Methods That Updated the Methods Foston Curtis US EPA.
Advertisements

Harmonization of Parts 60 and 75
Workshop: Maintenance Work Requests May 3, Project Goals  Implement SAP Plant Maintenance system Provide integration with Finance, HR, and Materials.
1 Licensing in the Energy Sector Georgian National Energy And Water Supply Regulation Commission Nugzar Beridze June 27 – July 3, 2008.
Louisiana Department of EnvironmentalQuality LDEQ CAM Plan Overview LDEQ’s 27 th Annual Conference on the Environment Cajundome Convention Center Lafayette,
SRPMIC Ozone Monitoring Sites Senior Center SiteHigh School Site Red Mountain Site Lehi Site.
LSA Plan Sequence Check Report Instructions Table of Contents Plan Sequence Rules1 Reviewing Current Plan Sequences2 Examples of Correct Plan Sequences3.
THE ADVANCED TECHNOLOGY ENVIRONMENTAL AND ENERGY CENTER (ATEEC) Summative External Evaluation July 1, 2013 – June 30, 2014 PRELIMINARY OUTLINE.
How Ozone is Regulated under the Clean Air Act Darcy J. Anderson AZ Dept. of Environmental Quality.
1 Guest Speaker: Bill Frietsche US EPA.  April 7: QA Systems, EPA definitions, PQAOs and common sense – Mike Papp  April 14: Routine Quality Control.
Presented by: Mike Hamdan South Coast Air Quality Management District Diamond Bar, CA Presented at: The Tribal Air Monitoring Training, Pechanga Reservation,
North American Emission Control Area
© Copyright, Yorke Engineering, LLC 2008 SCAQMD Rule Compliance Steps and Strategies Judy Yorke and Bipul K. Saraf Yorke Engineering, LLC
What to compare against the validation templates (see templates in course webpage: Resources/Validation%20Templates%20from%20Red.
Verification Visit by the Office of Special Education Programs (OSEP) September 27-29, 2010.
EPA Update- Bob Judge Maine Air Quality Monitoring Committee April 18, ) NAAQS schedule 2) Budget 3) Technical Systems Audit.
Institute for Tribal Environmental Professionals Tribal Air Monitoring Support Center Melinda Ronca-Battista Brenda Sakizzie Jarrell Southern Ute Indian.
Quality Assurance/ Quality Control
1 Dec. 8, 1997 LEADS Quality Assurance Summary Robert Brewer (512) Monitoring Operations Division Network QA Manager.
Press the F5 key to continue Project Manager is a web based Project Management Tool. All your work is done and information stored on the internet cloud.
1 Guest Speaker: Brandy Toft Leech Lake Ojibwe.  Overview of FRM/FEM/ARM status, requirements, and reporting  QC (routine checks, audits, and method-
Copyright © 2013, ESC | Environmental Systems Corporation Understanding ProcessNow Mark Astudillo Director of Training.
| Philadelphia | Atlanta | Houston | Washington DC Boiler MACT Compliance Plans: Failure to Develop Plans Is Planning to Fail Susie Bowden|
PA Department of Environmental Protection Continuous Source Monitoring Manual (Manual, Revision 8)
1 Saxony-Anhalt EU Twinning RO 04/IB/EN/09 State Environmental Protection Agency Wolfgang GarcheWorkshop European Standards Requirements of.
Quality Control/ Quality Assurance Annabelle Allison ITEP/TAMS Center.
Quality Control Lecture 5
Quality Control – Part II Tim Hanley EPA Office of Air Quality Planning and Standards.
System Analysis and Design
Appendix A: Calculations for Data Quality Assessment QC check statistics Precision calcs Bias calcs PM stats Reporting: quarterly and annual.
CARB Continuous PM 2.5 Monitoring Activity (BAM’s) Reggie Smith California Air Resources Board.
Exceptional Events Meredith Kurpius US EPA Region 9.
1 Dec. 11, 1997 LEADS Quality Control Systems Robert Brewer (512) Monitoring Operations Division Network QA Manager.
Hardware Analyser vs Software Analyser
CE 366 PROJECT MANAGEMENT AND ECONOMICS Robert G. Batson, Ph.D., P.E. Professor of Construction Engineering The University of Alabama
Virtual Analyser What is it Have you ever faced an analyser failure that requires a plant shut down to repair & wished that there.
REMEDIATION OF CONTAMINATED LAND IN SOUTH AFRICA Part 8 of the Waste Act Ms Mishelle Govender Chemicals and Waste Management.
WSNTG Annual Conference September 2007 Water Services National Training Group 11 th Annual Conference 6 th September 2007.
LEADS/EMS DATA VALIDATION IPS MeteoStar December 11, 2006 WHAT IS VALIDATION? From The Dictionary: 1a. To Make Legally Valid 1b. To Grant Official.
1 Software Testing Strategies: Approaches, Issues, Testing Tools.
Method 203 Quality Assurance/Quality Control Requirements for Continuous Opacity Monitoring Systems (COMS)
Measurement Quality Objectives = Data Validation Requirements Excerpted from EPA QA Handbook Volume II (aka “Redbook”)
WHAT IS THE CHEROKEE NATION? Cherokee Nation Air Quality Data Management Concepts for Quality Data Collection Ryan Callison.
Module 11 Module I: Terminology— Data Quality Indicators (DQIs) Melinda Ronca-Battista ITEP Catherine Brown U.S. EPA.
Tool Removed During Cycle Fault #2 Conditions for Setting Tool cocked prox switch goes open during cycle AND force on load cell drops below 5 lbs. Active.
ENVIRONMENTAL PROGRAMS Copyright © 2007 Exceptional Events and Data Collection in the Vicinity of the West 43 rd Avenue Monitor MAG Regional Council April.
Update on CASTNET Modernization Air Monitoring Steering Committee Meeting May 4, 2006 Larry Kertcher Office of Atmospheric Programs (OAP)
Table 1. The Five Medical Laboratory Case Studies Jan Martin et al. Transnational Evaluation of a New Continuing Professional Development Activity for.
OSHA A GUIDE TO THE NEGATIVE EXPOSURE ASSESSMENT.
 Software reliability is the probability that software will work properly in a specified environment and for a given amount of time. Using the following.
1 Ambient Monitoring Program PM 2.5 Data Lean 6 Sigma Air Director’s Meeting May 2015.
QC - THE OUT-OF-CONTROL PROBLEM 謝 昆 穎 Assistant Product Manager, CDG BIO-RAD Laboratories, Taiwan Branch.
BACK TO BASICS Quality Assurance and Validation Gaseous NAAQS Pollutants (O3, NO2, SO2, CO) By Kendall Perkins May 17, 2006.
Annual Air Monitoring Data Certification and Concurrence Process 1.
USAID’s Data Quality Standards & Conducting a DQA # ? % ?
Field Equipment Calibration PH, Temperature, Conductivity, Turbidity, Dissolved Oxygen, Free & Total Chlorine Gregory Langland CCSF.
Statewide Compliance Monitoring and Local Monitoring Projects
Quality Assurance.
EMSA 22 Lab Module 1 Field Equipment Calibration
Archiving and Document Transfer Utilities
Instrument Maintenance
Calibration Calibration of the analyzer establishes the relationship between actual pollutant concentration input and the analyzer response. Should be.
“all you ever asked us for, and more”
Topics in Microbiology Quality Assurance Project Plan Essentials
Back To Basics: PM2.5 NESCAUM MAC Meeting Newport, RI May 16-17, 2006
Proposed Ozone Monitoring Revisions Ozone Season and Methods
Discipline Incidents Collection
QA/QC Gaseous Pollutants mini-course TAMS Center February 2009.
A New Tool for Evaluating Candidate PM FEM and PM2.5 ARM Monitors
Precision, Bias, and Total Error (Accuracy)
Presentation transcript:

Why do we lose analyzer data? Monitor malfunction DAS malfunction Power outages Environmental problems Wildlife damage Vandalism Operator error

Why do we lose samples? Sampler malfunction Power outages Storms Wildlife damage Vandalism Site access restrictions Operator error

The majority of data loss – be it continuous data or field samples – is due to reasons beyond the control of the site operator!

Invalidating Data The site operator is the one most intimately involved with the operation of the monitors & samplers. The QA Section relies on the site operator to do the majority of the data invalidation! The site operator indicates what data needs to be voided on various reports and charts. QA does the actual coding of the data based on the site operator’s documentation. QA voids data that gets past the site operator or if it is a judgment call beyond the purview of the site operator.

The QA Section makes decisions on data validity based on the criteria established in CFR and EPA Guidance. PM 2.5 Critical Criteria Table

Example of monthly preliminary report submitted by site operator. The site operator invalidated 3 hours of data due to biweekly precision checks and an audit.

303 hours of data were actually invalid due to shelter temperature exceedances (highlighted blue). Data recovery = 58% Example of the same data report after it was marked by QA.

Example of monthly prelim documented for analyzer drift (negative readings). The site operator also documented troubleshooting and recalibrations with Technical Support assistance. Initial Data Recovery = 92.6%

However, 129 additional hours of data were lost due to analyzer malfunction & poor precision results. The negative readings were corrected during the QA process. Final Data Recovery =79%

The site operator flagged data as suspicious, but asked QA to make the final judgment call. For this example, the site operator had to replace the analyzer twice during the month, as well as the zero air supply. Initial Data Recovery = 89.5%

The site operator did a great job troubleshooting, conducting maintenance, and calibrating during the month. The site operator was correct to flag the data. Because of the equipment malfunctions, there were no precision checks or nightly zero/spans during the time period the site operator flagged as suspicious. Validating data was difficult. Final Data Recovery = 64%

Site operator documented lost data due to operator error. Prelim indicates 88.4% data recovery.

The same report after being audited by QA. Data Recovery = 94% The “lost” data was recovered during the QA process.

So when would the flagging or voiding of data be due to“operator error”?

Calibration (SO 2 or O 3 )

The site operator documented this chart as a calibration.

The results of this biweekly: Precision = 17.5% d. This failed biweekly occurred on July Jul-07 Precision Limits = ±10% d However, the first failed biweekly for this site was actually on June 9, but the site operator did not recalibrate.

The recalibration of this instrument finally occurred on August 1. As the chart illustrates, the site operator had difficulty conducting the calibration. All data between June 9 and July 20 was flagged as suspect. All data between July 21 and August 1 was void.

~0.080 PPM PPM The chart above shows a substantial drop in concentration when comparing data before the site operator’s visit and after his visit. The site operator did not retighten the mace filter holder after changing the filter inside the analyzer. Five days of ozone data were lost.

Pump malfunction on NOx monitor. Failed nightly zero/span at 0200 hours. The site operator did not address this issue for 7 days, despite having received a new pump immediately following the malfunction. The necessary recalibration occurred two days later. A total of 10 days of data were lost. Pump Failure Span

The scheduled run date for this sample was August 25. AQS requires concentrations for all scheduled samples. Thus, data for the August 25 sample had to be entered. It was entered as a void. The August 26 sample is considered a make-up. There was no explanation given as to why the filter ran on the wrong date.