1 of 39 The EPA 7-Step DQO Process Step 3 - Identify Inputs (45 minutes) Presenter: Sebastian Tindall Day 2 DQO Training Course Module 3

2 of 39 Objectives n Identify applicable information/data needed for making the decisions n Determine the quality of information needed n Determine whether the historical/existing data are sufficient to make the decisions or whether new data are required n Determine QC protocols

3 of 39 Step Objective: To identify the informational inputs that will be required to resolve the decision statements identified in Step 2, and to determine which inputs require environmental measurements Step 3: Identify Inputs Step 4: Specify Boundaries Step 2: Identify Decisions Step 3: Identify Inputs Step 1: State the Problem Step 5: Define Decision Rules Step 6 : Specify Error Tolerances Step 7 : Optimize Sample Design

4 of 39 Information INActions Information OUT From Previous Step To Next Step Evaluate the Appropriateness of Existing Data: Usability Assessment Step 3a - Identify Inputs Determine Whether the Information Exists List General Sources of Information Decision Statements Continue Step 3 Activities Specify Environmental Variables to be Measured Determine the General Level of Quality Required for the Data

5 of 39 Information INActions Information OUT From Previous Step To Next Step Evaluate the Appropriateness of Existing Data: Usability Assessment Determine Whether the Information Exists List General Sources of Information Decision Statements Continue Step 3 Activities Specify Environmental Variables to be Measured Determine the General Level of Quality Required for the Data Determine which environmental variables or other information are needed to resolve the decision statement. Step 3a - Identify Inputs

6 of 39 Information INActions Information OUT From Previous Step To Next Step Evaluate the Appropriateness of Existing Data: Usability Assessment Determine Whether the Information Exists List General Sources of Information Decision Statements Continue Step 3 Activities Specify Environmental Variables to be Measured Determine the General Level of Quality Required for the Data Ask general questions such as: “Is information on the physical properties of the media required?” “Is information on the chemical/radiological characteristics of the matrix needed?” Step 3a - Identify Inputs

7 of 39 Information INActions Information OUT From Previous Step To Next Step Evaluate the Appropriateness of Existing Data: Usability Assessment Determine Whether the Information Exists List General Sources of Information Decision Statements Continue Step 3 Activities Specify Environmental Variables to be Measured Determine the General Level of Quality Required for the Data Examples of Physical Properties: Soil/Sediment:Air: - Kd- Temperature - Hydraulic conductivity- Moisture content - Porosity- Percent particulate/volume - Grain-size distribution Groundwater/Surface Water:Building Materials: - pH- Density - Temperature- Compaction - Electrical conductivity - Turbidity Step 3a - Identify Inputs

8 of 39 Information INActions Information OUT From Previous Step To Next Step Evaluate the Appropriateness of Existing Data: Usability Assessment Determine Whether the Information Exists List General Sources of Information Decision Statements Continue Step 3 Activities Specify Environmental Variables to be Measured Determine the General Level of Quality Required for the Data Examples of Chemical / Radiological Properties: Groundwater/Surface Water: Soil/Sediment: - Concentration - Activity level Air: Building Materials: - Concentration - Activity level Step 3a - Identify Inputs

9 of 39 Information INActions Information OUT From Previous Step To Next Step Evaluate the Appropriateness of Existing Data: Usability Assessment Determine Whether the Information Exists List General Sources of Information Decision Statements Continue Step 3 Activities Specify Environmental Variables to be Measured Determine the General Level of Quality Required for the Data Create a list of environmental variables of interest for which environmental measurements may be required. Levels of lead, silver, Total Metals, etc. Levels of volatile organic compounds (VOCs), semi-volatile organic compounds (SVOCs), etc. Total Suspended Solids Temperature, pH, Eh, etc. Alpha, Beta, Gamma activities Step 3a - Identify Inputs

10 of 39 Information INActions Information OUT From Previous Step To Next Step Evaluate the Appropriateness of Existing Data: Usability Assessment Determine Whether the Information Exists List General Sources of Information Decision Statements Continue Step 3 Activities Specify Environmental Variables to be Measured Determine the General Level of Quality Required for the Data Identify and list the general sources where information on the environmental variables to be measure might exist. Step 3a - Identify Inputs

11 of 39 Information INActions Information OUT From Previous Step To Next Step Evaluate the Appropriateness of Existing Data: Usability Assessment Determine Whether the Information Exists List General Sources of Information Decision Statements Continue Step 3 Activities Specify Environmental Variables to be Measured Determine the General Level of Quality Required for the Data Step 3a - Identify Inputs Potential Data Sources: New data collection Existing data Historical records Scientific literature Regulatory guidance Professional judgement Modeling Modeling Data Needs: Scenario(s) - (develop) Parameters - (develop) - Values (obtain) - Ranges (obtain) Obtain Modeling Inputs: Old/New environmental measurements Scientific literature Other

12 of 39 Information INActions Information OUT From Previous Step To Next Step Evaluate the Appropriateness of Existing Data: Usability Assessment Determine Whether the Information Exists List General Sources of Information Decision Statements Continue Step 3 Activities Specify Environmental Variables to be Measured Determine the General Level of Quality Required for the Data Identify reports, historical data and list the source and type of information available. Step 3a - Identify Inputs

13 of 39 Information INActions Information OUT From Previous Step To Next Step Evaluate the Appropriateness of Existing Data: Usability Assessment Determine Whether the Information Exists List General Sources of Information Decision Statements Continue Step 3 Activities Specify Environmental Variables to be Measured Determine the General Level of Quality Required for the Data From Step 2: Consider the human health, ecological, political, cost, and legal consequences of each action when determining the required level of quality. Step 3a - Identify Inputs

14 of 39 Information INActions Information OUT From Previous Step To Next Step Evaluate the Appropriateness of Existing Data: Usability Assessment Determine Whether the Information Exists List General Sources of Information Decision Statements Continue Step 3 Activities Specify Environmental Variables to be Measured Determine the General Level of Quality Required for the Data Usability Assessment: Is data quality assured? Evaluate quality control data associated with each data set: Spikes (bias) Duplicates (precision) Blanks (evaluate contamination) Other considerations: Detection limits Data collection method (random, systematic, biased) Remove data that are of poor quality or that are not representative of the population Step 3a - Identify Inputs

15 of 39 Information INActions Information OUT From Previous Step To Next Step Evaluate the Appropriateness of Existing Data: Usability Assessment Determine Whether the Information Exists List General Sources of Information Decision Statements Continue Step 3 Activities Specify Environmental Variables to be Measured Determine the General Level of Quality Required for the Data Usability Assessment (Statistical): Are data representative of the population? Can the data be used to make inferences about the population or sub-population of interest? Translation: Can sweeping claims be made about the site on the basis of the results of an estimate, e.g., the existing data. Step 3a - Identify Inputs

16 of 39 Information INActions Information OUT From Previous Step To Next Step Evaluate the Appropriateness of Existing Data: Usability Assessment Determine Whether the Information Exists List General Sources of Information Decision Statements Continue Step 3 Activities Specify Environmental Variables to be Measured Determine the General Level of Quality Required for the Data Usability Assessment (CSM) : Are the data reasonable for the proposed CSM? Do the data fall within the range expected for the CSM? Step 3a - Identify Inputs

17 of 39 Step 3a - Approaches Approach 1 Use predominantly fixed traditional laboratory analyses and specify the method specific details at the beginning of the DQO Process and do not change measurement objectives as more information is obtained This approach will contain serious flaws.

18 of 39 Approach 2 Allow more field decisions to meet the measurement objectives and allow the objectives to be refined in the field using dynamic work plans (TRIAD approach) This approach will attempt to overcome the serious flaws shown in Approach 1. Step 3a - Approaches (cont.)

19 of 39 n Approach 2 - Dynamic Work Plans –Real-time, decision making in the field allows for a seamless flow of site activities resulting in fewer mobilizations Step 3a - Approaches (cont.) –Requires more flexible contracting approach –Requires experienced, well-trained field team (e.g., geologists, chemists and statisticians) either in the field or able to receive and process electronic data in real-time

20 of 39 n Approach 2 –Allows collection of more data in real-time Step 3a - Approaches (cont.) –Allows real-time decisions to be made –Must have flexible but established decision trees approved by decision makers ahead of time –Need general statements of measurement quality that will be interpreted by field team –May be more costly due to higher level of expertise required but…more defensible

21 of 39 n Approach 1 defines methods, precision, accuracy, detection levels Step 3a - Approaches (cont.) n Approach 2 defines more general, flexible measurement quality objectives (MQOs)

22 of 39 Information INActions Information OUT From Previous Step To Next Step Confirm that Appropriate Measurement Methods Exist to Provide the Necessary Data Information Needed to Resolve Decision Statements Specify the Matrix to be Measured Specify Required Detection Limits Specify the Precision Required Specify the Accuracy Required Information From Previous Step 3 Activities Identify Action Level and Basis for Level Step 3b - Identify Inputs

23 of 39 Information INActions Information OUT From Previous Step To Next Step Confirm that Appropriate Measurement Methods Exist to Provide the Necessary Data Information Needed to Resolve Decision Statements Specify the Matrix to be Measured Specify Required Detection Limits Specify the Precision Required Specify the Accuracy Required Information From Previous Step 3 Activities Identify Action Level and Basis for Level When selecting methods, consider: Detection limits Sample size Particle size Turn around time Cost Step 3b - Identify Inputs

24 of 39 Information INActions Information OUT From Previous Step To Next Step Confirm that Appropriate Measurement Methods Exist to Provide the Necessary Data Information Needed to Resolve Decision Statements Specify the Matrix to be Measured Specify Required Detection Limits Specify the Precision Required Specify the Accuracy Required Information From Previous Step 3 Activities Identify Action Level and Basis for Level Examples: Surface and groundwater Surface and subsurface soil Concrete Air Biota Step 3b - Identify Inputs

25 of 39 Information INActions Information OUT From Previous Step To Next Step Confirm that Appropriate Measurement Methods Exist to Provide the Necessary Data Information Needed to Resolve Decision Statements Specify the Matrix to be Measured Specify Required Detection Limits Specify the Precision Required Specify the Accuracy Required Information From Previous Step 3 Activities Identify Action Level and Basis for Level If practical, determine the actual numerical value that will be used as the action level for each environmental variable. In Step 5 confirm that action levels are greater than the detection limits. Step 3b - Identify Inputs

26 of 39 Information INActions Information OUT From Previous Step To Next Step Confirm that Appropriate Measurement Methods Exist to Provide the Necessary Data Information Needed to Resolve Decision Statements Specify the Matrix to be Measured Specify Required Detection Limits Specify the Precision Required Specify the Accuracy Required Information From Previous Step 3 Activities Identify Action Level and Basis for Level Action levels are from: Regulations (drinking water, RCRA TC) Derived from risk modeling (PRGs) Step 3b - Identify Inputs

27 of 39 Information INActions Information OUT From Previous Step To Next Step Confirm that Appropriate Measurement Methods Exist to Provide the Necessary Data Information Needed to Resolve Decision Statements Specify the Matrix to be Measured Specify Required Detection Limits Specify the Precision Required Specify the Accuracy Required Information From Previous Step 3 Activities Identify Action Level and Basis for Level For any new environmental measurements to be made, develop a comprehensive list of potentially appropriate measurement methods for each matrix. Specify the detection limits, precision, and accuracy for each environmental variable per matrix. Step 3b - Identify Inputs

28 of 39 Information INActions Information OUT From Previous Step To Next Step Confirm that Appropriate Measurement Methods Exist to Provide the Necessary Data Information Needed to Resolve Decision Statements Specify the Matrix to be Measured Specify Required Detection Limits Specify the Precision Required Specify the Accuracy Required Information From Previous Step 3 Activities Identify Action Level and Basis for Level Step 3b - Identify Inputs Specify the normal laboratory reporting limits. Compare these limits to action level. If the detection limit exceeds action level, either: Use larger sample size to lower reporting limit, Use alternate method, Develop new method, or Make the reporting limit equal to the action level.

29 of 39 Information INActions Information OUT From Previous Step To Next Step Confirm that Appropriate Measurement Methods Exist to Provide the Necessary Data Information Needed to Resolve Decision Statements Specify the Matrix to be Measured Specify Required Detection Limits Specify the Precision Required Specify the Accuracy Required Information From Previous Step 3 Activities Identify Action Level and Basis for Level Precision is specified by Relative percent difference Relative standard deviation Confidence limits Step 3b - Identify Inputs

30 of 39 Information INActions Information OUT From Previous Step To Next Step Confirm that Appropriate Measurement Methods Exist to Provide the Necessary Data Information Needed to Resolve Decision Statements Specify the Matrix to be Measured Specify Required Detection Limits Specify the Precision Required Specify the Accuracy Required Information From Previous Step 3 Activities Identify Action Level and Basis for Level Accuracy is specified by percent recovery. Step 3b - Identify Inputs

31 of 39 2 Approaches n Approach 1: Traditional lab methods n Approach 2: Field analytical methods with final confirmation via lab methods –Select onsite methods that focuses on driver COPCs (e.g., risk drivers, transport drivers, etc.)

32 of 39 Lab Methods CS

33 of 39 Onsite Methods CS

34 of 39 Approach 2 n To use XRF for onsite, the following must be done: –Develop correlation between lab methods listed in Approach 1 and on-site XRF methods for Pb and U per method 6200 –Correlation must take into account in-situ measurements without drying soil, this creates greater error than drying –In-situ must establish fixed distance of soil from source and fixed count (time exposed to X-rays) time –Develop calibration curves using all different types of soil present at the site CS

35 of 39 n For Diesel Range (DRO, GRO) onsite –Develop quick extraction with hexane for the DRO, 5 gr soil to 10 ml hexane –Perform short accuracy and precision study for DRO CS Approach 2 (cont.)

36 of 39 n MQOs –The RPDs in the previous tables represent the analytical precision and accuracy requirements based on the published methods. –Due to biases, the correlation between the lab methods and on-site methods must meet r 2 of 0.80 –Due to the higher detection limits and chance for false positives for Immunoassay, the final confirmation of the action limits must include lab analysis Approach 2 (cont.) CS

37 of 39 Information INActions Information OUT From Previous Step To Next Step Evaluate the Appropriateness of Existing Data: Usability Assessment Determine Whether the Information Exists List General Sources of Information Decision Statements Continue Step 3 Activities Specify Environmental Variables to be Measured Determine the General Level of Quality Required for the Data Step 3a - Identify Inputs

38 of 39 Confirm that Appropriate Measurement Methods Exist to Provide the Necessary Data Information Needed to Resolve Decision Statements Specify the Matrix to be Measured Specify Required Detection Limits Specify the Precision Required Specify the Accuracy Required Information From Previous Step 3 Activities Identify Action Level and Basis for Level Step 3b - Identify Inputs Information INActions Information OUT From Previous Step To Next Step

39 of 39 End of Module 3 Thank you