2. 1 of 30 Closing Remarks Presenter: Sebastian Tindall 4:45 PM - 5:00 PM (15 minutes) Day 2 DQO Training Course Module 10

3. 2 of 30 Module 10 Closing Remarks & Final Exam Course Objectives: n To summarize key points made today n Closing Remarks n “Final Exam” n Questions/feedback from the audience

4. 3 of 30 The DQO Process “A systematic planning process based on the scientific method for the unambiguous defining of Environmental decision criteria Data requirements Error tolerances and the documentation/preservation of these details in a consistent, standardized format providing a defensible record of the decision” Merrick “Rick” Blancq, USACE, Portland, OR

5. 4 of 30 Systematic Planning Doesn’t Just “Happen” n Haphazard approaches yield haphazard results n Tactical approach to implementation n Decision makers must work together n Successful implementation model evolved as the DQO Process was used

6. 5 of 30 Tools Make the Job Easier n Scoping Checklist n DQO e-Workbook (electronic template) –Standardized DQO Report format n DQO Web Site –DQO tools and materials –Latest version of all of today’s slides n Visual Sample Plan (VSP) –Download free software n Data Quality Assessment tools also!

7. 6 of 30 Managing Uncertainty n We are forced to make environmental decisions based on estimates n Estimates always involve errors n Errors in estimates are not mistakes n If unmanaged, errors in estimates CAN lead to Decision Errors which ARE MISTAKES n Decision Errors must be managed –Identify –Quantify n Severe consequences of decision errors mandate a statistical basis

8. 7 of 30 Defensibility n Comes from doing good science n Requires documentation –“If it isn’t written down, it didn’t happen” n Use a standardized format n We must employ the scientific method to make defensible decisions

9. 8 of 30 How Many Samples do I Need? REMEMBER: HETEROGENEITY IS THE RULE!

10. 9 of 30 How many samples do I need? Begin With the End in Mind Optimal Sampling Design Alternative Sample Designs , , ,  Correct Equation for n (Statistical Method) Population Frequency Distribution Contaminant Concentrations in the Spatial Distribution of the Population The end DATA

11. 10 of 30 Logic to Assess Distribution and Calculate Number of Samples

12. 11 of 30 n “Normal” FD n “Skewed” FD n Computer Simulations: “Badly skewed” or Any FD Evaluate  and  errors to select n Using the LBGR to Estimate n

13. 12 of 30 Project Planning Documents n Work Plan Must contain a clear presentation of (and the reasoning behind): n DQO Report n FSP n Quality Assurance Project Plan n HSP

14. 13 of 30 Project Planning Documents General project decision goals More detailed, technical project goals/decision rules (DQOs), that will guide project decision-making Goals for data quality (MQOs) How sampling representativeness will be ensured, and how sampling uncertainty will be controlled List of analytical technologies and methods QC protocols and criteria to demonstrate that data of known quality will be generated Description how data will be assessed and interpreted according to the decision rules

15. 14 of 30 Analytical + Sub-sampling + Natural heterogeneity of the site = Total Uncertainty Uncertainty is Additive! Remember the uncertainty is additive for all steps in sampling and analysis

16. 15 of 30 Keys to success –Sound technical basis –Complete and thorough documentation Do it! (Get the job done - right) Prove it! (Document what/why/how) Site Closed

17. 16 of 30 FINAL EXAM What is the Question? What is the DQO Process in a Nutshell? What is the Population? What is the Confidence required?

18. 17 of 30 TRIAD: Systematic Planning Managing Uncertainty for Environmental Decision Making Systematic Planning in Environmental Decision Making http://www.doe.hanford.gov/dqo Sebastian Tindall Bechtel Hanford Inc. 3350 George Washington Way Richland, WA 99352 (509) 372-9195 sctindal@mail.bhi-erc.com

19. 18 of 30 TRIAD: Dynamic Work Plans A Guideline for Dynamic Workplans and Field Analytics: The Keys to Cost-Effective Site Characterization and Cleanup http://cluin.org/char1_edu.cfm#dyna_work Albert Robbat, Jr. Tufts University, Chemistry Department Center for Field Analytical Studies and Technology Medford, Massachusetts, 02155 tel: 617-627-3474 and fax: 617-627-3443

20. 19 of 30 TRIAD: On-Site Analysis Applying the Concept of Effective Data to Environmental Analyses for Contaminated Sites http://cluin.org/ Deana M. Crumbling, M.S. Technology Innovation Office U.S Environmental Protection Agency 401 M Street, SW, Mail Code 5102G Washington, DC 20460 (703) 603-0643 Crumbling.Deana@epamail.epa.gov

21. 20 of 30 Sampling for Environmental Activities Charles “Chuck” Ramsey EnviroStat, Inc., P.O. Box 636 Fort Collins, CO 80522-0636 (970) 689-5700; Fax: (970) 229-9977 envirostat@home.com

22. 21 of 30 DQO Consultants: Preparation & Facilitation Mitzi Miller Environmental Quality Management (EQM) 1777 Terminal Drive Richland, WA 99352 (509) 946-4985; Fax: (509) 946-4595 eqmmitzi@owt.com

23. 22 of 30 DQO Consultants: Preparation & Facilitation Al Robinson Environmental Quality Management (EQM) 1777 Terminal Drive Richland, WA 99352 (509) 946-4985; Fax: (509) 946-4595 eqmmitzi@owt.com

24. 23 of 30 DQO Consultants: Environmental Statistics Jim Davidson Davidson and Davidson, Inc. 8390 Gage Blvd., Suite 205 Kennewick, WA 99336 (509) 374-4498; davidson@owt.com

25. 24 of 30 DOE EM-5/NAMP Sponsored Web Pages http:/www.hanford.gov/dqo/ http://dqo.pnl.gov/ http://www.em.doe.gov/safetyhealth/3d/

26. 25 of 30 DQO Training Points of Contact DQO Process Expert Sebastian Tindall Program Manager Bechtel Hanford Inc. 3350 George Washington Way Richland, WA 99352 (509) 372-9195 sctindal@mail.bhi-erc.com Visual Sample Plan James R. Davidson, Jr. Davidson and Davidson, Inc. 8390 Gage Blvd., Suite 205 Kennewick, WA 99336 Tel: (509) 374-4498 davidson@owt.com

27. 26 of 30 Program POCs Elizabeth M. Bowers Department of Energy/Richland Operations Office 825 Jadwin Avenue Richland, WA 99352 (509) 373-9276 Elizabeth_M_Liz_Bowers@rl.gov Dave Bottrell Department of Energy/EM-5/NAMP 19901 Germantown Road Cloverleaf Building Room 1078 Germantown, MD 20874-1290 (301) 903-7251 david.bottrell@em.doe.gov Sebastian Tindall Program Manager Bechtel Hanford Inc. 3350 George Washington Way Richland, WA 99352 (509) 372-9195 sctindal@mail.bhi-erc.com Brent Pulsipher Program Manager Pacific Northwest National Laboratories. 2400 Stevens Drive Richland, WA 99352 (509) 375-3989 brent.pulsipher@pnl.gov

28. 27 of 30 Day 2 Training Credits Susan Blackburn, SAIC, Richland, WA Dave Blumenkranz, SAIC, Richland, WA Mitzi Miller, EQM, Richland, WA & Knoxville, TN Al Robinson, EQM, Richland, WA Kelly Black, Neptune and Associates, Denver, CO Candy Hawk, Blue Sky Software, Richland, WA Mike Schwab, Bechtel Hanford, RL, WA Surajit Amrit, Bechtel Hanford, RL, WA

29. 28 of 30 VSP Acknowledgements John Wilson, PNNL Dick Gilbert, Nancy Hassig, Tim Schiebe, PNNL Don Singer, USGS Brent Pulsipher, PNNL

30. 29 of 30 How Many Samples do I Need? REMEMBER: HETEROGENEITY IS THE RULE!

31. 30 of 30 End of Day 2 Course Please take a few minutes to fill out and turn in all the course evaluation forms. Thank you for your attention today. Questions? Feedback?