1. US Army Corps of Engineers BUILDING STRONG ® Geophysical Classification at the Camp Sibert Remedial Action Amy Walker Geophysicist & Innovative Technology Advocate USACE, Huntsville November 20, 2013

2. BUILDING STRONG ® Outline  Site overview  Prep: WP, Seeding, Test Stand  Classification Method  Results  QC/QA: IVS results, seed results, Validation digging 2

3. BUILDING STRONG ®  37,000 acre FUDS near Gadsden, AL  Used from 1942-1945 as a Replacement Training Center (RTC) for the Army Chemical Warfare Service.  4.2-inch mortar used in most training (primarily HE & smoke/WP/tearing agent)  Current Use: mostly private ownership, used for grazing, woodlands, agriculture & residences  USACE involvement since 1990 (records research, aerial photography analysis, site characterizations, EECAs, removal actions, RIFS) Former Camp Sibert 3

4. BUILDING STRONG ® 4 Remedial Action Sites

5. BUILDING STRONG ® Site 18  Site 18- 400 acres (~118 open) in impact area, used for training to attack Japanese-type pillboxes; 4.2” mortars (HE & WP)  Currently used as wildlife/hunting area with some agriculture  2007- EECA & 1 st ESTCP Munitions Classification Demo (thousands of digs- 2 UXO)  Range 28A- Adjoining, same impact area, ~40 acres open pasture  2010-RIFS- better define boundaries 5

6. BUILDING STRONG ® How did we decide to use Classification?  Over the years, lots of discussions about classification given the ESTCP success here (‘Easiest site in the country’)  Benefits: easy site to show success (well characterized, only 4.2” mortars), minimize digs/disruption for landowners  Parsons under old RA contract - at award, classification capabilities not well understood  Since then- Several successful ESTCP demonstrations by Parsons; MetalMapper available as GFE  Team decided to perform MM classification under existing contract (FFP/PBC) - Final WP allowed for possibility with WP Addendum 6

7. BUILDING STRONG ® Define TOI  A lot of data : Only 4.2” mortars, MEC to 14” on Site 18, Site 17- one item at 40” (swampy)  MD - 90% in upper foot, all <36” at Site 18  PWS/DD says removal ‘to depth of detection’ ► Based on existing GPO and NRL Depth/Response models – threshold of 20mV (Sum1-4) on EM61-MK2 3-coil array expected to detect to 44” 7

8. BUILDING STRONG ® Is existing RA detection methodology acceptable to support classification?  Towed array, 3 adjacent coils, slight overlap in outside coil for coverage  Detection? Good, well above noise  Positioning accuracy? Supports MM needs ► Review of seeds at Sites 19/17 80% meet 40cm radius needed for MM, 98% meet required ESTCP demo EM61 seed detection offset of 60cm- similar to results during demos with 50cm lines spacing. ► Generally low anomaly density (>>1m between picks) Yes 8

9. BUILDING STRONG ® Classification Plan  Work Plan Addendum ► Based on Parsons’ ESTCP Dem Plan- Using same methods for MetalMapper data collection and analysis as successfully demonstrated at other more difficult sites ► Performance metrics/success criteria established based on ESTCP demos, lessons learned and modified as needed for leaving metal ► Blind seeding ► ADEM comments incorporated  No additional large-scale demo, but dig initial ‘200’ to verify process early on, present results and plan for additional validation digging  Conservative classification decisions ► Looking for additional items found elsewhere at Sibert (2.36” rockets, Livens) ► Looking for deep items ► ‘dig’ decisions based on conservative thresholds 9

10. BUILDING STRONG ®  Blind QA Seeds ► Inert 4.2” mortars ► Unknown to Parsons  Blind QC Seeds ► Medium ISOs used for testing EM61 data response and positioning repeatability ► Unknown to MM analyst and EM61 analyst  Known QC Seeds ► Medium ISOs ► Unknown to EM61 analyst ► Known to MM analyst to provide ongoing feedback of data analysis Seeding 10

11. BUILDING STRONG ® Test Stand Varieties of inert 4.2” mortars (with/without noses, base plates, flattened, etc.) – All Matched Data at 36 & 42” – starts to look noisy, matches Livens better than 4.2”mortar, but still meets dig criteria at 48”- not clearly detectable in MM data 11

12. BUILDING STRONG ® Test Stand/GPO 4.2” mortar base plate 4.2” mortar 12 4.2” mortar half shell

13. BUILDING STRONG ® Site 18 pond Data gaps, saturated areas, woods- Mag & Dig 13

14. BUILDING STRONG ® Classification Method  Dig: ► 3-curve Library match > 0.575 ► 2-curve Library match > 0.7 ► 1-curve Library match > 0.8  QC Digs: ► Targets added at the discretion of the analyst- noisy data with confidence metrics close to the thresholds or based on location within feature space  Can’t Analyze targets ► All 3 curves identified as poor by analyst/ bad fit ► EM61 data looks real (not noise spike, anomaly present on multiple lines)  Validation digs: ► Selected by USACE/ADEM  No dig: ► Targets not meeting the above criteria 14

15. BUILDING STRONG ® Site 18 Classification Results 15

16. BUILDING STRONG ® Site 18 Dig Results 16

17. BUILDING STRONG ® ROC Curve (Site 18 & 28A) UXO (all 0.99 matches) Not dug (presumed clutter) & 500 validation digs (known clutter) 17

18. BUILDING STRONG ® ROC Curve 18

19. BUILDING STRONG ® UXO Classification  All three recovered UXO (4.2” mortars) had Library Match of 0.99  Able to inform field crew of last expected UXO - assist in scheduling 19

20. BUILDING STRONG ® Site 18 Intrusive Results 20

21. BUILDING STRONG ® 21

22. BUILDING STRONG ® Nose frag 22

23. BUILDING STRONG ® Cluster – Nose Frag 23

24. BUILDING STRONG ® Cluster – Small Frag 24

25. BUILDING STRONG ® Cluster – Base Plates 25

26. BUILDING STRONG ® Half Shells/Large Frag 26

27. BUILDING STRONG ® 27 Performance Objectives Performance Objective MetricSuccess Level Success Achieved Correctly identify seed items in Instrument Verification Strip (IVS) Percentage of IVS items identified correctly 98% of IVS items identified correctly with confidence metric of > 0.90 Yes Correctly position MetalMapper relative to source Distance between collection location and inverted target location 100% of inverted locations within 40 cm of collection point unless re-shot also outside radius 1 Yes Correctly position MetalMapper relative to EM61 target Distance between MetalMapper collection location and EM61 target location 100% of collection points within 65 cm of EM61 target location 2 Yes Maximize TOI retained on dig list Percentage of TOI identified as dig targets. 100% of TOI identified as dig targets 3 Yes Minimize non-TOI retained on dig list Percentage of false alarms eliminated. 75% of non-TOI left in ground Yes Correctly identify type of TOI Percentage of TOI correctly identified by group 4 75% of TOI identified correctly Yes Classify type of non-TOI Percentage of non-TOI correctly classified by size and shape 5 75% of non-TOI classified correctly with regard to size and shape 6 Yes Correct estimation of target location Accuracy of estimated target parameters for dig list targets marked as “dig”. X, Y < 30 cm (1 s ) Z < 15 cm (1 s ) Yes

28. BUILDING STRONG ® Validation Digging 1)Initial 200 (early verification)- results presented to ADEM (QC metrics pass, seeds classified, dig results make sense) 2)Remainder selected by USACE and ADEM, final list concurrently, while reviewing data in UX-Analyze. Based on: (1)proximity to contractor ‘dig’ thresholds, (2)location in feature space, and (3)location in large anomalous features where classification may be more difficult. 3)No TOI recovered, results make sense (hot soil results for potentially large/deep items in feature space, base plates correctly labeled, etc) 4)Retrospect- too much (nothing looked suspicious) 28

29. BUILDING STRONG ® Non-TOI Results make sense 0.86 match to MK2 Hand Grenade 0.87 match to 2.36” rocket Small, symmetric, slow decay 0.90 match to 60mm mortar 29

30. BUILDING STRONG ® Conclusions  Success!  Using very conservative dig criteria & high % validation: 84% anomalies left undug  UXO ranked very high on dig list  Less disruption for landowner (land & time)  PDT agrees: no increased risk of UXO remaining versus the traditional approach of digging all selected EM61 anomalies 30

31. BUILDING STRONG ® Acknowledgments John Baptiste, Patti Berry, Greg Nivens Sherri Anderson-Hudgins, Karl Blankinship Julie Ange, Stephen Cobb Jim Pastorick Herb Nelson 31