1. 1 E-2D Advanced Hawkeye Lessons Learned from Integrated Test (IT) Rick Quade Navy T&E 10 March 2010

2. 2 Agenda Program Overview IT Challenges Implementation of IT IT Self Assessment Keys to Success

3. 3 E-2D Advanced Hawkeye Program ACAT:ID M/S:MS B June 03, MS C May 09, IOT&E FY12, IOC FY15 Contractors:Northrop-Grumman as Total Weapon System Prime Lockheed-Martin as Radar Principal Subcontractor Flight Test Program Phases SDD – 2 SDD Aircraft, ~2000 Flt Hrs Apr 2007 Pilot Production Verification – 3 Aircraft, ~800 Flt Hrs June 2010 IOT&E – 4 Aircraft, ~1000 Flt Hrs FY12 E-2D Integrated Test Team (ITT) 100+ engineers and project officers

4. 4 E-2D Test Organization

5. 5 Test Environmental Factors E-2D complex weapon system with extensive amount of flight testing –Mission Systems - ~225 successful flights (SDD) –Air Vehicle - ~125 successful flights (SDD) –25+ Test Plans (SDD) Many moving parts (Staff, HW/SW, DRs, Management) Large and diverse test team comprised of NAVAIR (5.1.1, 5.1.2, 5.1.6, VX-20, 5.2, 5.4, CSS), Northrop Grumman, Lockheed Martin, VX-1, COTF and others Typical program and flight test challenges

6. 6 E-2D IT Challenges DT, OT and Program Organizational Barriers “I’ve got a secret” Expectations Management Staffing/Turnover Spec Compliance vs Suitability Legacy vs Program of Record Weapon System Maturity Leveraging/Integrating DT/OT efforts IT touches all aspects of program execution.

7. 7 E-2D IT Implementation PMA embraced T&E role in program execution –Multiple 5.0 T&E Deep Dives of test program –Conducted an Independent T&E Review to identify test risks –Program unilaterally added an Operational Assessment (OA) Focused on improving internal/external communications –Monthly meetings with VX-1 (OTA) –Weekly reports and metrics to stakeholders & leadership Embraced early and robust OT participation –OA Report mitigation plans pre-coordinated –OT concerns included in update to CDD –OT part of program management team E-2D ITT CONOPS implemented to document roles, responsibilities and procedures –Signed by NGC, PMA, DT (VX-20), OT(VX-1) and DCMA

8. 8 E-2D IT Implementation (Continued) Early and continuous participation by all stakeholders (DT, Cont and OT) on test DT planning and execution –Test planning working groups –Discrepancy reporting/NTAB Yellow Sheet Reviews –Technical Reviews Integrated Test Planning & Execution –DT/OT Test Point Matrix for Pilot Production/IOT&E testing –OT Test Planning – coordinate with program, risk reduction –Integrated flight schedule w/OT crews Efficient use T&E Infrastructure/Capability –Telemetry Trailer, targets, labs –Data/data analysis personnel used by DT and OT Northrop-Grumman Support –Embraced early OT involvement and feedback –Willing to discuss and mitigate relevant OT issues

9. 9 E-2D IT – Self Assessment Contractor data augmenting IOT&E data –OA Report leveraged significant amount of data collected during DT DT and OT personnel recognize each other in airport OT personnel influence DT scenarios –OT part of planning process, common goal of leveraging “DT” flights to meet OT objectives DT system operated by OT users –Monthly flt hr goals for OT team, DR verification DT and OT sharing data in common format OT confirms DT results –OA Report did not identify any new issues

10. 10 E-2D Awards and Recognitions CY2007 –NAWCAD Commander's Award for 2007 –VX-20 Test Team Award 2007 CY2008 –NAWCAD Commander's Award for 2008 for Individual Effort for Mr. Pat Svatek –Society of Flight Test Engineers' International Flight Test Team of the Year 2008 (James S McDonnell Award) –Daedalian Weapons Systems Award: Colonel Franklin C. Wolfe Memorial Trophy –VX-20 Test Team Award 2008 CY2009 –NAWCAD Commander's Award 2009 –Society of Flight Test Engineers’ 40th International Symposium Best of Symposium Award for E-2D ACAWS Team –European Flight Test Safety Award for 2009 –E-2/C-2 Shore Pilot of the Year – LT Greg Machi –E-2/C-2 Shore NFO of the Year – LCDR Matthew Tharp

11. 11 E-2D IT Keys to Success Set Expectations –Known roles & responsibilities, big picture awareness Open Communication –Create forums for discussion, education and decision making –No secrets or surprises, transparency expedites issues resolution Common Goals & Objectives –Deliver weapon system to war fighter with known performance Robust Conflict Resolution Process –No one has to agree, resolve conflicts at lowest level possible Demand Constructive-Tension/ Positive-Friction –Disagreements are expected, know when to move on Embrace value of robust T&E program –Program leadership values T&E and solicits input –T&E’s job is to inform the PM and decision makers