ICOTE Meeting October, Chief Developmental Tester Project Status for ICOTE October 2014 Brendan Rhatigan – Lockheed Martin

ICOTE Meeting October, CDT Project Status – October 2014 Project team consists of: Joe Manas (Lead) – RaytheonBrendan Rhatigan – Lockheed Martin Sandi Gianotas – Boeing (BTE)Steve Scukanec – Northrop Grumman Tom Simms – DASD(DT&E)Paul Alfieri – DAU Joe Wascavage – NAVAIRBram Lillard – DOT&E Power Point paper version completed in July Paper accepted to the following conferences: NDIA 29th Annual National Test & Evaluation ConferenceNDIA ICOTE Meeting 07/21/2014 — 07/23/2014 7/21/2014 The Westin Washington, DC City Center Washington, DC ITEA 31st Annual International Test and Evaluation SymposiumNDIA 17th Annual Systems Engineering Conference 10/6/2014 — 10/9/201410/27/2014 — 10/30/2014 Crystal Gateway MarriottWaterford at Springfield Arlington, VirginiaSpringfield, VA Authoring of white paper sections progressing – ECD November 14 Feedback received from ICOTE and T&E Division presentations Clear, concise recommendations DOT&E member added to project team Paper focuses on specific recommendations to shape future RFPs Key Personnel Clauses around the Industry Test Lead Key interaction between CDT & ITL and the output products Developmental Evaluation Framework (DEF) – Recommend Workshop w/ key stakeholders Continue to update and review the DEF / TEMP as needed during development

ICOTE Meeting October, High Level Recommendations 1.Continue advertising the importance of the Chief Developmental Tester role. We recommend that industry provide a qualified Industry Test Lead that is equal to but separate from the Chief Engineer with sufficient independence to ensure test is well thought out and executed through the program lifecycle. 2.Amplify the deliverables required by the RFP to request a Test and Evaluation Strategy based on Scientific Test and Analysis Techniques (STAT), and a robust Integration Strategy that is updated throughout the program lifecycle. 3.Add additional language in Request For Proposals (RFPs) to specifically identify an Industry Test Lead with responsibilities outlined later in the paper in the Contractor Key Personnel Clause.

ICOTE Meeting October, High Level Recommendations 4.Industry should recognize test as a profession through specific career tracks and training. Adopt qualification and certification initiatives similar to the DOD. Provide wider access to DAU coursework in DOD T&E for industry to help the ITL and CDT have a more common mastery of T&E. 5.Require in the RFP and subsequent contract SOW that the ITL is to work in conjunction with the CDT on the Developmental Evaluation Framework (DEF), Test and Evaluation Master Plan (TEMP). Adopt the DEF workshop DDT&E strategy for MDAP programs. 6.Develop a case study on selected new programs to further refine doctrine and guidance specific for CDT and ITL work products and interactions.

ICOTE Meeting October, BACKUP

ICOTE Meeting October, T&E Themes For Conferences SED Committee Collaborative Projects DT&E Committee Current Structure Since 2010 NDIA Systems Engineering Conference (Q4) Collaborative Projects NDIA Test and Evaluation Annual Conference (Q2) Periodic T&E Committee-Focused Conferences Cooperation with other NDIA Divisions NDIA Industrial Committee on Test and Evaluation (ICOTE) DT&E Committee Focus: T&E initiatives aligned with SE, DT&E T&E Themes & Issues Project Results DT&E Themes NDIA Test and Evaluation Division NDIA Systems Engineering Division NDIA DT&E Committee SE Themes & Issues

ICOTE Meeting October, Chief Developmental Tester Project Project NameActivities 2014Project Output Chief Developmental Tester Review service policies for new role and industry implementations Propose model for industry interaction White paper T&E/SE conference presentations The Secretary of Defense shall require that each major defense acquisition program be supported by— ‘‘(A) a Chief Developmental Tester; and ‘‘(B) a governmental test agency, serving as Lead Developmental Test and Evaluation organization for the program. Coordinating DT&E activities Insight into Contractor activities Oversee T&E activities Inform government PM about contractor DT&E results Project Lead: Joe Manas

ICOTE Meeting October, T&E in Acquisition Lifecycle Full Rate Production Decision Review C A Technology Maturation & Risk Reduction Engineering & Manufacturing Development Production and Deployment O&S Materiel Solution Analysis MDD Requirements Decision Developmental RFP Decision B Draft SHIFT LEFT: Includes earlier test and evaluation planning and activities to support Milestone C decision SRR SFR CDR SVR ASR PDR TEMP Draft DT&E Chief Developmental Tester Industry Test Lead EMD Contract TMRR Contract Industry Test Lead(s) Lead DT&E Organization T&E WIPT Industry Test Leads can help with early test and evaluation planning and activities PROJECT FOCUS: Interactions between Industry and government Most important single decision in the life cycle… sets in motion all that follows. The venue for frequent interaction with all key stakeholders