1. UNCLASSIFIED Bill McCarthy Bill McCarthy Deputy Director 15 September 2010 15 September 2010 COTF Perspectives

2. Joint Capability Area Universal Joint Task List Joint Mission Thread Capabilities Documents AoA System 1 System 2 System 3 Mission Task Mission Task Mission Task Task/Subtask Conditions Attributes Data Rqmts Test Performance Spec Detailed Spec Test Design Test Analysis System Under Test Warfighting Effect Integrated Test Technical Decomposition Operational Decomposition Operational Effectiveness in a Joint Environment 2

3. 3 Mission Based Test Design Define Tasks Establish Conditions Determine Measures of Success Develop Design of Experiments Create Vignettes Develop Detailed Procedures Identify Resources Integrated Evaluation Framework Systems Engineering approach to OT design Design created early in the acquisition lifecycle (ideally before MS B) Based on tasks from the Universal Joint Task List Integrated Evaluation Framework design aligns with Navy/Joint Mission Essential Task List based training assessments Process produces document called Integrated Evaluation Framework Provides foundation for all detailed test plans and TEMP Provides detailed list of test resources

4. OT in the “Notional” Systems Engineering Life Cycle JCIDS Tasks PDR Attributes & Conditions CONOPS Mission CDR Integrated Testing IOT &E SE Process MBTD Process Developmental Testing FOT&E Integrated Evaluation Framework

5. UNCLASSIFIED Bill McCarthy Bill McCarthyWilliam.mccarthy@cotf.navy.mil Questions?

6. Practical Application of MBTD 6 JMT TASK CONDITION ATTRIBUTE DATA TEST DESIGN OF EXPERIMENTS BIG, UNEXECUTABLE MATRIX MULTIPLE POINTED, SMALL MATRICES VIGNETTES FOR TEST EVERYTHING WHAT’S ESSENTIAL

7. COTF Competency Aligned Organizational Construct 7 ADMIRAL UNDERSEA WARFARE AVIATION WARFARE C4ISRSURFACE WARFARE EXPDTNRY WARFARE SPECIAL PROGRAMS POLICY PLANNING SUPPORT EXECUTION SUPPORT DEPUTY VX-9VX-1VMX-22HMX-1 FUNCTION PRODUCT (Fleet)