DISTRIBUTION STATEMENT A: Cleared for Public Release by OSR on 8/04/11; SR Case # 11-S-3228 applies R&M Engineering 08/16/11 Page 1 DTM R&M Engineering Implementation Strategy Andrew Monje Deputy Assistant Secretary of Defense, Systems Engineering Office of the Under Secretary of Defense (Acquisition, Technology and Logistics) 16 Aug 2011

R&M Engineering 08/16/11 Page 2 DISTRIBUTION STATEMENT A: Cleared for Public Release by OSR on 8/04/11; SR Case # 11-S-3228 applies PURPOSE Provide overview of the R&M Implementation Strategy upon approval of DTM AGENDA DTM Overview Policy Implementation - DTM Process - Guidance & Standards/DIDs People - Human Capital Summary Open Discussion Purpose / Agenda

R&M Engineering 08/16/11 Page 3 DISTRIBUTION STATEMENT A: Cleared for Public Release by OSR on 8/04/11; SR Case # 11-S-3228 applies Engineering activities (AS to describe tasks and processes to be stated in the RFP) –R&M Allocations, block diagrams and predictions –Failure definitions and scoring criteria –Failure Mode, Effects and Criticality Analysis (FMECA) –Built-in test and maintainability demonstrations –Reliability Growth testing at system/subsystem level –Failure Reporting, Analysis and Corrective Action System (FRACAS) Preliminary RAM-C Report in support of MS A and updated for MS B & C –Provides early (Pre-MS A) reliability, availability, maintainability and ownership cost feasibility assessments of alternative concepts − Includes early formulation of maintenance & support concepts –Provides an audit trail that documents and supports JCIDS thresholds –Ensures correct balance between the sustainment metrics (Availability-KPP, Materiel Reliability-KSA, and Ownership Cost-KSA) –Provides early risk reduction by ensuring requirements are realistic and correct AS and SEP to specify how the JCIDS sustainment thresholds have been translated into R&M design requirements for use in contract specifications DTM Overview

R&M Engineering 08/16/11 Page 4 DISTRIBUTION STATEMENT A: Cleared for Public Release by OSR on 8/04/11; SR Case # 11-S-3228 applies DTM Overview Reliability Growth Strategy –Documents system-level reliability growth curves in the SEP beginning at MS A and updated in the TEMP beginning at MS B –Establishes intermediate goals for reliability growth curves that will be tracked through fully integrated system-level test and evaluation events until the threshold is achieved –Requires MS C PMs and Operational Test Agencies to assess reliability growth required to achieve the reliability threshold during Initial Operational Test and Evaluation Tracking and Monitoring –Requires PMs to report status of reliability objectives and/or thresholds as part of the formal system engineering review process –Incorporates Reliability Growth Curves into the Defense Acquisition Executive System (DAES) review process

R&M Engineering 08/16/11 Page 5 DISTRIBUTION STATEMENT A: Cleared for Public Release by OSR on 8/04/11; SR Case # 11-S-3228 applies DoDI Encl(6) Test DAES Quad Chart Policy Implementation DTM Incorporating DTM in DoD 5000 and affected Governance Documents –DoDI & enclosure 12 (SE) revision – Complete & sent to DPAP –Enclosure 13 (Logistics) – Comments provided to L&MR –Systems Engineering Plan Outline – Approved –Acquisition Strategy Outline – Approved –Preliminary Design Review Report Guideline – Completed –TEMP outline – Currently in review –LCSP outline – In work –DAES RVW Growth Quad chart – In work Systems Engineering Plan (SEP) Test & Evaluation Master Plan (TEMP) Technology Development Strategy/ Acquisition Strategy Preliminary Design Review Report DTM /21/11 Life-Cycle Sustainment Plan Encl(12) System Engineering In review/In-work Approved Status: DTM to Policy and Acquisition Document Relationships DoDI Encl(13) Lifecycle Logistics

R&M Engineering 08/16/11 Page 6 DISTRIBUTION STATEMENT A: Cleared for Public Release by OSR on 8/04/11; SR Case # 11-S-3228 applies v.01 Annotated Outlines for TDS/AS, SEP Released as “Expected Business Practice” TDS/AS and SEP outlines signed April 20, 2011 Technology Development Strategy [or] Acquisition Strategy Annotated Outline Systems Engineering Plan Annotated Outline April 20,

R&M Engineering 08/16/11 Page 7 DISTRIBUTION STATEMENT A: Cleared for Public Release by OSR on 8/04/11; SR Case # 11-S-3228 applies v.01 Identify the engineering activities to be stated in the RFP and required of the contractor to demonstrate the achievement of the reliability and maintainability design requirements. Provide a table (see example below) to specify how the sustainment key performance parameter thresholds have been translated into reliability and maintainability design and contract specifications … The reliability threshold is often expressed as Mean Time Between Failure (MTBF). Use the appropriate life units (e.g., hours, cycles, etc.). “MTTR” is “mean time to repair;” “N/A” may be entered if an item is not applicable. R&M in the TDS/AS Reliability and Maintainability Requirements ParameterThreshold Contract Specification Requirement Reliability (e.g., MTBF) Maintainability (e.g., MTTR)

R&M Engineering 08/16/11 Page 8 DISTRIBUTION STATEMENT A: Cleared for Public Release by OSR on 8/04/11; SR Case # 11-S-3228 applies New Reliability Reporting Document the Reliability Growth Curve beginning at MS A, updated at each successive milestone, … and report planning to generate R&M artifacts. Implementation of New Reliability Policy

R&M Engineering 08/16/11 Page 9 DISTRIBUTION STATEMENT A: Cleared for Public Release by OSR on 8/04/11; SR Case # 11-S-3228 applies v.01 Update to DAG Chapter 4 R&M Sec –Include overview of R&M Eng Activities by phase –Apply R&M Eng activities based on program position in Life Cycle –Also based on acquisition strategy and equipment type − Provides guidance on Reliability Growth Program –Includes R&M contract guidance with associated DIDs Collaborate with DAG Editors (i.e., to ensure R&M guidance is properly integrated Develop R&M Engineering Guidance with task descriptions per phase –Describes R&M engineering activities across typical program areas Forming R&M Standards working group –Priority given to standards that directly relate to the R&M engineering activities required by the DTM –R&M Eng Mgt STDs 1 st (i.e. 785, 470, & 2165) –Design & Reliability Growth STDs (i.e. 1629, 1635) Process - Guidance & Standards/DIDs DAG LM&R Chapter 5 Updates DAG SE Chapter 4 Updates Key R&M Engineering Standards & DIDs DAG DDT&E Chapter 9 Updates Defense Acquisition Guidebook R&M Engineering Guidebook

R&M Engineering 08/16/11 Page 10 DISTRIBUTION STATEMENT A: Cleared for Public Release by OSR on 8/04/11; SR Case # 11-S-3228 applies v.01 Materiel Solution Analysis Phase MS A MDDMDD MDDMDD DOD LIFECYCLE ENTRY ICD TES TDS SEP GOV TASK ASSIGNMENT PR & RFP FOR MSA INPUT TO TDS PR/RFP TECH DEV PHASE PROPOSAL EVAL CRITERIA PROCUREMENT (SECT. VIII) INPUT TO TES TEST AND EVALUATION (SECT. VII) MAINT. ANALYSIS LIFE CYCLE SUSTAINMENT PLAN R&M RQMTS. ANALYSES TRADEOFF STUDIES R&M ANALYSIS REPORTS SYSTEM ENGINEERING (SECT. V) CONFIG MGMT. TECH DEV SYSTEM SPEC CONFIGURATION MANAGEMENT (SECT. IV) R&M DATA RQMTS UPDATE DATA CONTROL (SECT. III) RAM-C REPORT SUMMARY INPUT TO SEP PM PLAN PROGRAM REVIEW PROJECT CONTROL (SECT. II) MS-A PHASE FUNCTIONS R&M PLANS TECHNOLOGY DEV PHASE REJECT ACCEPT A A R&M PLANS MSA ICD R&M DATA RQMTS 3 REVIEW CONTRACT ITR ASR FUNCTIONAL BASELINE AOA Draft CDD LOGISTICS PLANNING (SECT. VI)

R&M Engineering 08/16/11 Page 11 DISTRIBUTION STATEMENT A: Cleared for Public Release by OSR on 8/04/11; SR Case # 11-S-3228 applies People Human Capital Objective: Increase PM demand for R&M Engineering and enhance R&M Engineering professional capabilities to successfully implement a R&M program. Approach –Define R&M Engineering tasks –Develop R&M Engineering competencies for PM and R&M Engineers – Submit R&M competencies to DAU for curriculum development via SE FIPT chair –DAU develops training architecture, curriculums, training content and delivers training. R&M Engineering E&T Strategy Capture/Define R&M Engineering Tasks and Associated Roles Define R&M Engineering Competencies For Associated Roles (incl. KSAs) Define R&M Engineering Learning Architecture (e.g. CLMs, SPRDE/SE Courses & R&M Competencies Integration, Dedicated R&M Courses) Develop and Deliver Training

R&M Engineering 08/16/11 Page 12 DISTRIBUTION STATEMENT A: Cleared for Public Release by OSR on 8/04/11; SR Case # 11-S-3228 applies Summary Actively engaged on all Focus Areas to improve “Technical Health” of R&M Engineering Institutionalizing the process across the Services Collaborating with other functionals (e.g., test, logistics …) DTM implementation will: –Not burden the programs with unreasonable expectations –Not drive a “One Size Fit All Solution” on programs –Smartly apply engineering activities based on acquisition strategy & life cycle position