1. U Development of Reliability Program Standard GEIA-STD-0009 SE Summit March 2009 Approved for Public Release; Distribution is unlimited

2. GEIA-STD-0009, Reliability Program Standard for Systems Design, Development, and Manufacturing DSB Task Force on DT&E: –Ensure programs are formulated to execute a viable systems engineering strategy from the beginning, including a RAM growth program, as an integral part of design and development. –Develop a military standard for RAM development and testing that can be readily referenced in future DoD contracts Brisk schedule: –1 st DoD-industry WG meeting Oct 07 –Formal ballot closed 30 Jun 06, unanimously approved –Final WG meeting 28-29 Jul 08 GEIA = Govt Electronics & Info Technology Assoc

3. Army Systems Failing Operational Reliability Tests 33% of systems met reliability requirements 47% of systems fail to achieve even ½ of their reliability requirements 1997 - 2006 The Problem!

4. DoD O&S Costs Largest Fraction of Life Cycle Costs RDT&E Procurement O&S Source: Defense Science Board Task Force on Developmental Test & Evaluation Color Key:

5. Observed Problems Addressed? DescriptionMil-Std-785BIEEE 1332SAE JA1000 Estimate and update loads being imposed on sub- assemblies and components No ID and characterize resulting failure distributions and modes No (not explicit) No (not explicit) No Mitigating resulting failure modes No (not explicit) No (not explicit) No Integrated reliability growth management Yes (Task 302) No (not explicit) No Determine if reliability is seriously off track early No Reliability caseNoYes

6. GEIA-STD-0009 Reliability Objectives 1.Understand customer/user requirements and constraints 2.Design and redesign for reliability 3.Produce reliable systems/products 4.Monitor and assess user reliability

7. Before System Testing Begins After System Testing Begins Notional Reliability Growth

8. Virtual failures from engineering- and physics-based models Potential user failure modes Failures from component ALT Failures from subsystem testing Failures from system testing Field Failures Potential manufacturing & workmanship failures Reliability Assessment Reqment Reliability Verification Characterize operational & environmental loads Closed-loop failure- mode mitigation Systems Engineering GEIA-STD-0009 Reliability Growth Identify failure modes & mechanisms

9. Consistent, concise, sample reliability program language for RFP sections: –C Statement of Work –L Proposal Instructions –M Factors for Evaluation – Evaluation Checklist Consists of what to do, i.e., top-level objectives and activities that are essential in order to design, build, and field reliable systems –Distilled from GEIA-STD-0009, Reliability Program Standard for Systems Design, Development and Manufacturing –Developer remains responsible to identify and propose methods, tools, and a set of Best Practices (i.e., how to do it) Located at DAU website with overview and URL being included in Defense Acquisition Guidebook, Guide for Integrating Systems Engineering into DoD Acquisition Contracts, and Incorporating Test and Evaluation into DoD Acquisition Contracts Will cause developers to plan for and resource a reliability growth program, as an integral part of design and development DoD RIWG Task 1.2 Sample RFP Language Supports New Army and DoD Policies

11. RIWG Task 1.4 Standard Evaluation Criteria Standard evaluation criteria needed to provide consistent way to evaluate programs reliability health early in the development process RIWG developed Reliability Scorecard that assesses critical reliability activities in the areas of Tool developed to view scorecard in Acquisition Community Connection – R&M Interest Area Link to be included in DAG Army T&E Evaluator will use for implementing new Army Reliability Policy Reliability Requirements and Planning Training and Development Reliability Analysis Reliability Testing Supply Chain Management Failure Tracking and Reporting Verification and Validation Reliability Improvements Supports New Army and DoD Policies

13. Guidance DoD Guide for Achieving Reliability, Availability, and Maintainability, 3 Aug 2005 Concerning Reliability Assessment and Verification: Best Practices for Reliability Assessment and Verification, ITEA Journal, Sep, 2008 Implementing contractual language developed by DoD Reliability Improvement Working Group –Contractual language will be regularly revised based on lessons learned Reliability Scorecard developed by AMSAA and DoD Reliability Improvement Working Group