Systems Engineering Guideline Development Overview 15 September 2005

2 The Environment Acquisition streamlining of the 90s The Good, the Bad, & the Ugly Nature abhors a vacuum ISO-15288, IEEE-1220, EAI-632 Maj. Gen. Craig Cooning, the Air Force's Director of Space Acquisition at the Pentagon "We walked away from some of the things that served us very well. When you did away with that, you did away with the common language that engineers spoke. So, what we are trying to do is to reinstate those processes that served us well--not to go overboard-- but to do it selectively." (21 October 2004) MIL-STD 499C in draft Like DoD, NASA tossed out many processes & procedures in the 90s, only to regret those actions.

3 Background: NASA System Engineering Issues Failure Review Boards have consistently pointed to lack of SE Space Shuttle Columbia Accident Organizational causes of this accident … cultural traits … detrimental to safety … allowed to develop including: …reliance on past success as a substitute for sound engineering practices … -CAIB, Executive Summary Mars Climate orbiter (MCO) …., the root cause was not caught by the processes in place in the MCO project … -MCO Mission failure Investigation Board Other Recent NASA Projects: CDR was too high level to adequately assess design…too little time to perform an adequate assessment ….Although training was widely available, poor requirements are still common … likely cause for the failure of the parachute system was a faulty design …switches … improperly installed on a circuit board the mishap occurred mainly because of failures in NASAs SE process….This issue is recognized within the directorate.. and is known to be the cause of several recent failures Keep repeating the same SE problems.

4 Response: Establish a Common Framework for Systems Engineering Consistent approach at all levels Advanced tools and methods to achieve greater efficiency, and effectiveness Experienced, well trained engineers in application of concepts, processes, tools, and methods Continuous improvement through assessment at the personal and organizational level Knowledge & Skill of Workforce Concepts and Processes Tools & Methods Capability Multi-Dimensional problem requires 3-D solution

5 Response: Concepts & Processes Develop a NASA Systems Engineering Guideline to: Provide consistency across agency Advance practice in agency Take advantage of lessons learned from other organizations Address findings and results from numerous studies and FRBs/Mishaps CAIB/Diaz NIAT

6 Key Strategies in NASA SE Policy Recognize differences in types of NASA projects. Define a standard design review approach within a common life cycle definition. Standard SE process that can be applied to any system regardless of scope & scale.

7 Background: Approach Develop Requirements for NASA Policy for Engineering of Systems Detailed research into the Failure Review Board Reports, NIAT, etc… Analyzed results of the Pre-Assessment study Primary recommendation NPR required to solve major issues Review SE at other organizations such as LMI, Boeing, RAYCO, N-G, NGA, DoD, SMC, NRO, USAF, USN, INCOSCE, NDIA…. Assess Systems Engineering best practices Evaluate Systems Engineering at NASA Integrate the best SE practices for NASA Modeled after C, 8700 series and SW NPR Process Conduct four workshops Hold Technical exchanges and conduct Reviews (internal and external) Products NPR Document as well as others as required, … Do it right up-front, the first time…instead of heroes saving the day

8 NPD NPR NPR 71xx.x Center Directives Program/Project Management Program and Project Management Processes and Requirements Systems Engineering Processes and Requirements MPGs, MWIs Agency SE Handbook, SP Lessons Learned Best Practices NASA Body of Knowledge For SE PM/SE Handbook MSFC-HDBK-3173 SE Handbook MSFC-HDBK-1912 Verification Handbook MSFC-HDBK-2221 Center Guide(s) For SE Agency Policy Hierarchy

9 Workshop I 7 Feb OCE approval Workshop I, Feb 22-24: Senior group of Government and Industry experts Captured valuable nuggets DoD and Industry are developing robust SE processes Enforced and supported by leadership NASA has many disconnected pockets Each center has their own way But, similarities and commonalities NASA needs a top-down directed approach An Enterprise (OCE) Architecture Crucial for development of complex systems Converging on a new enterprise process framework and consistent processes across NASA represents significant culture change Change of this magnitude takes time and persistence It is important that PM, software and systems engineering be well integrated WS I Attendees OSD - Mark SchafferOSD - Mark Schaffer USAF - Col. Mike HolbertUSAF - Col. Mike Holbert NRO- Rob KlotzNRO- Rob Klotz USAF SMC - Col. Rocky DewanUSAF SMC - Col. Rocky Dewan NSSO- Capt. MarsdenNSSO- Capt. Marsden USN - Zig RafalekUSN - Zig Rafalek Raytheon/NDIA- Robert RossaRaytheon/NDIA- Robert Rossa Lockheed- Paul RobatailleLockheed- Paul Robataille Boeing- Dev BanerjeeBoeing- Dev Banerjee Northrop-Grumman- James van GaasbeekNorthrop-Grumman- James van Gaasbeek INCOSE- John SnoderlyINCOSE- John Snoderly NASA HQ (OCE) - Rex GevedenNASA HQ (OCE) - Rex Geveden NASA ESMD - Ellen StigbergNASA ESMD - Ellen Stigberg NASA HQ (OSMA) - Wilson HarkinsNASA HQ (OSMA) - Wilson Harkins NASA Stennis - Christine PowellNASA Stennis - Christine Powell NASA HQ (SMD) - Stan FishkindNASA HQ (SMD) - Stan Fishkind NASA Goddard - Jim AndaryNASA Goddard - Jim Andary NASA LaRC - Al MotleyNASA LaRC - Al Motley NASA MSFC - Herb ShiversNASA MSFC - Herb Shivers NASA JSC - Linda BromleyNASA JSC - Linda Bromley NASA NESC- Peggy ChunNASA NESC- Peggy Chun NASA APIO- Steve CavanaughNASA APIO- Steve Cavanaugh USAH Col Mike HolbertUSAH Col Mike Holbert Consultants- Jerry Lake/SMi, Jalal Mapar/SAICConsultants- Jerry Lake/SMi, Jalal Mapar/SAIC WS I Attendees OSD - Mark SchafferOSD - Mark Schaffer USAF - Col. Mike HolbertUSAF - Col. Mike Holbert NRO- Rob KlotzNRO- Rob Klotz USAF SMC - Col. Rocky DewanUSAF SMC - Col. Rocky Dewan NSSO- Capt. MarsdenNSSO- Capt. Marsden USN - Zig RafalekUSN - Zig Rafalek Raytheon/NDIA- Robert RossaRaytheon/NDIA- Robert Rossa Lockheed- Paul RobatailleLockheed- Paul Robataille Boeing- Dev BanerjeeBoeing- Dev Banerjee Northrop-Grumman- James van GaasbeekNorthrop-Grumman- James van Gaasbeek INCOSE- John SnoderlyINCOSE- John Snoderly NASA HQ (OCE) - Rex GevedenNASA HQ (OCE) - Rex Geveden NASA ESMD - Ellen StigbergNASA ESMD - Ellen Stigberg NASA HQ (OSMA) - Wilson HarkinsNASA HQ (OSMA) - Wilson Harkins NASA Stennis - Christine PowellNASA Stennis - Christine Powell NASA HQ (SMD) - Stan FishkindNASA HQ (SMD) - Stan Fishkind NASA Goddard - Jim AndaryNASA Goddard - Jim Andary NASA LaRC - Al MotleyNASA LaRC - Al Motley NASA MSFC - Herb ShiversNASA MSFC - Herb Shivers NASA JSC - Linda BromleyNASA JSC - Linda Bromley NASA NESC- Peggy ChunNASA NESC- Peggy Chun NASA APIO- Steve CavanaughNASA APIO- Steve Cavanaugh USAH Col Mike HolbertUSAH Col Mike Holbert Consultants- Jerry Lake/SMi, Jalal Mapar/SAICConsultants- Jerry Lake/SMi, Jalal Mapar/SAIC A change in culture is required that promotes and works towards using a systems approach by all disciplines -- not just systems engineers!

10 SE Guideline Development Summary Preparation Briefings SE NPR Objectives Workshop 1: Baseline team, Define Objectives and draft annotated outline Draft Outline Workshop 2: Meat on the Bones SE Process Revised Outline Elements for Rough Draft 75% Draft NPR NODIS = Red Team/ Pre-Nodiss Update6105Update6105 Workshop 3 Partial Draft Run Scenarios Develop Process & Models Updated Processes & Models Workshop 4: Review draft Other Products Complete Sections, Interate Models Updated Draft Approved NPR App.Stds

11 Concept Studies (P-PA) Advanced Technology Development (ATD) Flight Systems and Ground Support Projects US Public/Industry/Academia/Federal Agencies, etc. Concept Devel. (A) Prelim Design. (B) Disposal (F) Concept Study KPP Enhancements Early Program/Project Funded BAR / ATD Studies Institutional Projects Pre-Formulation & ProposalPreliminary Design / AnalysisBuild/Construct / Fabricate Operations & MaintenanceDisposal Final Design. (C) Fab/ Assmb/ Test (D) Operations (E) Sys & Portfol Analy TRL Mat. Basic and Applied Research (BAR) Prep. Portf. Mont. Perf. Metrics Aprv Props Sel Fnd Continuous Review Mgmt Approval (BAR) * Note: Timescales are not to scale, and not all interfaces are shown Comm Reslts Updt Portf. Monitor Perfrm. NASA Investments & Life Cycles A NASA project is not a NASA project.

12 Flight & Ground Support System Life Cycle Key Milestone Reviews Mission Concept Review Systems Requirements Review Systems Design Review Preliminary Design Review Critical Design Review Test Readiness Review Systems Acceptance Review Flight Readiness Review Operational Readiness Review Decommissioning Review Formulation Implementation Pre A Concept Studies A Concept Development B Preliminary Design C Detail Design D Fabrication, Assembly, Integration, & Test E Operations & Sustainment F Disposal

13 Program Project Subsystem Component Project System of Interest System of Interest & Hierarchy of Systems The systems engineering process can be applied at any level of the systems hierarchy.

14 System of Interest & Hierarchy of Systems Transponder Antenna A Antenna B Transponder RF Switch Filters Diplexers Transponder System of Interest Communications System of Interest Satellite System of Interest Goal: develop a single systems engineering guideline that can be used to develop a transponder, a subsystem, or a satellite.

15 The SE Process Engine Design Processes applied to each product down and across product structure Realization Processes applied to each product up and across product structure Transition Design Realization Product Verification Product Validation Transition Design Realization Product Verification Product Validation Design Processes Technical Management Processes Realization Processes Design Output Realization Input Design Input Realization Output Feedback Iteration Loops Feedback

16 Stakeholder Expectations Desired Product Technical Solution Products & Technical Design Solution Stakeholder Expectations Definition Technical Requirements Definition Technical Solution Definition Logical Decomposition Physical Solution Planning Assessment Control Decision Analysis Stakeholder Expectations Definition Technical Requirements Definition Technical Solution Definition Logical Decomposition Physical Solution Planning Assessment Control Decision Analysis Design Planning Assessment Control Decision Analysis Transition Design Realization Product Verification Product Validation Planning Assessment Control Decision Analysis Transition Design Realization Product Verification Product Validation Product Transition Design Realization Product Verification Product Validation Realization Layer N+1, 2, …i Products Layer N Product Top Down System Design Bottom Up Product Realization System Structure Layer N SE Engine Applies Recursively

17 Summary Standard design review approach within a common life cycle definition. Recognizes differences in types of NASA projects. Standard SE engine process that can be applied to any system regardless of scope & scale and integrates across hierarchical levels.