Cost and Management Challenges of Systems of Systems True Program Success TM Cost and Management Challenges of System of Systems Arlene Minkiewicz, Chief Scientist PRICE Systems, L.L.C. SEPG 2005

Cost and Management Challenges of Systems of Systems 2 Agenda > Introduction and Definitions > Problem Description > Related Research > New Project Roles > New/Expanded Activities and Cost Drivers > Basic Behaviors for Success > Conclusion

Cost and Management Challenges of Systems of Systems 3 Introduction and Definitions > The Department of Defense has migrated from a platform based acquisition strategy to a capabilities based acquisition strategy > In The Army’s Future Combat Systems’ Features, Risks and Alternatives, the GAO states…. –“…14 major weapons systems or platforms have to be designed and integrated simultaneously and within strict size and weight limitations in less time than is typically taken to develop, demonstrate and field a single system. At least 53 technologies that are considered critical to achieving critical performance capabilities will need to be matured and integrated into the system of systems. And the development, demonstration and production of as many as 157 complementary systems will need to be synchronized with FCS content and schedule.” > In order to deliver such capabilities, suppliers need to change the way they do business

Cost and Management Challenges of Systems of Systems 4 What is a System of Systems > According to Mair [1996] a System of Systems must have most, if not all, of the following characteristics –Operational independence of component systems –Managerial independence of component systems –Geographical distribution –Emergent behavior –Evolutionary development process > Starting from this definition – we expand to explicitly state that there is network centric focus that enables these independent systems to communicate effectively and efficiently

Cost and Management Challenges of Systems of Systems 5 Why do we need System of System’s Capability ? > Today – there are many platforms deployed throughout the battlefield with limited means of communication > No direct means for Army to talk with the Navy to talk with the Air Force > Time from detection to engagement is often unacceptable > Redundant capabilities ABCCC Rivet Joint U-2R/S C-5, C-141 C-130 S-2, S-3 F-16 F-22 F-117 JSF Commercial SATCOM TIBS, TDDS TADIXS-B ACN Link-16 UCAV MC2A

Cost and Management Challenges of Systems of Systems 6 SoS example – WIN-T > Communication between platforms and across services > Time from detection to engagement acceptable > Opportunities are not missed > “The Cloud has been lifted from the battlefield” The Win-T program is the Army’s communication system for reliable, secure, and seamless video, data, imagery, and voice services that enable decisive combat actions

Cost and Management Challenges of Systems of Systems 7 How Does SoS Differ from any System? > Acquisition Strategy Differences –Capability based rather than a specific platform –Many and diverse stakeholders Multiple services / DARPA Lead system integrator (LSI) Multiple primes for component systems Different motivations/priorities/values/business practices –More political > Software Differences –Network centric – communication protocols key –Requirements are emergent not pre-specified –Standards crucial – especially for software interfaces –Large dependency on Commercial Off the Shelf Software > Hardware Differences –Requirements are emergent not pre-specified –Varying ages and technologies of component systems

Cost and Management Challenges of Systems of Systems 8 The Problem > What we know…. –We know how to plan and manage the development and fielding of component systems. –We know that these component plans are not comprehensive enough to deliver the capability required of the System of Systems of interest. > What we need to know… –What additional activities need to be added to plan and manage a System of Systems project and what are the factors that drive effort for these activities? –How might existing activities be impacted by System of Systems activities and what are the factors that drive effort for these changes? –What other factors impact the success or failure of a System of Systems project and what best practices can be employed to mitigate risks?

Cost and Management Challenges of Systems of Systems 9 Related Research > The following lists some of the institutions currently researching cost and management issues associated with System of Systems –University of Southern California Center for software Engineering – CoSOSIMO model –OSD PA&E CAIG (Cost Analysis Improvement Group) –Defense Acquisition University –Cranfield University –Carnegie Mellon Software Engineering Institute –Boeing –SAIC

Cost and Management Challenges of Systems of Systems 10 New Project Role – Lead System Integrator (LSI) > A “Super” prime contractor responsible for fielding systems and managing other primes and sub- contractors, the LSI is responsible for fielding the System of Systems – the “Prime of Primes” > LSI Focus on –System of System Architecture –System of System Integration and Test –Modeling and Simulation –Risk Mitigation –Overall Program Management for System of Systems > LSI Roles –Systems Engineers –System Architects –System of System Program Managers

Cost and Management Challenges of Systems of Systems 11 New Activities > System of Systems Requirements Analysis > Define System of Systems Architecture > Identify Suppliers for component systems > System of Systems Integration and Test > System of Systems Program Management

Cost and Management Challenges of Systems of Systems 12 System of Systems Requirements Analysis > Drivers –Number of operational scenarios –Number of unique interface protocols –Number and complexity of component systems –Number of stakeholders –Key Performance Parameters > Determine scope of SoS > Determine components required to deliver required capabilities –Analyze –Document –Manage Change > On-going process as requirements are emergent with changing needs and technologies

Cost and Management Challenges of Systems of Systems 13 Define System of System Architecture > Drivers –Number of operational scenarios –Number of unique interface protocols –Number and complexity of component systems –New vs. existing component systems –Key Performance Parameters –Experience of architects and system engineers with SoS –Technology maturity –Integration complexity > Architecture should represent an enterprise view rather than the structured hierarchy of traditional systems > Interface protocol standards are key > Network centric

Cost and Management Challenges of Systems of Systems 14 Identify Suppliers for Component Systems > Drivers –Number of interfaces existing/new –Number of component systems existing/new –Number of potential suppliers –Evaluation process –Experience of LSI with SoS procurements > Evaluation and Selection based on SoS Requirements –All the classic COTS issues moved up a tier –How much technology exists/How much needs to be developed > Procure existing technology > Solicit and procure developers of new technology

Cost and Management Challenges of Systems of Systems 15 System of Systems Integration and Test > Drivers –Number and complexity of component systems –Number of unique interface protocols –Number of suppliers –Integration team experience with SoS –Component stability and readiness –Integration process –Integration complexity –Level of risk management –Number of COTS solutions in component systems > SoS Integration and Test on-going process as systems evolve and technologies change > Spiral process focusing on risk mitigation with integrations as part of each spiral > Modeling and Simulation a key factor for test and evaluation of SoS Solutions

Cost and Management Challenges of Systems of Systems 16 System of Systems Program Management > Drivers –Number of operational scenarios –Number of unique interface protocols –Number and complexity of component systems –Key Performance Parameters –Experience of LSI with SoS –Number of suppliers –Number of stakeholders –Geographical distribution of team –Personnel turnover > Coordination / Collaboration / Communication > Risk Management > People Management

Cost and Management Challenges of Systems of Systems 17 Basic Behaviors for Success > Clearly defined authority and responsibility > Standards > Well established and communicated priorities > Risk Management > System Engineering involvement from the very start > Evolutionary development > On-going integration > Flexible architecture

Cost and Management Challenges of Systems of Systems 18 Future Directions at PRICE > On-going engagements –DARPA developing an Affordability Simulation Requirements Model for SoS software affordability management –ODASA – independent estimate for FCS –Air Force – support Joint Unmanned Air Combat Systems cost group > On-going research to develop Cost Estimating Relationships for these SoS Activities > TruePlanning cost estimating framework available making it possible to model Systems and System of Systems in one breakdown structure

Cost and Management Challenges of Systems of Systems 19 Conclusion Arlene F. Minkiewicz Chief Scientist PRICE Systems, L.L.C > The Department of Defense has migrated from a platform based acquisition strategy to a capabilities based acquisition strategy > The development and fielding of Systems of Systems to deliver these capabilities is a complex problem involving changes to the way suppliers do business > Standard system development practices are necessary but not sufficient to meet the needs of SoS’s > New activities are required at the concept, design, integration and test, and program management levels that must be properly planned for.

Cost and Management Challenges of Systems of Systems 20 FASTER DECISIONS. BETTER DECISIONS. 

Cost and Management Challenges of Systems of Systems 21 About PRICE Systems > Leader in Program Affordability Management solutions > Combine cost estimating, project control, and knowledge management – ensuring project success at every decision gateway > Customers increase visibility, minimize risk and cost, accelerate project development, and improve the effectiveness of project selection, control and delivery