1. Distribution Statement A – Approved For Public Release, Distribution Unlimited ONR Technical Exchange, 4 JUN 2013 Page-1 Automated Software Complexity Reduction for Reclaiming Software Execution Efficiency and Increasing Security Sponsored by the Office of Naval Research View from the Office of the Secretary of Defense Michael May, Ph.D. Office of the Assistant Secretary of Defense for Research and Engineering

2. Distribution Statement A – Approved For Public Release, Distribution Unlimited ONR Technical Exchange, 4 JUN 2013 Page-2 Outline Software Overview from OSD DoD Software Challenges OSD Software Research –Software Engineering Institute –Software Producibility Initiative (SwPri) –Advanced Software Engineering Technologies (ASETS) BAA

3. Distribution Statement A – Approved For Public Release, Distribution Unlimited ONR Technical Exchange, 4 JUN 2013 Page-3 Office of the Secretary of Defense Software Overview Most software development is paid for by Program Offices within the Services: narrow focus on one system. OSD dedicates about $30M to software research; “raise all boats” –Software Engineering Institute –Software Producibility Initiative (SwPri) Other sources of software research funding: ONR, AFOSR, ARO, NSA, SBIR OSD developing Software Assurance R&D Strategy (Section 933, 2013 NDAA) Drive for “Better Buying Power” (BBP 2.0, USD AT&L Memo 13 Nov 2012) and Open Systems Architecture Successful transition of software technology is often to industry first, then indirectly to the Warfighter

4. Distribution Statement A – Approved For Public Release, Distribution Unlimited ONR Technical Exchange, 4 JUN 2013 Page-4 $135 Billion Cost Increase Over 2008 Estimates 2 Reasons for Nunn-McCurdy Breaches 5 Number of Nunn-McCurdy Breaches 5 DoD Can Affect Nearly All Of These! DoD SOFTWARE CHALLENGES (AFFORDABILITY) GAO 2, Contributing Factors To Poor Program Outcome: –Lack Of Technology Maturity –Changes To Requirements –Increases In The Scope Of Software Development –Lack Of Focus On Reliability

5. Distribution Statement A – Approved For Public Release, Distribution Unlimited ONR Technical Exchange, 4 JUN 2013 Page-5 DoD Is Evolving System of Systems (SoS) and Family of Systems (FoS) Concepts To Ultra-Large-Scale (ULS) System Concepts Based On These Programs That Creates Ever More Massive Size And Complexity While ESLOC For Individual Programs Grow The Total Size and Complexity Of The DoD End-To-End Mission Grows Due To The DoD CONOPS For Net-Centric Operations, Information Dominance, and Now The Emphasis On Big Data Approaches Total Raw SLOC Is Even Greater Given The Reuse Factors Range 2X – 4X Sources: CARD Data, SEI, CSIS Analysis DSB 6 Figure 6. Executable Source Lines of Code within Classic Weapon Systems DoD SOFTWARE CHALLENGES (SIZE & COMPLEXITY) Cancelled Over-budget, behind schedule

6. Distribution Statement A – Approved For Public Release, Distribution Unlimited ONR Technical Exchange, 4 JUN 2013 Page-6 DSB 6 Figure 7 Depicts How Code Required For Sustainment Matches Or Exceeds Those For New Development. The Figure Also Suggests That Out-year Budgets Required To Maintain And Upgrade Existing Code Will Be Substantial. Source: CARD Data, Federal Procurement Database System, QSM, CSIS Analysis DSB 6 Figure 7. Estimated SLOC for the National Security Community Technical Challenge To Manage This Growth TECHNICAL CHALLENGES (LEGACY SOFTWARE)

7. Distribution Statement A – Approved For Public Release, Distribution Unlimited ONR Technical Exchange, 4 JUN 2013 Page-7 Software Engineering Institute Research and Development FFRDC Operated by Carnegie Mellon University, Pittsburgh, PA –Academic collaborations: Nation-wide and International –Collaboration possible without restrictions on publication (new 2013) Established 1984 ~600 Full-time employees Funding –OSD (Research), ~$20M –DoD Customers (Tech. Transition) –DHS, DoE, DoT, DoJ (Tech. Transition) Major Units: SEI CERT (cyber), Acquisition Support, Architectures & Systems, Innovation Center http://www.sei.cmu.edu/ Mission: Provide technical leadership and innovation through research and development to advance the practice of software engineering and technology.

8. Distribution Statement A – Approved For Public Release, Distribution Unlimited ONR Technical Exchange, 4 JUN 2013 Page-8 SOFTWARE PRODUCIBILITY INITIATIVE 1 of 2 SwPri is an ongoing program with the goal of improving the DoD's ability to design, build, test, and sustain software-intensive systems that are large-scale, high complexity, highly reliable, and operate in relevant military environments, which meet mission critical requirements, safety critical requirements as well as exhibit predictable behavior. Conducts an integrated program of research to advance the state-of-the- art in the producibility of software for DoD systems. Technical Challenges Operations in an ever-evolving, complex operational environment Growing dependence on software; increasing size and complexity Shortcomings in software development cause schedule slippage, cost growth Software Producibility 1 - The Capacity To Design, Produce, Assure And Evolve Software-Intensive Systems In A Predictable Manner While Effectively Managing Risk, Cost, Schedule, Quality, And Complexity

9. Distribution Statement A – Approved For Public Release, Distribution Unlimited ONR Technical Exchange, 4 JUN 2013 Page-9 SOFTWARE PRODUCIBILITY INITIATIVE 2 of 2 SwPri Development Focus Efficiently Design, Build, And Test Software-Intensive Systems. Pursue Technical Tools And Techniques That Address Software With Tens Of Millions Of Lines Of Code Pursue New Technical Approaches Such As Interoperable Multi-scale, Multi-domain Models; Pursue Efficient Execution And Coordination Of Distributed And Multi-Core Processing; Pursue Code Analysis And Visualization Of Complex Systems; Pursue Performance Validation And Verification Of Complex Code; Pursue Quantitative Representations Of Risk And Uncertainty ASSETS BAA Focus Of Interest Are Advanced Software Engineering Technologies That Harness Cutting-Edge Ideas In Computer Science, Mathematics, And Information Science To Enable Production Of Large-Scale Software-Intensive Systems With Improved Quality And Performance, Decreases In Cost And Development Times, Automation Of Labor-intensive And Error-Prone Processes, Increased Reliability, And Easier Integration And Sustainment Technical Area 1: Distributed Processing / Multi-Core Processing Technical Area 2: Completeness, Development, Testing, and Sustainment Technical Area 3: Instrumentation and Monitoring Technical Area 4: Legacy Software Success Story: “OpenCPI” (http://opencpi.org/) Performers: Academia Service Labs Industry

10. Distribution Statement A – Approved For Public Release, Distribution Unlimited ONR Technical Exchange, 4 JUN 2013 Page-10 BAA-RIK-12-06 Advanced Software Engineering Technologies (ASETS) Posted on FedBizOpps website (http://www.fedbizopps.gov)http://www.fedbizopps.gov Posting Date: 7 March 2012 BAA Closing Date: 2pm EST 30 September 2016 Individual awards will not normally exceed 24 months with dollar amounts normally ranging between $100,000 to $500,000 per year. It is recommended that white papers be received by the following dates to maximize the possibility of award…FY 14 by 4 Nov 13; FY 15 by 3 Nov 14 and; FY 16 by 2 Nov 15 ASETS Will Focus On The Discovery And Adaptation Of Cutting-Edge Ideas To Improve The Producibility Of DoD Software-Intensive Systems