1. Systems Engineering in DoD
Mr. Gordon Kranz Director, Major Program Support
Office of the Director, Defense Research & Engineering/Systems Engineering

2. Bottom-line Upfront
DoD changes emphasize early stages of pre-systems acquisition - prior to Milestone B (MS B)
Reduce risk before making business commitment
Improve likelihood of being able to meet commitments
The Weapon Systems Acquisition Reform Act of 2009 furthers this emphasis with
additional certification requirements at MS A and B,
mandatory competitive prototyping, and
system-level Preliminary Design Review [PDR] before MS B for all MDAPs
Knowledge-based Acquisition – Starting Programs Right!

3. DoD Instruction 5000.02 Mandatory Materiel Development Decision
Mandatory Milestone A for all “major weapon systems” requiring technology development
Mandatory system-level PDR and CDR with reports to and assessments by the Milestone Decision Authority (MDA)
Strengthened MDA certifications at Milestones A and B 3

4. Acquisition Reform - SE Thumbnail
New legislation, Public Law , recognizes the importance of SE to weapon systems acquisition
Heavy focus on starting MDAPs right:
Development and tracking of measurable performance criteria as part of SEPs and TESs / TEMPs
Requiring completion of competitive prototypes for all Major Defense Acquisition Programs
Requiring completion and MDA assessment of a system-level Preliminary Design Review before MS B
Codifying a role for systems engineering in development planning, lifecycle management and sustainability
Yearly OSD assessment to Congress of Component capabilities for SE, development planning, and DT&E and of SE in MDAPs

5. Summary of Legislation
The Weapon Systems Acquisition Reform Act of contains provisions that will:
Address problems with unreasonable performance requirements by requiring DoD to reestablish systems engineering organizations and developmental testing capabilities; make trade-offs between cost, schedule and performance early in the program cycle; and conduct preliminary design reviews before giving approval to new acquisition programs;
Address problems with unreasonable cost and schedule estimates by establishing a new, independent director of cost assessment to ensure that unbiased data is available for senior DoD managers;
Address problems with the use of immature technologies by requiring the Director of Defense Research and Engineering to periodically review and assess the maturity of critical technologies and by directing the Department to make greater use of prototypes, including competitive prototypes, to prove that new technologies work before trying to produce them; and
Address problems with costly changes in the middle of a program by tightening the so-called “Nunn-McCurdy” requirements for underperforming programs.
Excerpts from Bill Signing Ceremony Press Release – May 22, 2009 5

6. Impact of Acquisition Reform Legislation on Early Acquisition Policy
Establishes Director, Systems Engineering (D, SE) and Director, Developmental Test and Evaluation (D, DT&E) as principal advisors to the Secretary of Defense and the USD(AT&L) on systems engineering and development planning and on developmental T&E, respectively
Mandates documented assessment of technological maturity and integration risk of critical technologies for MDAPs during the Technology Development (TD) phase
Establishes D, DT&E and D, SE joint tracking and Congressional reporting on MDAP achievement of measurable performance criteria
Mandates competitive prototyping and MDA completion of a formal Post-Preliminary Design Review Assessment for all MDAPs before MS B; additional MDA certification to both at MS B
Strengthens technical analysis of cost and schedule breaches during the Technology Development (pre-MS B) and the Engineering and Manufacturing Development (post-MS B) phases

7. Acquisition Lifecycle Comparisons
Defense Acquisition Management System, May 12, 2003 A B C
(Program Initiation)
System Development and Demonstration
Concept Refinement
Technology Development
Production and Deployment
Operations and Support
Design
Readiness Review
Full-Rate
Production Decision
Review
Concept Decision
Defense Acquisition Management System, December 8, 2008 A B C
(Program Initiation)
Materiel Solution Analysis
Engineering and Manufacturing Development
Production and Deployment
Technology Development
Operations and Support
FRP Decision
Review
PDR
PDR
CDR
Materiel Development Decision
PDR after B w/ Post-PDR Assessment
Post-CDR Assessment Or
Defense Acquisition Management System, May 22, 2009 A
Technology Development B C
(Program Initiation)
Technological Maturity and Integration Risk Assessment
Materiel Solution Analysis
Engineering and Manufacturing Development
Production and Deployment
Operations and Support
FRP Decision
Review
Competitive
Prototyping
PDR
CDR
Materiel Development Decision
Post-PDR Assessment
Post-CDR Assessment 7

8. DoD 5000.02 and PL 111-23 Change the Early Acquisition Landscape
New 2366a & 2366b Certifications
LCSP
PDR
CDR
Materiel Development Decision (MDD)
Renewed emphasis on manufacturing across the lifecycle
PDR, PDR Report to the MDA, and Post-PDR-Assessment
System-level CDR with an initial product baseline and a Post-CDR Report to the MDA
Competitive
Prototypes
Post-CDR Assessment by the MDA between EMD sub- phases
What are the implications of these changes for programs and SEs?
How can systems engineering enable the program during this early phase?

9. What This Means for Systems Engineers
Systems engineering is now recognized in law as inherently necessary in requirements definition, development planning, and early acquisition
Need for and focus of all engineering in the “pre-acquisition” phases (Materiel Decision Analysis and Technology Development) is dramatically altered:
Earlier engineering involvement (well before Milestone A)
More government expertise to plan for and oversee requirements definition, technology maturation, and competitive prototyping leading to fully expressed system design (the allocated baseline) at the system-level Preliminary Design Review

10. New Challenges for Programs
Need for Program Office formation and PM skill-sets after MDD and prior to MS A
Increased importance of the Technology Development Strategy (TDS) (as a surrogate Acquisition Strategy) at MS A
Schedule and funding shifts – EMD into TD
Earlier engagement with industry and different contracting strategies for technology maturation, competitive prototyping, data rights, PDR before MS B, etc.
Explicit need for earlier, formal SE process application (e.g., data, configuration, and risk management)

11. DDR&E Organization Director, Defense Research and Engineering (DDR&E)
Honorable Zachary J. Lemnios
Director, Research
Dr. David Honey
Principal Deputy Dr. André van Tilborg
Director,
Systems Engineering
Mr. Stephen Welby
Principal Deputy Mr. Terry Jaggers
Rapid Fielding
Mr. Earl Wyatt
Principal Deputy Mr. Ben Riley
Director, Developmental Test & Evaluation (DT&E)
Mr. Chris DiPetto (Acting)
Principal Deputy Mr. Chris DiPetto
Defense Advanced Research Projects Agency (DARPA)
Dr. Regina Dugan
Defense Technical Information Center (DTIC)
Mr. Paul Ryan
Principal Deputy
Mr. Alan R. Shaffer

12. New Emphasis on Development Planning and Early SEC
CBA B
ICD
Technology
Development
Engineering and Manufacturing Development
Production and Deployment
Materiel
Solution
Analysis
MDD
CPD
CDD
O&S
FRP DR
PDR
CDR
Development Planning
Development SE
DP (Early SE)
LCS
DT&E
DP: Development Planning
DT&E: Developmental Test and Evaluation
LCS: Life Cycle Sustainment
SE: System Engineering
CBA: Capabilities Based Assessment
CDD: Capability Development Document
CPD: Capability Production Document
ICD: Initial Capabilities Document
MDD: Materiel Development Decision

13. Development Planning and Early SE Critical Activities
MDD A B
CBA
ICD
Materiel Solution Analysis
CDD
Technology Development
SE Input to MDD
Engagement in AoA
Engineering Analysis
CONOPS
Awareness of Strategic Context
Engagement with S&T
Engagement with JCIDS
Guidance
Plan
Analysis Activity
Report
Consideration of SOS/Interdependency, Interoperability Context
SEP for Milestone A
Input to TDS (CTE, CPI), TES, CCE
SE in TD Contract Requirements
Tech Reviews (ASR, Early SE Requirements)
Prototyping & Risk Reduction
Prototyping (Technology and Design)
CTE TRL Maturation
Trade Studies
SE Support for Technology Risk Reduction
Oversight of Competitive Designs
Risk Assessment
Input to Acquisition/ Planning, CARD, Budget & Other
SE in Contract Requirements
SE into the PDR Report to MDA, Acquisition Strategy, TEMP, CARD, and ICE
Evidence of Strong SE Activity
PDR and PDR Report and Assessment
Technical Reviews up to and including PDR
Systems Engineering Plan
Strong Reliability, Availability and Maintainability (RAM)
Inputs to Requirements
System Requirements Definition
RAM and Sustainability
Requirements Traceability Matrices
Translation of Requirements to Contract
Capability Development Document (CDD)
*Reference DAG Sections and

14. The Milestone A Planning Challenge
Documents / activities / data requiring technical input from the Systems Engineer before Milestone A:
Analysis of Alternatives
Technology Development Strategy
Critical Program Information
Technology maturation plans
Competitive Prototyping plans
Net-Centric Data Strategy
Market Research
Data Management Strategy
Component Cost Estimate
Systems Engineering Plan
Test and Evaluation Strategy
The PM’s Dilemma: Where to find the data!?

15. Why Is This Hard?
Program offices (both government and contractor) have very little experience with pre-MS B systems engineering activities
The DAG guidance is voluminous – online resource with over 750 printed pages in recent revision
Program offices have limited understanding about interdependencies within the DAG guidance
New implementing policy and DAG guidance in response to PL will not be available immediately

16. New Challenges for SEPs
Explicit technical planning for the Technology Development phase at Milestone A (and subsequent Milestones) including:
Technology maturation
Competitive prototyping
Manufacturing readiness as assessed in Tech Reviews
Critical Program Information in design
Item Unique Identification (IUID) planning
Integration of RAM and HSI with SE
Role of Component Configuration Steering Board relative to requirements and configuration management processes
Mandatory system-level PDR before MS B for MDAPs and rationale for its placement before or after Milestone B for non-MDAPs
PDR Report to the MDA either side of MS B
Post-PDR Assessment by the MDA for MDAPs or if PDR after MS B
Mandatory system-level CDR
Post-CDR Report to and Assessment by the MDA followed by an ADM
IUID Implementation Plan as SEP Annex at Milestones B and C

17. SE Policy & Guidance Some Activities
[Re] Adopted ISO/IEC Standards into ASSIST
15288 [SE], [SWE, in progress], [Risk], [Measurement], [IEEE 1220]
Reviewed ISO drafts
[[in JTC1/SC7 for Systems & Software Engineering]
24748 [guide for Life cycle management, [guide to 15288[,
29148 [Requirements engineering]
Reviewed GEIA/EIA drafts
EIA-649 STD and HDBK
GEIA-Std-927
Under development in SESS [DDRE/SE approves]
MIL-STD-189A Reliability Growth Management
Mil-Std Engineering drawings
Other
Updated earlier cancellation of Mil-Std-973 to note that EIA-649 is a good alternative
Adopted ANSI/GEIA-STD-0009 [Reliability]
led update of SEMP DID; ready to be posted in ASSIST
In process guide updates: SEP Prep, SE in Contracting, IMP/IMS, Risk Mgt, DAG/SE

18. SE Policy and Guidance Structure
DoD
Data Flow:
Acquisition Policy
Defense Acq Guidebook
Chapter 4 SE
Chapter 8
Security
Policy-specific guidance linked to . . .
M&S Guidance
Risk Mgmt Guide
“Wall Chart”
PPP
DoDI
. . . all other relevant guidance
DoD M&S Mgt DoDD
SE Slide Rule
SEP Prep Guide
Systems Assurance
Guide
Safety/ESOH Guides
DoD M&S VV&A
DoDI
DM Guide
DTM
Supply Chain Risk
Management
EW and C2W Countermeasures
DoDD
Safety MIL-STD-882D
Functional
Architecture
Development
Guide
RAM Guide
RAM-C
Rationale Report
Manual
Contracting for
SE Guide
PPP Prep Guide
DoD IA
DoDD E
Tech Review Guide
CPI Security Classification Guide
SOS SE Guide
Interoperability &
Supportability of IT &
NSS DoDD
CM Mil Hbk 61A
IMP/IMS Guide
Planned
CPI Identification Tool
WBS Mil Hbk 881
Extent
MOSA Guide
Acq Security-Related
Policies & Issuances
Tool
Other Standards &
Mil Handbooks
PP Contract Language Compendium
Other Design
Consideration Guides

19. <Gordon.Kranz@osd.mil>
If any who review this presentation have questions, feel free to contact Gordon Kranz at: