1. Milestone A to Milestone B Requirements Management Activities
Candidates: FVL, LRSB, LCS, JSF
June 7, 2016

2. Lesson Objective
Assess the major requirements management activities during the Technology Maturation & Risk Reduction (TMRR) Phase, including the CDD Validation Decision, Development RFP Release Decision, and Milestone B
Explain the purpose and major activities of the TMRR phase and the links between those activities
Describe the decisions the Milestone Decision Authority (MDA) makes and what the MDA approves at Milestone B

3. Milestone A to Milestone B Requirements Management Activities
Development RFP Release Decision
Purpose: Reduce risk
Major activity: Competitive prototyping
PDR
TRA
CDD
Technology Maturation & Risk Reduction (TMRR)
CDD Validation
Source Selection
Contract(s)
Final
RFP
TMRR Phase
Draft A
EMD Phase B
SRR
SFR
Requirements Management Activities
Update:
Draft CDD to final validated CDD
CONOPS & OMS/MP
Participate in
IPTs and Technical Reviews
Preliminary Design Review (PDR)
Configuration Steering Board (CSB)
Milestone & Decision Reviews
Monitor/provide input
Update of Acquisition Strategy, TEMP, SEP, LCSP, ISP, RAM-C Report, Cyber Security Strategy, and other milestone documents
AoA update
PPBE process
Cost Estimate and Affordability Caps
Test and Evaluation: DT/Early Operational Assessments (EOAs)

4. Technical Reviews During Phases of the Acquisition Process
Model 1, Hardware Intensive Program
Materiel
Development
Decision
CDD
Validation
Development RFP Release Decision
Full-Rate
Production A B C
LRIP
Materiel Solution Analysis
Technology Maturation &
Risk Reduction
Engineering & Manufacturing Development
Production & Deployment
Operations &
Support
OT&E
ASR
SRR
SFR
PDR
CDR
SVR/
FCA
PRR
PCA
ISR
TRR
AOTR
OTRR
Legend
AOTR – Assessment of Operational Test Readiness
ASR – Alternative Systems Review
CDD – Capability Development Document
CDR – Critical Design Review
FCA – Functional Configuration Audit
ISR – In-Service Review
LRIP – Low-Rate Initial Production
OT&E – Operational Test & Evaluation
OTRR – Operational Test Readiness Review
PCA – Physical Configuration Audit
PDR – Preliminary Design Review
PRR – Production Readiness Review
RFP – Request for Proposals
SFR – System Functional Review
SVR – System Verification Review
TRR – Test Readiness Review
Mandatory
Technical Reviews
Best Practice
Technical Reviews
Test Reviews
For additional information, see Teaching Note, Technical Reviews, posted to the student reference folder and the RM CoP

5. CDD Validation
Precedes the Development RFP Release Decision and provides a basis for preliminary design activities and the PDR that will occur prior to Milestone B unless waived by the MDA.
The MDA (and CAE when the MDA is the DAE) participates in the review and staffing of the CDD, to ensure that requirements are technically achievable, affordable, and testable, and that requirements trades are fully informed by a systems engineering trade-off analyses.
JCIDS Manual provides for CDD staffing with the MDA
PM and RM must coordinate on all requirements trades

6. Configuration Steering Board (CSB)
After CDD Validation, the CAE forms and chairs a CSB.
Members: Senior representatives from the office of the USD(AT&L), Joint Staff (J8), DoD CIO, Service Chief of Staff and Comptroller, Military Deputy to the CAE, the PEO, and other representatives as appropriate.
Program requirements come under CSB cognizance upon receipt of a validated CDD before the Development RFP Release Decision Point.
The PM, in consultation with the PEO and requirements sponsor, will, at least annually, identify and propose to the CSB a set of descoping options that reduce program cost and/or moderate requirements, and changes needed to respond to the threat
CSB will recommend to the Component requirements validation authority and the MDA which descoping options should be implemented
DoDI requires a CSB for ACAT I and IA programs, and indicates that Components should form CSBs for lower ACAT programs

7. Preliminary Design Review (PDR)
Unless waived by the MDA, a PDR will occur before Milestone B and prior to contract award for EMD (timing relative to DRFPRD at Component discretion).
Purpose: Provides the acquisition community, end user, and other stakeholders with an opportunity to understand the trade studies conducted during the preliminary design, and confirm that design decisions are consistent with the user’s performance and schedule needs.
Outcome: Confirms that the preliminary design satisfies the operational and suitability requirements of the draft CDD.

8. Development RFP Release Decision (DRFPRD)
Purpose: Ensure that prior to release of final RFP for EMD that an executable and affordable program has been planned. The “critical decision point” in an acquisition program.
MDA signs ADM that:
Approves the Acquisition Strategy
Authorizes release of the RFP and source selection for EMD; may have LRIP options
Determines preliminary LRIP quantities for ACAT I & II programs
Documents criteria required for Milestone C (needed testing; affordability; FYDP funding)
Requires validated CDD

9. Technology Readiness Assessment (TRA)
TRA assesses maturity of, and risk associated with Critical technologies to be used in an MDAP
TRA plan is prepared by PM; approved by PEO, CAE and ASD(R&E).
Conducted by Subject Matter Experts independent of PMO, but assigned by PM.
Required for MDAPs for Sec. 2366b cert at Milestone B
TRA results are included in CDD
ASD(R&E) provides MDA an independent assessment and review of the TRA final report as to whether technology was demonstrated in relevant environment
Technology Readiness Levels (TRLs) are knowledge-based standard but not a substitute for professional judgment
Critical technologies are those that may pose major technological risk during development, particularly during the EMD phase of acquisition. (DoD TRA Guidance, April 2011, revised 13 May 2011)

10. Technology Readiness Levels (TRLs)
Actual system proven through successful mission operations
System Test, Launch & Operations
System/Subsystem Development
Technology Demonstration
Technology Development
Research to Prove Feasibility
Basic Technology Research
TRL 9
TRL 8
TRL 7
TRL 6
TRL 5
TRL 4
TRL 3
TRL 2
TRL 1
Basic principles observed and reported
Technology concept and/or application formulated
Analytical and experimental critical function and/or characteristic proof-of-concept
Component and/or breadboard validation in laboratory environment
Component and/or breadboard validation in relevant environment
System/subsystem model or prototype demonstration in a “relevant environment” (2366b certification item - Milestone B)
System prototype demonstration in a operational environment (Milestone C)
Actual system completed and qualified through test and demonstration (Full-Rate Production Decision)
Public law requires MDAPs be at TRL 6 for Milestone B

11. Milestone B MDA Approves:
LRIP Quantity or limited fielding scope (if not previously approved at DRFPRD)
Exit criteria for leaving EMD and entering next phase (if not previously approved at DRFPRD)
APB (includes affordability caps)
2366b Certifications and Declarations
ADM to document decisions
Formal Program Initiation (most programs) with approval of the Acquisition Program Baseline (APB)
Authorizes entry into EMD phase and award of contracts for EMD
Most Milestone B documentation requirements will have been satisfied at the Development RFP Release Decision (DRFPRD)
Any significant changes since DRFPRD must be provided to the MDA
Commits required investment resources to program
Requires validated CDD, and
Full Funding in the Future Years Defense Program (FYDP)

12. 10 USC 2366b Requirements at Milestone B
Certification CERTIFICATIONS AND DETERMINATION REQUIRED.—A major defense acquisition program may not receive Milestone B approval until the milestone decision authority—
(1) has received a preliminary design review and conducted a formal post-preliminary design review assessment, and certifies on the basis of such assessment that the program demonstrates a high likelihood of accomplishing its intended mission;
(2) further certifies that the technology in the program has been demonstrated in a relevant environment, as determined by the milestone decision authority on the basis of an independent review and assessment by the Assistant Secretary of Defense for Research and Engineering, in consultation with the Deputy Assistant Secretary of Defense for Developmental Test and Evaluation;
(3) Has received a business case analysis and certifies on the basis of that analysis that determines in writing that—
(A) the program is affordable when considering the ability of the Department of Defense to accomplish the program’s mission using alternative systems;
(B) appropriate trade-offs among cost, schedule, technical feasibility, and performance objectives have been made to ensure that the program is affordable when considering the per unit cost and the total acquisition cost in the context of the total resources available during the period covered by the future-years defense program submitted during the fiscal year in which the certification is made;
Changes made by NDAA 2016

13. 10 USC 2366b Requirements at Milestone B cont..
(C) reasonable cost and schedule estimates have been developed to execute, with the concurrence of the Director of Cost Assessment and Program Evaluation, the product development and production plan under the program; and
(D) funding is available to execute the product development and production plan under the program, through the period covered by the future-years defense program submitted during the fiscal year in which the certification is made, consistent with the estimates described in subparagraph (C) for the program;
(E) appropriate market research has been conducted prior to technology development to reduce duplication of existing technology and products;
(F) the Department of Defense has completed an analysis of alternatives with respect to the program;
(G) the Joint Requirements Oversight Council has accomplished its duties with respect to the program pursuant to section 181(b) of this title, including an analysis of the operational requirements for the program;
(H) life-cycle sustainment planning, including corrosion prevention and mitigation planning, has identified and evaluated relevant sustainment costs throughout development, production, operation, sustainment, and disposal of the program, and any alternatives, and that such costs are reasonable and have been accurately estimated;
Changes made by NDAA 2016

14. 10 USC 2366b Requirements at Milestone B cont..
(I) an estimate has been made of the requirements for core logistics capabilities and the associated sustaining workloads required to support such requirements;
(J) there is a plan to mitigate and account for any costs in connection with any anticipated de-certification of cryptographic systems and components during the production and procurement of the major defense acquisition program to be acquired;
(K) the program complies with all relevant policies, regulations, and directives of the Department of Defense; and
(L) the Secretary of the military department concerned and the Chief of the armed force concerned concur in the trade-offs made in accordance with subparagraph (B); and
(4) in the case of a space system, performs a cost benefit analysis for any new or follow-on satellite system using a dedicated ground control system instead of a shared ground control system, except that no cost benefit analysis is required to be performed under this paragraph for any Milestone B approval of a space system after December 31, 2019
Changes made by NDAA 2016

15. Takeaway: Linkage - CDD, APB, TEMP & Contracts for TMRR & EMD
Milestone A
Milestone B
Cost Estimate & $$
Competitive
Designs &
Prototypes DT
TEMP
COIs, MOEs,
MOPs, CTPs
EMD
Contract(s)
Draft
CDD
Contract(s)
Validated
CDD
AoA
Update
SPECs
“design-to”
TMRR
KPPs
KSAs
Final
RFP
TMRR
Final
RFP
EMD
MOEs
MOPs
KPPs
KSAs
APB
KPPs
Source Selection
Source Selection
Configuration Steering Board Established
Technology Maturation & Risk Reduction Phase

16. Back Up

17. Useful Links:
Picture - Integration Readiness Level (IRL), 8 Mar 2016.jpg
Picture - Manufacturing Readiness Level (MRL), 8 Mar 2016.jpg
Platinum Card Full Size Jan 2016_v3.pptx
Platinum Card Small Size Jan 2016 v3.pptx