1. FCS ACQUISITION & EVALUATION TEAMING
Army Test and Evaluation Command

2. Evaluation Strategy Elements FCS MISSION Capabilities & Limitations By
(Platforms, Networks, …)
FCS
MISSION
MOPs/MOEs
Element Level
(ORD, Spec)
MOPs/MOEs
FoS/SoS Level
(ORD, Spec,
KPP, COIC)
Mission Threads
(O&O)
Decomposition
M&S
Data TT OT
Core
Compl
Systems
Element Level
Cap/Lim
E, s, s, + Unks
S, S, +Unks
M&S
Red
FCS FoS/SoS
Cap/Lim
E, s, s, + Unks
SoS,
S, S, + Unks
Joint/
Compl
Systems
S, S, +Unks
M&S
Cap/Lim By
Mission +
Unks
Sensitivity Analyses By
Thread
Mission,
S, S, + Unks
Blue
Capabilities
&
Limitations By
Mission +
Unks
Updated as Systems Mature

3. Traditional Acquisition Program
Mission
Mission Capability Exists
“PROXY”
Issues
Fielded Unit
Effective Suitable Survivable, KPP’s COIC’s, ORD Requirements
New
Equipment

4. FCS Acquisition Program
Mission
Relates To Warfighter Needs
Relates To Identified Criteria
Capabilities
Effective Suitable Survivable, KPP’s COIC’s, ORD Requirements
New Fielded Unit

5. ATEC’s Role Independent Evaluator For FCS
Develop MOEs And MOPs To Support Platform And FoS/SoS Assessment Of:
Specs
ORD Requirements
KPPs
COICs
Address The Capabilities & Limitations Of The FCS Enabled UA Mission Accomplishment
Produce An Evaluation Of Whether The FCS FOS, In The Context Of The UA, Is Effective, Suitable, And Survivable
Work In A Collaborative Environment To Maximize Commonality Of Resources & Ensure The Success Of FCS

6. Unmanned Ground Systems
CTO Organization
Primary Functional Management Location
Director
ATEC Deputy Director
Aberdeen Proving Ground, Maryland
National Capital Region
Warren, Michigan
Picatinny, New Jersey
Ft. Monmouth, New Jersey
Huntsville, Alabama
LSI Deputy Director
PMO Deputy Director
St. Louis Office
Evaluation
Liaison
Cell
Analysis
Support
System of System Level
Test Planning,
Integration,
& Execution
Test
Assessment &
Reporting
Test
Support &
Facilities
M&S/T&E
Integration
Test
Resources
Product
Assurance
& Verification
System Level
C4ISR
Manned
Combat
Systems
Unmanned Ground Systems
Unmanned
Aerial
Systems
Lethality/
Munitions
Complementary
Systems
Test Integration
Field Offices
Ft. Huachuca
WSMR
UAMBL
YPG
Ft. Hood

7. COLLABORATION PROCESS
Combat Developer Defines Scenarios And Vignettes
O&O,
ORD
FCS That Meets User’s Needs Within A Shortened Acquisition Cycle
Mission Decomposition: Detailed Look at User Intent And How FCS Enabled Unit Of Action Will Fight
PM/LSI:
SoS Spec,
FCS Design
O&O,
ORD, Spec, Mission Decomp
O&O,
ORD, Spec, Mission Decomp, T&E Plans
ATEC:
Evaluation Plan to Assess Capabilities & Limitations
Plan Together, Test Once, Share the Data

8. Evaluation Strategy Elements FCS MISSION Capabilities & Limitations By
(Platforms, Networks, …)
FCS
MISSION
MOPs/MOEs
Element Level
(ORD, Spec)
MOPs/MOEs
FoS/SoS Level
(ORD, Spec,
KPP, COIC)
Mission Threads
(O&O)
Decomposition
M&S
Data TT OT
Core
Compl
Systems
Element Level
Cap/Lim
E, s, s, + Unks
S, S, +Unks
M&S
Red
FCS FoS/SoS
Cap/Lim
E, s, s, + Unks
SoS,
S, S, + Unks
Joint/
Compl
Systems
S, S, +Unks
M&S
Cap/Lim By
Mission +
Unks
Sensitivity Analyses By
Thread
Mission,
S, S, + Unks
Blue
Capabilities
&
Limitations By
Mission +
Unks
Updated as Systems Mature

9. Platform/FoS/SoS Capabilities/Limitations
MOEs, MOPs Based On COIs, ORD, KPP, AIs
Platform Level
Based On Unique Platform Requirements
FoS/SoS Level
Based On Synergistic Effects Of Multiple Platforms
Focused On FCS’ Contributions To Capabilities
Requires Complimentary Systems To Execute FCS Test
Basis To Determine Capabilities And Limitations At All Levels

10. Evaluation Strategy Elements FCS MISSION Capabilities & Limitations By
(Platforms, Networks, …)
FCS
MISSION
MOPs/MOEs
Element Level
(ORD, Spec)
MOPs/MOEs
FoS/SoS Level
(ORD, Spec,
KPP, COIC)
Mission Threads
(O&O)
Decomposition
M&S
Data TT OT
Core
Compl
Systems
Element Level
Cap/Lim
E, s, s, + Unks
S, S, +Unks
M&S
Red
FCS FoS/SoS
Cap/Lim
E, s, s, + Unks
SoS,
S, S, + Unks
Joint/
Compl
Systems
S, S, +Unks
M&S
Cap/Lim By
Mission +
Unks
Sensitivity Analyses By
Thread
Mission,
S, S, + Unks
Blue
Capabilities
&
Limitations By
Mission +
Unks
Updated as Systems Mature

11. Mission Capabilities & Limitations
MOEs, MOPs Based on O&O, ORD,
Based On Live, Virtual & Constructive Events
Utilize Mission Decomposition Process To:
Assist In OT Planning
Correlate Capabilities And Limitations At Platform, FoS & SoS To Required Tasks
Determine Requirements For Force Effectiveness M&S
Focused On FCS Contributions To Mission
Sensitivity Analyses Conducted To:
Determine If Other FCS Or Complimentary Systems May Alleviate Shortfalls In Capabilities Caused By:
Technical Limitations
Environmental Influences (Including Threat Effects) …
Enable Army Examination Of Alternate Scenarios/ Red Responses

12. Mission Decomposition
Missions
Tasks
Achieve air superiority
Destroy WMD capability
Facilitate control of energy centers
Destroy resisting Rebel forces
JTF
TASKS
Destroy WMD
Seize oil and gas pipelines and prod facilities
Seize the RHC fac of the IFP mil forces
Seize vital infrastructure with min coll damage
Facilitate the transition of power
Destroy Rebel forces in zone
JFLCC
TASKS
Seize RHC fac with min coll damage
Defeat Rebel forces W&S/W of Baku
Conduct vertical maneuver to Baku
UE1
TASKS
Establish multiple FOBs, on order conduct
handover FOB security to 3d BN 504 PIR
Defeat rebel forces W/SW of Baku
Secure OBJ CAMEL
UA1
UA1
TASKS
Defeat enemy forces withdrawing to Baku
Seize bridge vic OBJ BISHOP
Conduct air assault with 1 dismounted INF CO
CAB2
TASKS

13. Task Decomposition CAB2 Tasks AUTL Task AUTL Sub-tasks Lower AUTLTasks
Missions
Tasks
CAB2 Tasks
Defeat enemy forces withdrawing to Baku
Seize bridge vic OBJ BISHOP
Conduct air assault with 1 dismounted INF CO
TASKS
AUTL Task
TASKS
ART Conduct an Attack
TA 1 Deploy Conduct Maneuver
TA 2 Develop Intel
TA 3 Employ Firepower
TA 5 Exercise C2
AUTL
Sub-tasks
TASKS
ART Collect Relevant Information
ART Display COP Tailored to User Needs
ART Disseminate a COP & Execution Info
ART Process Relevant Information to Create a COP
Lower
AUTLTasks
TASKS
Conduct UAV Flight Operations
Conduct GCS (C2V) mission activities
Conduct Autonomous Surveillance
MTP Tasks
TASKS

14. FCS Task to Functional Capability Mapping
Tasks
Capabilities

15. FCS Functional Capability to ORD Requirements
Tasks
Capabilities

16. FCS ORD Requirements to Materiel
Capabilities
Materiel

17. Capabilities/Limitations Assessed At All Levels
JTF Mission
JFLCC Task
UE Task
UA Task
FCS Task
Platform Task
Subsystem Task
UA Mission Capabilities/Lim
UA Level
(Mission)
As defined
in O&O
FoS/SoS Capabilities/Lim
FoS/SoS
Level
Platform Capabilities/Lim
Platform
Level
Decomposition
As defined in
COIC, KPP,
ORD
………
As defined
in ORD, Spec

18. Example Feedback to Be Provided to TRADOC and LSI Systems Engineering as a Result of this Endeavor thus far:
ORD  ”FCS FoS systems must be capable of automated precision engagements with automated fire control, distribution and clearance procedures with a manual back-up. (Threshold).” Rational paragraph indicates requirement enables “rapid selection of high payoff and most dangerous targets while static or moving”.
SOS Spec - no capability at SOS level in spec for “rapid selection of high payoff and most dangerous targets while static or moving”; only addresses “rapid selection of high payoff and most dangerous targets” in paragraph and for threshold and objective requirements for MCS (ORD 3407) MCS. SOS Spec does not include ORD 3825 which indicates selection of high payoff targets requirement for ICV.
ORD 1159 – “FCS systems must accomplish position/navigation (horizontal and vertical) to a one meter Spherical Error Probable (SEP) with a Low Probability of Detection (LPD)/ Interception (LPI) and in the presence of electronic jamming. (Objective)”
SOS Spec - ( ) identifies requirement as Objective. Only other references to navigation are kit to enable legacy systems to be interoperable; auto navigation for UAS CL I; – UGS position themselves; directly enables 18 tasks from 3 missions, indirectly enables 37 tasks from 3 missions
O&O (SORC) – Required Capability - Terrain Analysis. ORD addresses in – no ORD Reference number; addresses in Appendix H, ; Appendix F, Table 302; Appendix J IERs.
SOS Spec – could not find any reference to requirement for terrain analysis; directly enables 21 tasks from 3 missions, indirectly enables 35 tasks from 3 missions

19. Applying Mission Decomposition & Capability Mapping to Construct Operational Test Events Sample Application

20. UA Missions in OT SoSIL Virtual Loop Live Loop System Task 1 Task 2
Unit
Mission
Lane
C2V
Task 1
Task 2
Task 3
NLOS-C
Task 1
Task 2
Task 3
SoSIL
Unit
Mission
Lane
Larger Unit
Mission
Lane
Task 1
Task 2
Task 3
Task 1
Task 2
Task 3
CL III UAS
MCS
Task 1
Task 2
Task 3
Unit
Mission
Lane
Task 1
Task 2
Task 3
SUGV
Virtual Loop
Live Loop

21. Sample Task Set Applied OT Model
C2V
Unit
Mission
Lane
Conduct
Zone Recon
MTP Conduct UAV Flight Operations
MTP CGS Mission Activities
ART Collect Relevant Information
ART Disseminate COP & Execution Information
ART Process Relevant Information to create COP
RECON
System
Task 1
Task 2
Task 3
Unit
Mission
Lane
Unit
Mission
Lane
ART Conduct Surface to Surface Atk
MTP Conduct UAV Flight Operations
NLOS C
CL III UAS
ART Display COP Tailored to User Needs
ART Collect Relevant Information
3.3.1
Conduct Lethal FS
NLOS
C2V
Task 1
Task 2
Task 3
NLOS C
Task 1
Task 2
Task 3
SoSIL
Unit
Mission
Lane
ART 8.1.2
Conduct an
Attack
Larger Unit
Mission
Lane
Task 1
Task 2
Task 3
Unit
Mission
Lane
MCS
XX-XX Conduct Autonomous Surveillance
SUGV
8.5.1 Attack By Fire an Enemy Force /Position
ART Collect Relevant Information
ART Display COP Tailored to User Needs
ART Conduct Lethal Direct Fire Against a Surface Target
Task 1
Task 2
Task 3
CL III UAS
MCS
Task 1
Task 2
Task 3
Unit
Mission
Lane
Task 1
Task 2
Task 3
SUGV
Virtual Loop
Live Loop

22. Evaluation Strategy Example
Platforms
FCS
MISSION
MOPs/MOEs
Platform Level
(ORD, Spec)
MOPs/MOEs
FoS/SoS Level
(ORD, Spec,
KPP, COIC)
Mission Threads
(O&O)
Decomposition
M&S
Data TT OT
Red
Blue
Mission Delayed Awaiting Ground Sensor for NLOS
Capabilities
&
Limitations By
Mission +
Unks
UAV Cannot Be used as Sensor for NLOS in the precision mode
Cap/Lim By
Mission +
Unks
Mission,
S, S, + Unks
Core
Compl
Systems
Element Level
Cap/Lim
E, s, s, + Unks
S, S, +Unks
M&S
UAV TLE =120M
NLOS = 25M CEP
FCS FoS/SoS
Cap/Lim
E, s, s, + Unks
SoS,
S, S, + Unks
Joint/
Compl
Systems
S, S, +Unks
M&S
Comanche Provide Location Accuracy for NLOS
Sensitivity Analyses By
Thread
Updated as Systems Mature

23. Evaluation Strategy Example
Platforms
FCS
MISSION
MOPs/MOEs
Platform Level
(ORD, Spec)
MOPs/MOEs
FoS/SoS Level
(ORD, Spec,
KPP, COIC)
Mission Threads
(O&O)
Decomposition
M&S
Data TT OT
Red
Blue
Manned Grnd Vehicle Protection Limited to 14.5mm
Capabilities
&
Limitations By
Mission +
Unks
Network Provides Enemy Location to Commander Prior to Engagement
Enemy Destroyed Out of Contact
Cap/Lim By
Mission +
Unks
Sensitivity Analyses By
Thread
Mission,
S, S, + Unks
Core
Compl
Systems
Element Level
Cap/Lim
E, s, s, + Unks
S, S, +Unks
M&S
FCS FoS/SoS
Cap/Lim
E, s, s, + Unks
SoS,
S, S, + Unks
Joint/
Compl
Systems
S, S, +Unks
M&S
WIN-T/JTRS Provides Connectivity
UAV Provides Enemy Location
Updated as Systems Mature

24. The Road Ahead TRADOC Complete Decomposition of 1st Mission
TRADOC, ATEC, PM/LSI Identify M&S Requirements
Develop Common Database For All Stakeholders
Identify All T&E Events
Include All Measures For Evaluation
Capabilities and Limitations Based
Evaluation of Data and Confidence Levels Continuously Updated

25. Backup

26. System of System Testing Integrated Evaluation Process
FCS Test Program Schedule
Production
System of System Testing
MS B Q2 Q3 Q4 Q1
FY2002
FY2003
FY2004
FY2005
FY2010
FY2006
FY2007
FY2008
FY2009
Demos
ASARC
CTD
Integrated Evaluation Process
TFT# S3
TFT# S2
LUT1
Log Demo
SDD
Integration
IT/UT
IP S2
IP S3
TRR
Spec Verif / Integr Qual Testing -SDD
Early Emulators
Deliveries
Sims
Init DP PIs
Spec Verif / Integr Verif Testing - Prod
LFT - FUSL
FY2012
FY2011
FOC
UA 1.6a
IP S4
Init Sys
FY2013
IP P1
Assessment
IP S1
SoSIL Dev
LUT2
TFT#S4
IP S5 **
IMT
Init SW
IP P2
** SW Testing only
Facilitization
LL IPR
Waiver
Initial Production
Decision
SoS CDR
IOC UA(-)
W/ILOs
SoS PDR
SFR
IOT
TFT#P1
LUT3
FDTE
Continuous Evaluation
TFT#P2
OE/CE
Alt 5A v

27. ORD - KPP Mapping

28. M&S In Support of Evaluation
Elements
(Platforms, Networks, )
FCS
MISSION
MOPs/MOEs
Element Level
(ORD, Spec)
MOPs/MOEs
FoS/SoS Level
(ORD, Spec,
KPP, COIC)
Mission Threads
(O&O)
Decomposition
HWIL
MIL
Digital
SWIL
SILs
PRO-E
BRL CAD
Element Level Models
Mobility (NATO Reference Model)
C4.(Comms, COP, FIRES)
ISR/Fusion
Synthetic Environment
Behavioral
Environ (Atmosphere, Propagation)
Threat (behavior, Platform, Signature)
Observable(Obscuration, Wx, Signature)
Core
Compl
Systems
Element Level
Cap/Lim
E, s, s, + Unks
HWIL
MIL
Digital
SWIL
SILs
SoSIL
Wrap-Around Sim
Red
FCS FoS/SoS
Cap/Lim
E, s, s, + Unks
Joint/
Compl
Systems
SoSIL
Wrap-Around Sim
Federated Battle Labs
Force-On-Force M&S
Cap/Lim By
Mission +
Unks
Sensitivity Analyses By
Thread
Blue
Capabilities
&
Limitations By
Mission +
Unks
Updated as Systems Mature

29. Instrumentation & Facilities In Support of Evaluation
Elements
(Platforms, Networks, etc.)
FCS
MISSION
MOPs/MOEs
Element Level
(ORD, Spec)
MOPs/MOEs
FoS/SoS Level
(ORD, Spec,
KPP, COIC)
Mission Threads
(O&O)
Decomposition
Platform Level,
Embedded
RTCA,
C3 Driver,
Embedded,
Field Data
Collection Systems
Core
Compl
Systems
Element Level
Cap/Lim
E, s, s, + Unks
Red
FCS FoS/SoS
Cap/Lim
E, s, s, + Unks
Joint/
Compl
Systems
RTCA,
Field Data
Collection Systems,
Large Scale Data
Integration
Cap/Lim By
Mission +
Unks
Sensitivity Analyses By
Thread
Blue
Capabilities
&
Limitations By
Mission +
Unks
Updated as Systems Mature