1. Modeling, Virtual Environments & Simulation Institute

2. The Beginning of MOVES
Started with NPSNET
MOVES began in 1996 with the MS degree program
Originally a mix of Computer Science and Operations Analysis
Ph.D. started in 1999
Became an Institute in 2000

3. MOVES History Formalized Body of Knowledge in 2006
Definition of graduate’s capabilities
Change in MOVES Navy sponsor 2009
Launched the Nation’s first Healthcare Simulation Master’s program 2011
2015 Marine Corps became Major Area sponsor of degree program
House resolution 487 passed recognizing
2007 “M&S Critical National Technology”
for defense and security
Recognized leadership role in the evolution of Modeling and Simulation as a research field and academic discipline.

4. Overview of MOVES (1 of 2) MOVES focus
The science and technology driving the development and novel application of M&S tools
Wide range of consumers:
Training, Analysis and Acquisition
Inherently interdisciplinary and user-centric
M&S is a growth industry
More consumers increase demand on M&S tools
Synchronize Education and Research
Powerful feedback process strengthens quality of both research and education

5. Overview of MOVES (2 of 2) MOVES strengths NPS environment
Ability to bridge the gap between technical and operational
Innovative and practical
Joint, Interagency, International
Independent and objective
Inherent understanding of the military domain/perspective
Close coupling of Research and Academic programs
Feedback from graduates
Informs curriculum evolution
Informs research direction
Partnership with key organizations
MCMSO
NMSO
ONR/NRL/ Navy Labs
TRAC – Evolution of next-generation M&S for analysis
USUHS – Medical

6. General Areas of Concentration
Human Systems and Training
Training system design and human factors
Human performance evaluation
Cognitive Agents, Agent Based Modeling and Adaptive Systems
Learning agents in rich environments
Predictive agents
Computer Gaming, Virtual Environments, Augmented Reality
Methods for game-based training design
Highly cost efficient software and simulation development
Mixed-mode, real and virtual, simulation environments
Simulation Modeling for Analysis
Composable models, large-scale reusability
Experimental designs for large studies
Constructive analytical simulations
Standards and Interoperability
Web-Based Simulation
Core competencies have (and continue to) evolve based on the expanding role of M&S.

7. Education Tied to MOVES
MOVES Degrees:
M.S. in MOVES
2 year resident program
Mainly officers – US and foreign
~230 graduates
Ph.D. in MOVES
3 year resident program
~ 20 graduates
Medical Modeling and Simulation Certificate
Introduced in 2011
1 year Asynchronous DL
Mainly uniformed healthcare professionals.
40+ graduates

8. MOVES Mission
“To enhance the operational effectiveness of our joint forces and our allies by providing superior training and analysis products, education, and exemplary research in the field of modeling and simulation.”
Maintain and expand a leadership role in the evolution of Modeling Simulation and Virtual Environments. Continually refine a Research Agenda and Academic Program to enable…
… Graduates effectively leading and managing M&S programs.

9. Research Supporting USMC
Falls into three major categories:
M&S and Training
M&S and Operational Support
M&S in Analysis
Includes
Investigating Sim base training design
Training effectiveness methodologies
Technological challenges in LVC
Three recent thesis in this area
M&S Operational support
Logistic process improvement
Developing deployable Sim based TBI assessment tool
Three recent thesis in this domain
Focus on improving representation of dynamic behaviors in analytical sims (such as COMBATXXI)
Long standing collaboration with CAB of OAD at CD&I
Three M.S. Theses and one Ph.D. dissertation in this area

10. Selected Other Projects
MMOWGLI
Modeling social systems
VR based training

11. Massively Multiplayer Online War Game Leveraging the Internet
Crowdsourcing methodology to foster innovation
Collaborative game structure
Web Application + Game design principles
Developed in collaboration with
ONR
Institute for the Future
Active partners:
NSWC Carderock
SPAWAR Atlantic

12. – Nobel Prize-Winning Economist Thomas Schelling
the challenge: an era of wicked problems…complex, open-ended, uncertain…characterized by shifting requirements and invisible interdependencies. In this context, a hierarchically driven, top down approach to thinking no longer works.
mmowgli is an online platform as well as a transformational practice that harnesses the potential of large, diverse groups for thinking and acting on emergent challenges and unmissable opportunities. mmowgli also builds the creative capacity of the crowd by offering a more gameful, more novel, and more democratized way of engaging together with a problem than traditional methods afford. mmowgli shifts our institutional thinking away from narrow practices that create inert, top down blueprints towards a new culture of continuous, non-hierarchical conversation around challenges and our collective response.
why we need this: “One thing a person cannot do, no matter how rigorous his analysis, or heroic his imagination, is to draw up a list of things that would never occur to him.”
– Nobel Prize-Winning Economist Thomas Schelling

13. Modeling Social Systems
Using Agent based models to better understand social dynamics
Focus on military/Stability operations
Help understand how social structures can change based on different types of influencers
Crowd modeling – investigate impact of crowds on operational effectiveness
Upcoming project for Marines to look at non-lethal weapons

14. Virtual Reality Based Training
Low cost ways to enhance training
Uses latest advances in VR
Supports SECNAV VE Vision

15. Modeling, Virtual Environments, and Simulation (MOVES) Curriculum 399

16. Topics Formal Stakeholders Curriculum Overview Review History
Program Assessment
ESRs
Matrix
Summary of Action Items

17. Curriculum Stakeholders
USMC – Major Area Sponsor (June 2015)
LtGen Robert Walsh – Commanding General, Marine Corps Combat Development Command (MCCDC)
Dr. George Akst, SES – Director, Operational Analysis Directorate, MCCDC
SME: Mr. Brett Telford – Director, Marine Corps Modeling and Simulation Office (MCMSO)
US Army – Co-Sponsor
LTG John Murray – Deputy Chief of Staff, FA57 Proponent (also FA49/OR and FA50/FM)
COL Joseph Nolan – Deputy Director AMSO
USN – Stakeholder: Ms. Amy Markowich - DoN Modeling and Simulation Executive
Dr. Ivar Oswalt for Mr. John Moore – Director Navy Modeling and Simulation Office (NMSO)
MCCDC COC was in Aug 2015
Mr. Mike Lamarche for Mr. Dennis Reed, Modeling and Simulation deputy for DoN

18. MOVES (399) Program Summary
Degree: Master of Science in MOVES
Graduate School of Operational and Information Science
Dean: Dr. Gordon McCormick, Associate: COL Nelson Emmons
Computer Science Department
Chair: Dr. Peter Denning
MOVES Academic Chair: Dr. Chris Darken
Program Officer: LCDR Eric McMullen
APC: 325
Subspecialty Code:
USMC: 8825, Modeling and Simulation Officer
USA: FA-57, Simulation Operations Officer
USN: 6202, MOVES
Program Length: 21 Months (Plus 3 mo. refresher)
Program Start: Fall (Summer)
Dr. Imre Balogh, Director of the MOVES Institute
LTC John Morgan, MILFAC and Deputy Director of MOVES
No change in APC

19. MOVES (399) Program Starts
Cohort
USMC
USA
Int’l
USN
Total
2010-1 3 5 14
2010-3 1 4
2011-1
2011-3
2012-1 6 10
2013-1 2 12
2014-1 7
2015-1
5 (+1 PhD)
2016-1 9
2017-1
(projected) 19 9

20. MOVES (399) Program Starts by Year
Grads
Incoming
1st Yr.
≈ 10

21. Program History
1996 – MOVES Degree established as degree program in CS
1998 – N6 (N2/N6) takes over sponsorship of degree
(2009 – Conducted last formal Curriculum Review)
1999 – MOVES Academic Group established
2000 – MOVES Institute established
2010 – USMC and US Army signs on as Co-Sponsors
2011:
N2/N6 zero’s out USN quotas for 2012 and beyond
Intends to drop sponsorship
Single cohort / year starts: USMC, USA, Internationals

22. History (continued) 2012-2015 – No formal MAS
2012 – Informal curriculum updates on input from USMC and USA co-sponsors
Program shortened from 8Q to 7Q (+ refresher)
2013
Last USN/6202P graduates
Recent: (‘14-’15)
MCCDC/MCMSO – agrees to sponsor
Conducts full top-bottom assessment of field requirements
MOVES curriculum works with MCMSO, AMSO, and NMSO to address assessment

23. MOVES Program Assessment
Conducted in 2014 by Johns Hopkins University/APL on contract from MCMSO / NMSO
Broad bottom-up survey of all USMC 8825 (M&S Officers)
Current job requirement
Important concepts to understand
Recall of classes taken in MOVES
MOVES team helped quantify level of mastery required
Result:
“Modeling, Virtual Environments, and Simulation Curriculum Assessment FY2015 Initial Assessment” (NSAD-R , Feb 2015)
Established baseline of 93 necessary “knowledge items” (“KI’s”) and level of mastery needed for each
KI’s grouped into eight ESRs
MOVES identified 30 total issues to address
Primarily: courses’ content and focus
Johns Hopkins University / Applied Physics Lab
Assessment technical lead was: Mr. Eric Whittington (MOVES grad)

24. Proposed ESRs Modeling & Simulation (M&S) Foundations M&S in the DoD
Capabilities, limitations, programming, statistics, AI, math
M&S in the DoD
Organizations, policies, VV&A, cyber security
Models and Modeling Techniques
Physics, culture, resolution, machine learning
Simulation Software Development
Military Applications
Training & analysis
Simulation Interoperability
Stand-alone and Distributed
Business Practices
Thesis

25. Current Curriculum Matrix
Refresher
Summer
(15.5 credit hrs.)
CSR-100 (2-2)
Refresher for Beginning Programming
MA-1113 (4-0)
Single Variable Calculus I
MA-2025 (4-1)
Logic and Discrete Mathematics
MA-1114 (4-0)
Single Variable Calculus II with Matrix Algebra
Quarter 1
Fall
(19.0 credit hrs.)
CS-2072 (4-2)
Object Oriented Programing in JavaScript
MV-3101 (4-0)
Intro to DoD Modeling and Simulation
MA-3042 (4-0)
Linear Algebra
OS-3111 (4-0)
Probability & Statistics
for HSI and MOVES
MV-2921 (2-0)
Intro to MOVES
Quarter 2
Winter
(20.0 credit hrs.)
CS-2173 (4-2)
Java as a Second Language
MV-3202 (3-2)
Intro to Computer Graphics
MV-3025 (4-1)
Artificial Intelligence
for Simulation
OS-3113 (4-1)
Data Analysis for HSI and MOVES
MV-3922 (2-0)
Intro to Virtual Environment Tech.
Quarter 3
Spring
(20.5 credit hrs.)
CS-3600 (4-2)
Intro to Computer Security
MV-3302 (4-1)
Intro to Discrete Event Modeling
MV-3203 (3-2)
Graphical Simulation
OS-3112 (4-2)
Statistics and Design of Experiments
MV-3923 (2-0)
Intro to Research in MOVES
Quarter 4
(18.0 credit hrs.)
MV-4025 (3-2)
Cognitive and Behavioral Modeling for Sims
MV-4002 (4-1)
Simulation and Training
MV-4502 (2-4)
Simulation Development Practicum
MV-3500 (3-2)
Internetwork Comms
and Simulation
MV-4924 (1-1)
Research Seminar in MOVES
Quarter 5
OA/MV46XX (4-0)
Intro to Joint Combat Modeling
MV-4503 (2-4)
Sim. Interoperability Practicum
MV-4920 (4-0)
Advanced Topics in Modeling and Sim.
MV-4001 (4-1)
Human Factors of Virtual Environments
Quarter 6
MV-4501 (2-4)
Simulation Application Practicum
MN-3331 (5-1)
Principles of Acquisition and Program Mgmt.
MV-4657 (3-2)
Modeling & Simulation
for SSTR Operations
MV-0810 (0-8)
Thesis Research
Quarter 7
(17.5 credit hrs.)
SE-3100 (3-2)
Fundamentals of System Engineering
MV-4460 (4-0)
Management of M&S Development

26. Questions?