1. Virtual Environment Tutoring Engine: ITSs for 3D Game Environments Shrenik Devasani Stephen Gilbert, Ph.D. Suhas Shetty Nandhini Ramaswamy Stephen Blessing, Ph.D.

2. Problem Authoring game-based tutors is challenging due to: – Inherent domain complexity – Dynamic nature of the environment, non-player inputs What’s missing: – Authoring tools that help non-programmers develop game- based ITSs – Generic authoring tool to create tutors for multiple game engines / simulated environments

3. Previous Work - XPST Extensible Problem Specific Tutor (xPST) – ITS authoring tool that supports tutoring within synthetic environments. Tutor author lists the sequence of steps or “subgoals” to be performed by the trainee and describes the feedback associated with each step. xPST could be used by non-programmers.

4. Previous Work - XPST sequence { (shoot-the-kork then pickup-the-crossbows) then All-Done; } shoot-the-kork{ answer: "1"; Hint: "Go find the Kork and shoot it once."; Hint: "A green crosshair shows you have correctly aimed at the Kork."; OnComplete: "You have shot the Kork!"; }

5. Previous Work - XPST Goalnodes lack sufficient power to model a dynamic environment Non-player entities’ actions were difficult to represent Events that occur without the player’s knowledge were difficult to account for

6. Solution Tutoring model is a collection of states – Atomic state Represents the physical state of the real world – Complex state Represents a cognitive state Helps model complex tutoring strategies Can account for full range of possibilities within the environment Designed for non-programmers

7. Design An atomic state is described by the values of the properties of the entities in the scenario. Every property can take a special value called “don’t care” (DC).

8. Complex states help model events that happen over time. A complex state is a pattern of one or more atomic states, described by a regular expression. – e.g. S1 (S2 | S3)* S4 One complex state can encapsulate another. – e.g. (S1 S2)* S3 encapsulates S2 S3 Every state is associated with a priority. Design

9. Every state is classified as one of: – Start State – Failed State – Goal State – Intermediate State – Response State Design

10. Each state is associated with 3 kinds of feedback: – Hints – Just in time messages – Prompts

11. Design Counter variables: – Help keep track of time and speed – Updated when the learner enters or leaves a state – Can be used as pre-conditions to enter a state Learner model: – Every state can be tied one or more skill variables

12. Simulation Engine: VBS2 Virtual Battlespace 2 – a commercial-off-the-shelf 3D military simulator Scenarios can be created using the VBS2 Mission Editor by simple drag-drop of entities

13. Architecture

14. Tutor Authoring Process – First step is to create the scenario using the VBS2 Mission editor – Next, Define locations in the scenario that would be interest – Once the scenario is ready, the tutor-author can start building the tutoring model using VETE

15. Example Consider an example scenario consisting of the learner located outside a building (B5), an insurgent, a civilian and an IED all located inside B5. In order to complete the mission, the learner must: – Run towards the nearest wall – Approach B5, staying close to the wall at all times – Kill the insurgent – Diffuse the IED

16. Example Start State: Learner isAlive {true} Location {!B5} Action {stand} Insurgent isAlive {true} Location {B5} Action {DC} Civilian isAlive {true} Location {B5} Action {DC} IED Diffused {false} Exploded {false} Location {B5}

17. Example InsurgentDead (Intermediate State) : Learner isAlive {true} Location {DC} Action {DC} Insurgent isAlive {false} Location {DC} Action {DC} Civilian isAlive {true} Location {B5} Action {DC} IED Diffused {false} Exploded {false} Location {DC}

18. Example IEDDiffused (Goal State) : Learner isAlive {true} Location {DC} Action {DC} Insurgent isAlive {false} Location {DC} Action {DC} Civilian isAlive {true} Location {!B5} Action {DC} IED Diffused {true} Exploded {false} Location {DC}

19. Example PlayerDead (Failed State) : Learner isAlive {false} Location {DC} Action {DC} Insurgent isAlive {DC} Location {DC} Action {DC} Civilian isAlive {DC} Location {DC} Action {DC} IED Diffused {DC} Exploded {DC} Location {DC}

20. Example Complex State: “LearnerConfused” – (Start NearWindow) {3, } – Represents the learner being in a confused state of mind, when he switches between the two states, three or more times – “LearnerConfused” can be assigned a higher priority than “NearWindow”

21. Example

22. Discussion State-transition definitions are not required. Tutor-author only needs to define a subset of possible states. VETE’s architecture allows extension to other simulation engines.

23. Future Work Empirical evaluation study to demonstrate that VETE is feasible for non-programmers Training based on real-time physiological data Support for “programming by demonstration” Learner Management System

24. Questions? Shrenik Devasani Stephen Gilbert, Ph.D. Suhas Shetty Nandhini Ramaswamy Stephen Blessing, Ph.D.