1. Distance Learning and Education Center for Advanced Research in Technology for Education Lewis Johnson, Ph.D., Director Erin Shaw, presenter Research Scientist, CARTE, USC Information Sciences Institute Adjunct Lecturer, Distance Education Network

2. Research @ USC ISI Information Sciences Institute USC Viterbi School of Engineering (>300 researchers, students, staff) USC Viterbi School of Engineering (>300 researchers, students, staff) R&D advanced computer and communication technologies R&D advanced computer and communication technologies Intelligent Systems Division (Artificial Intelligence) Robotics Robotics Knowledge systems Knowledge systems Natural language understanding Natural language understanding Machine translation Machine translation Virtual humans Virtual humans Intelligent agents Intelligent agents @ Center for Advanced Research in Technology for Education (CARTE)

3. CARTE Erin Shaw, Research Computer Scientist Joined 1995 Participated in development of first Distance Education course at USC, Introduction to Cinema Participated in development of first Distance Education course at USC, Introduction to Cinema Prior to joining ISI Digital library researcher Digital library researcher Cornell University, New York Cornell University, New York Computer graphics engineer Computer graphics engineer MIT startup company, Boston MIT startup company, Boston Math and science teacher Math and science teacher US Peace Corps, Nepal US Peace Corps, Nepal W. Lewis Johnson, Director

4. Pedagogical agents Interact with students in learning environments Engage in instructional dialogue Engage in instructional dialogue Assess learner knowledge Assess learner knowledge Model skills being taught Model skills being taughtAddress Motivational factors Motivational factors Control, curiosity, challenge, confidence Cognitive factors Cognitive factors Goals, inquiry & explanation, interactive problem solving Enhance motivation and interest

5. Typical system  Agent (reasoning engine)  Agent Persona  Simulation  Interactive exercise (e.g. Flash animation, Java Applets)  Simulation  Interactive exercise (e.g. Flash animation, Java Applets) Research items

6. VFTS (Virtual Factory Teaching System) Course Course Operations Scheduling in Manufacturing, Production and Inventory Management Operations Scheduling in Manufacturing, Production and Inventory Management Gives hands-on experience running a virtual factory Gives hands-on experience running a virtual factory Deliver over the Internet Deliver over the Internet Provide on-line monitoring and assistance Provide on-line monitoring and assistance Intelligent agents monitor student progress and provide immediate feedback Intelligent agents monitor student progress and provide immediate feedback

7. VFTS simulation (scheduling work)

8. Digital Puppets (Elementary grades)

9. Clinical Practice Agent embedded in interactive 2D ‘game’ Supports medical and dentistry cases Users typically first year graduate students Users typically first year graduate students Assists students in learning best practices Features virtual patient Features virtual patient Ask questions based on history Ask questions based on history Order labs and x-rays Order labs and x-rays Score based on type and order of procedures performed Score based on type and order of procedures performed (Demo Adele, Agent for Distance Learning Envs., Dentistry, 1.5m)

10. Trauma care

11. Introduction to clinical medicine

12. Geriatric dentistry

14. Pedagogical Drama Agent integrated into 2D animated ‘story’ Part of BRIGHT IDEAS social work program Users typically mothers of children with cancer Users typically mothers of children with cancer Assists students in learning coping skills Identify with a character Identify with a character Choose character’s thoughts and decisions Choose character’s thoughts and decisions Experiment with different paths (branching) Experiment with different paths (branching) (Demo Carmen’s Bright Ideas 1.5/3m)

15. Carmen’s Bright Ideas

17. Language Training Agents embedded in 3D virtual game Focus on language and communication skills training Users typically military personnel Users typically military personnel Practice language and gestural skills Practice language and gestural skills Contextual problem-solving in mission-based scenario Contextual problem-solving in mission-based scenario Game score based on performance Game score based on performance (Demo Tactical Language 3m)

18. Tactical Language

19. Virtual Training (3D) Example 4: Equipment operations training First person, immersive virtual reality First person, immersive virtual reality Naval ship high-pressure air compressor operators Naval ship high-pressure air compressor operators Practice equipment operation Practice equipment operation Contextual training Contextual training Virtual tutor Virtual tutor (Demo STEVE 5m)

20. STEVE (Soar Trainer Virtual Envs.) for

21. Leadership Training Agents embedded in interactive 3D environment Focus on leadership training Users typically military personnel Users typically military personnel Practice decision-making in context Practice decision-making in context Ethical conflicts in mission-based scenario Ethical conflicts in mission-based scenario Scored by human observer Scored by human observer (Demo Mission Rehearsal 1.5m)

22. Mission Rehearsal Exercise

23. Behind the scenes 2D simulations were produced with modest NSF- and NIH grants 2D simulations were produced with modest NSF- and NIH grants (< ½ $million a year) 3D simulations were produced with large DARPA and ONR grants 3D simulations were produced with large DARPA and ONR grants (> 1 $million a year) (> 1 $million a year)

24. Thank you for visiting, enjoy your stay Please feel free to contact me: Please feel free to contact me: Erin Shaw, shaw@ISI.EDU