1. Immersive Virtual Humans for Educating Medical and Pharmacy Communication Skills A. Raij, A. Kotranza, B. Rossen, J. Chuah, L. Cao, B. Lok Computer and Information Science and Engineering J. Cendan Surgery D. Beck, C. Kimberlin Pharmacy R. Ferdig, J. DePietro Education H. Shah, A. Gehlot, A. Gucwa, B. Rossen, A. Foster, C. Kalaria, D. Lind Surgical Oncology K. Johnsen Engineering L. Cuty-Ruiz, M. Feldmen Medicine

2. Project Overview Started Spring ’04 Started Spring ’04 n > 2100 health care students n > 2100 health care students One of the most experienced VH/VR experiences One of the most experienced VH/VR experiences Integration at five institutes Integration at five institutes –University of Florida –University of Central Florida –Medical College of Georgia –University of Georgia –Keele University (U.K.) 21 person team 21 person team –Computer Science –Medicine –Education –Psychology

3. Virtual Patients Speak to a life-size VH Speak to a life-size VH Interview a virtual patient via the web Interview a virtual patient via the web Visit a virtual patient in Second Life Visit a virtual patient in Second Life

4. Developing Virtual Character Conversation Model Virtual People Factory Virtual People Factory – Web-based interface – End-user creation of content – Pharmacy patient Pharmacy patient Pharmacy patient – Create a VP in two weeks In 6 months In 6 months – Over 2000 interactions – 12 end-user created scenarios End-user created scripts can reach 85% accuracy End-user created scripts can reach 85% accuracy

5. After-Action Review Students Students – Students received email with link – Sample student (Brent/45169) Sample student Sample student – Self-directed review of content, video, and feedback – Compare against experts Educators Educators – Educators can review student interactions – Data from study Data from study Data from study – Filter based on user background Level of expertise Level of expertise Gender Gender Educator-defined metrics Educator-defined metrics – Identify trends and outliers

6. Physical Examinations of Virtual Human Patients Mixed reality humans Mixed reality humans –Passive-haptic interface to life-sized virtual human –Applications  Clinical breast exam Clinical breast exam Clinical breast exam  Prostate exam (upcoming) Medical students can Medical students can –Concurrently practice physical examination and communication skills –Get real-time feedback of exam performance  Coverage  Pressure

7. Abnormal Findings: Cranial Nerve Multi-tool interface to VH Multi-tool interface to VH –Wii Remote controls multiple virtual tools used in eye exam –Gestural and tool input, in addition to speech Medical students can Medical students can –Experience interactions difficult to curricularly plan or are infrequent occurrences –Learn how to use neurological tests to diagnose a patient with a vision disorder

8. Biases with Virtual Humans “Could this be cancer?” Small visual change => large behavioral change in Empathy Empathy correlates with real world bias People treat the VHs below differently

9. Community Outreach: Museum of Science and Industry Science museum in Tampa, FL Science museum in Tampa, FL 5 th largest in US (75,000 sq ft.) 5 th largest in US (75,000 sq ft.) 1 million guests 1 million guests Integrate a VH interaction Integrate a VH interaction –The Amazing You exhibit –Lifelong wellness information –Fall ’09 Inspire, Inform Inspire, Inform Explore race, VH bias Explore race, VH bias