1. Physically Realistic Interface for a User Inside VR Masahide Hashimoto Kenji Miyamoto Faculty of Engineering Hosei University (Japan)

2. What is User Inside VR ? Bodily Interaction with Virtual Objects Stepping-in presentation. (Yoshino.A, Mitsumata.H, and Miyamoto.K. 2003)

3. User Inside VR: Researches (1/3) A Mirror Metaphor Interaction System: Touching Remote Real Objects in an Augmented Reality Environment. （ Hosoya.E, et al. 2003 ）

4. User Inside VR: Researches (2/3) Virtually Touchable Video Communication. (Kanehata.S, Yoshino.A, and Miyamoto.K. 2004)

5. User Inside VR: Researches (3/3) EYETOY. (SONY.2003)

6. Various Interactions InteractionSystem Colored area stays Stepping-in presentation Colored area touches A Mirror Metaphor … Overlap Virtually Touchable Video Communication MoveEYETOY Which Interaction ? Difficult to use at sight.

7. Framework Events Object-1 Object-N Real Event Detection Dispatcher Tool-1 Tool-2 Tool-N Events System..... Event Action Rule

8. Example Dial Events Dial Tool ・ Overlap Opaque ・ Release Translucent ・ Move Rotate Touch Rub Release Move Release Overlap

9. Applications

10. V-Rimokon: Controls Consumer Electronic （ Using Dial Object ）

12. V-VolleyBall: Game （ Using Bouncing Object ）

14. Discussion

15. Related works (1/3) 5DT Data Gloves (http://www.5dt.com/hardware.html\#glove )

16. Related works (2/3) Ubi-Finger: Gesture Input Device for Mobile Use (Tsukada, K. and Yasumura, M.2002)

17. Related works (3/3) Wii Remote (Nintendo,2006)

18. Future work Extending to 3D Clayish Object

19. Conclusion A framework that forces reality was proposed. Tools built in this framework can be used easily at sight.

20. Thank you for your attention !

22. Implementation Input: Video Camera Background Subtraction Event Detection & Dispatching Object Action Invocation Output Image Composition

23. Comparison with AR Deviceless CG in the Real World Augmented Reality Virtual Manipulation User feels in the Real World

24. Comparison with AV Virtual Manipulation Interacting Image User in VR User live Image Augmented Virtuality Image