INTERACTING WITH SIMULATION ENVIRONMENTS THROUGH THE KINECT Fayez Alazmi Supervisor: Dr. Brett Wilkinson Flinders University Image 1Image 2 Source : 1

PROJECT AIM Develop hardware and software that provides for the control of different artefacts via motion gestures and speech recognition. Implement a simulation environment to deploy the Kinect based system Deploy the application to a real world scenario such as battle field training. Flinders University

W HAT IS THE K INECT  Developed by Microsoft  Infrared projector and RGB camera  Microphone array  3D depth sensors  Complete hands free interaction Flinders University

SPECIFIC USE Flinders University Update the conventional systems in educating the fresh soldiers with Kinect based systems Develop a thorough understanding of the training field via simulation prior to entering the training field Flinders University

BACKGROUND  Extensive research done on depth based sensors  Has the potential to be used in mapping applications  Hand gestures operates robustly in uncontrolled environments and is insensitive to hand variations and distortions  Hand modeled as elliptic cylinder with each finger as three cones. See References [1,2,3,4,5] Flinders University

T ECHNOLOGY  Hardware  Microsoft XBOX-360 Kinect  Monitor display/ Projector display  Standard computer/PC  Software  Microsoft Visual Studio 2012  Kinect SDK v1.7 for Windows  Windows 7 Flinders University

TIMELINE Flinders University

CONCLUSION Flinders University  Implement a functional simulation environment.  Interact through motion gestures  Develop an understanding of the Kinect SDK and middleware applications for Natural Interactions  Conduct user evaluations

FUTURE WORK  Investigate into the possibilities of Kinect based applications  Make use of this system relevant to my field; ultimate goal is to assist in the training access.  Determine stability of low cost technology for such systems. Flinders University