1. EEC 490 GROUP PRESENTATION: KINECT TASK VALIDATION Scott Kruger Nate Dick Pete Hogrefe James Kulon

2. PART ONE: INTRODUCTION  Project Proposal  Create Guidelines Of Kinect Parameters  Accuracy Of The Kinect Sensors  Use Of Multiple Kinects  Static, Dynamic Movement Data Collected

3. INTRODUCTION CONTINUED  Work With Health Science Professors  Use Eight Camera Motion Analysis System  Compare Kinect Accuracy To Eight Camera Motion Analysis System  Establish Limitations Of Kinect Hardware

4. INTRODUCTION CONTINUED  Six Exercises  Hamstring Stretch Sitting Position  Scapular Plane Turn  Sit To Stand  Lateral Weight Shifting In Standing  Video Game Bowling In Sitting  Side Lying Hip Abduction

5. PART TWO: SOFTWARE  C#  Microsoft SDK 1.0  SQL Databases  Storage  Retrieval  Exporting Data Collected To Excel

6. SOFTWARE CONTINUED  Twenty Joints Of Detection  Database: Data Storage  Body Part (string)  X Coordinate Position (float)  Y Coordinate Position (float)  Z Coordinate Position (float)

7. SOFTWARE CONTINUED Skeleton

8. SOFTWARE CONTINUED  Initial Design Functionality  Start, Stop Recording  Collect Data  Tilt Camera Up/Down  Green Dots Highlight Joint Of Detection  Export To Excel

9. SOFTWARE CONTINUED

10.  Advanced Design Functionality  Replay Skeleton Movements  Slow, Pause Skeleton  Different Views  Total Frames Collected

11. SOFTWARE CONTINUED

12. PART THREE: MOTIONS LAB DEMO

13. MOTIONS LAB DEMO CONTINUED  Health Science Department (03/23/12)  Four Kinects  Front, Back, Side, Corner Angles  Different Heights  Different Separation Of Distance To Center

14. MOTIONS LAB DEMO CONTINUED  Health Science Lab Requirements  37 Strobes Of Detection Placed On Body  User Only Wears Shorts  Shorts Are Tied  Distance, Angles Of Some Joints Must Be Measured: Ankles To Knees

15. MOTIONS LAB DEMO CONTINUED  Eight Exercises  Walking  Weight Shift- Arms Out, Side To Side  Weight Shift- Foot Out, Front To Back  Wrist Rotation Sword

16. MOTIONS LAB DEMO CONTINUED  Eight Exercises (Continued)  Stand To Sit To Stand With Chair  Seated Bowling  Hamstring Stretch On Table  Hip Abduction On Table

17. MOTIONS LAB CONTINUED STANDING WEIGHT SHIFT

18. MOTIONS LAB CONTINUED

19.  Observations  Weight Shift: Ankle Joints Scattered  Sit To Stand, Bowling Sitting: Leg Joints Estimated Due To Chair  Table Exercises: All Joints Scattered  Walking: Hard Time Acquiring Data

20. MOTIONS LAB CONTINUED  Problems Of Demo  Only Front Angle Data Useful  Heights of Kinects Not Measured  Distance From Center Not Measured  No Universal Coordinate System

21. PART FOUR: CAPTURE SESSION Two Kinects Side-by-Side

22. CAPTURE SESSION CONTINUED Grid Layout GRID LAYOUT

23. CAPTURE SESSION CONTINUED Five Separate Movement Sets

24. CAPTURE SESSION CONTINUED Data Analysis

25. CAPTURE SESSION CONTINUED  Data Analysis  SDK Scale Is In Centimeters  Maximum Depth Is Approximately Four Meters  Field Of View Is 45 Degrees

26. CAPTURE SESSION CONTINUED Frame Rate Variance

27. CAPTURE SESSION CONTINUED Kinect Can Be Very “Noisy”

28. CAPTURE SESSION CONTINUED Abrupt Jumps

29. CAPTURE SESSION CONTINUED Z-axis is Most Stable

30. CAPTURE SESSION CONTINUED  Defined Physical Operating Parameters  Data Anomalies - Software Or Hardware  Better Experimental Setup

31. PART FIVE: CONCLUSION  Future Progress  Good (Green), Wrong (Red) Point Colors  Wrong Point Data Discarded  On Screen Grid  Animation

32. CONCLUSION CONTINUED  Algorithms To Solve Limitation Warnings  Back  Side  Extremity Crossing  Tables, Chairs Interference  Voice Commands

33. CONCLUSION CONTINUED  Compare Data To Physical Therapy System  Third Party Packages  More Sophisticated  More Capable  Microsoft SDK 1.0: Barebones

34. CONCLUSION CONTINUED  Summary  Learned How To Program Kinect  Found Limitations Of Kinect  Collected Data  Compared, Analyzed Data

35. QUESTIONS?