Wearable Sensor Analysis for Gesture Recognition Supervisor:Dr. Manolya Kavakli Student:Alexey Novoselov St. ID:

2 Agenda 1: Background; 2: Goals; 3: Intended Outcomes; 4: Significance; 5: Approach; 6: Contemporary Technologies; 7: Piezo-Electric Technology; 8: Problems; 9: Experiments; 10: Output Data; 11: Initial Analysis; 12: Mathematical Approach; 13: Algorithmic Approach; 14: Conclusion 15: Future Work

3 1: Background Virtual Reality is very promising scientific area; Virtual Reality is very promising scientific area; Needs tools for interaction; Needs tools for interaction; A lot of various technologies and devices; A lot of various technologies and devices; Sensor Jacket is one of them; Sensor Jacket is one of them; No appropriate software for output analysis; No appropriate software for output analysis;

4 2: Goals Investigate contemporary Motion Capture technologies and techniques; Investigate contemporary Motion Capture technologies and techniques; Collect Sensor Jacket’s output data; Collect Sensor Jacket’s output data; Analyze it; Analyze it; Develop a mathematical model or an algorithm for Sensor Jacket; Develop a mathematical model or an algorithm for Sensor Jacket;

5 3: Intended Outcomes The list of justified experiments; The list of justified experiments; Data, collected during the set of experiments; Data, collected during the set of experiments; General characteristics of signals; General characteristics of signals; Application of mathematical approach; Application of mathematical approach; Application of algorithmic approach; Application of algorithmic approach; Mathematical model or algorithm for signal processing; Mathematical model or algorithm for signal processing;

6 4: Significance Other Motion Capture systems not very convenient in use; Other Motion Capture systems not very convenient in use; Sensor Jacket is wearable; Sensor Jacket is wearable; Sensor Jacket is simple; Sensor Jacket is simple; But is has no software for output analysis; But is has no software for output analysis;

7 5: Approach Develop and perform experiments; Develop and perform experiments; Collect data; Collect data; Filter data; Filter data; Analyze data; Analyze data; Develop a tool; Develop a tool;

8 6: Contemporary Technologies Optical; Optical; Inertial; Inertial; Mechanical; Mechanical;

9 7: Piezo-Electric Technology Piezo-effect; Piezo-effect; Piezo-electric sensor; Piezo-electric sensor; Made of graphite and silicone rubber; Made of graphite and silicone rubber;

10 8: Problems Only static characteristic provided; Only static characteristic provided; Electric noise in the output channels; Electric noise in the output channels; Strongly non-linear output signal; Strongly non-linear output signal; Speed dependent; Speed dependent;

11 9: Experiments

12 10: Output data

13 11: Initial Analysis Minimal (Starting) value; Minimal (Starting) value; Maximal (Peak) value; Maximal (Peak) value; Steady Value; Steady Value; The overshoot; The overshoot; Difference between initial and final values; Difference between initial and final values;

14 12: Mathematical Approach Basic characteristics; Basic characteristics; Speed of the signal change; Speed of the signal change; Angle of slope of the signal; Angle of slope of the signal; Area of the signal; Area of the signal;

15 13: Algorithmic Approach 1.Determine the active sensors; 2.Calculate the area of their signals; 3.Calculate the speed of sensors’ signals change; 4.Using the graphs (Figures 18-20), calculate the real speed of movement; 5.Using the tables of active sensors, determine to which types of movement (AoF, AoS, or AStF) this motion belongs; 6.Determine the approximate direction of movement; 7.Calculate the average time between the start and the peak of transient process for each group of sensors, forming the movement type; 8.Using the information from steps 4, 5, and 6, calculate the approximate distance that operator’s hand has passed during the motion in each direction; 9.Calculate the final coordinates of operator’s palm using formulas;

16 14: Conclusion Technologies review; Technologies review; Designed and performed experiments; Designed and performed experiments; Collected, filtered, and analysed data; Collected, filtered, and analysed data; Mathematical approach did not succeed; Mathematical approach did not succeed; Algorithm created; Algorithm created;

17 15: Future Work More experiments; More experiments; More sensitive data filtration; More sensitive data filtration; Use advanced mathematical techniques; Use advanced mathematical techniques; Create more accurate and precise tool. Create more accurate and precise tool.

18 Thank you!