Presentation is loading. Please wait.

Presentation is loading. Please wait.

Multi Hand Pose Recognition System using Kinect Depth Sensor: Application to Medical Image Navigation Oscar Lopes, Miguel Pousa, Miguel Reyes, Sergio Escalera,

Similar presentations


Presentation on theme: "Multi Hand Pose Recognition System using Kinect Depth Sensor: Application to Medical Image Navigation Oscar Lopes, Miguel Pousa, Miguel Reyes, Sergio Escalera,"— Presentation transcript:

1 Multi Hand Pose Recognition System using Kinect Depth Sensor: Application to Medical Image Navigation Oscar Lopes, Miguel Pousa, Miguel Reyes, Sergio Escalera, and Jordi González All rights reserved HuBPA© Human Pose Recovery and Behavior Analysis

2 Index Motivation System Architecture Descriptor Gesture Recognition Dataset Application Results Conclusion All rights reserved HuBPA© Human Pose Recovery and Behavior Analysis

3 Motivation All rights reserved HuBPA© Human Pose Recovery and Behavior Analysis Recognize hand poses and gestures with high visual variability. Introduce the recognition process in an automatic medical image navigation application

4 System architecture All rights reserved HuBPA© Human Pose Recovery and Behavior Analysis RGBD data acquisition Trained spherical descriptors and HMM gesture recognition Medical image navigation A B C

5 Descriptor All rights reserved HuBPA© Human Pose Recovery and Behavior Analysis Sergio Escalera, Alicia Fornés, Oriol Pujol, Josep Lladós, and Petia Radeva, Circular Blurred Shape Model for Multiclass Symbol Recognition, Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions On, Volume 99, pp. 1-10, Digital Object Identifier: /TSMCB , pp. 1-10, IEEE Society, Hanover, USA, ISSN , IF JCR CCIA /103, 2010.

6 Descriptor All rights reserved HuBPA© Human Pose Recovery and Behavior Analysis Rotation invariance Multiclass SVM

7 Gesture recognition All rights reserved HuBPA© Human Pose Recovery and Behavior Analysis Probabilistic HMM gesture recognition using hand trajectories and hand labels

8 Dataset All rights reserved HuBPA© Human Pose Recovery and Behavior Analysis Medical image repository

9 Application All rights reserved HuBPA© Human Pose Recovery and Behavior Analysis

10 Results All rights reserved HuBPA© Human Pose Recovery and Behavior Analysis Descriptor results improve state-of-the-art approaches (51 categories) MethodsPapersDepth SIFT + Texton + Color Histogram + Spin Images + 3D Bounding BoxesICRA11A64.7 Sparse Distance LearningICRA11B70.2 RGB-D Kernel DescriptorsIROS Hierarchical Matcing PursuitISER Ours ICPR Demonstrator challenge85.13

11 Conclusion All rights reserved HuBPA© Human Pose Recovery and Behavior Analysis Conclusion Future work Use virtual models to learn objects as a composition of parts Use the same descriptor to learn spatial relations of object parts A new, fast, and robust 3D object descriptor Spherical descriptor improves state-of-the-art approaches Gesture recognition using HMM including hand poses and trajectories Fully-functional application using Microsoft Kinect SDK for medical image navigation

12 Multi Hand Pose Recognition System using Kinect Depth Sensor: Application to Medical Image Navigation Oscar Lopes, Miguel Pousa, Miguel Reyes, Sergio Escalera, and Jordi González All rights reserved HuBPA© Human Pose Recovery and Behavior Analysis Thank you!


Download ppt "Multi Hand Pose Recognition System using Kinect Depth Sensor: Application to Medical Image Navigation Oscar Lopes, Miguel Pousa, Miguel Reyes, Sergio Escalera,"

Similar presentations


Ads by Google