1. Jivko Sinapov, Kaijen Hsiao and Radu Bogdan Rusu Proprioceptive Perception for Object Weight Classification

2. What is Proprioception? “It is the sense that indicates whether the body is moving with required effort, as well as where the various parts of the body are located in relation to each other.” - Wikipedia

3. 3 Why Proprioception?

4. 4 Full Empty

5. Hard Softvs Why Proprioception?

6. Lifting: gravity, effort, etc.

7. Pushing: friction, mass, etc.

8. Squeezing: compliance, flexibility

9. Power, “Play and Exploration in Children and Animals”, 2000

10. Related Work: Proprioception “Learning Haptic Representations of Objects”: [ Natale et al (2004) ]

11. Related Work: Proprioception Proprioceptive Object Recognition [ Bergquist et al (2009) ]

12. Perception Problem for PR2: Is the bottle full or empty?

13. General Approach Let the robot experience what full and empty bottles “feel” like Use prior experience to classify new bottles as either full or empty

14. Behavior: Power, “Play and Exploration in Children and Animals”, 2000

15. Behaviors 1) Unsupported Holding2) Lifting

16. Data Representation Behavior Execution: [J i, E i, C i ] Recorded Data: Joint Positions Efforts Class Label {full, empty}

17. Example Recorded Joint Efforts of Left Arm:

18. Classification Procedure [J i, E i, ?] Feature Extraction Recognition Model Pr( ‘full’ )Pr( ‘empty’ )

19. Recognition Model X =[J i, E i, ?] Recognition Model

20. X =[J i, E i, ?] Recognition Model Find N closest neighbors to X in joint-feature space

21. Recognition Model X =[J i, E i, ?] Recognition Model Find N closest neighbors to X in joint-feature space Train classifier C on the N neighbors that maps effort features to class label

22. Recognition Model X =[J i, E i, ?] Recognition Model Find N closest neighbors to X in joint-feature space Train classifier C on the N neighbors that maps effort features to class label Use trained classifier C to label X

23. Objects: Procedure: Place object on table Robot grasps it and performs the current behavior (either hold or lift) in a random position in space Robot puts object back down on table in random position; repeat. Each behavior performed 100 times on each bottle in both full and empty states A total of 2 x 5 x 100 x 2 = 2000 behavior executions Training Procedure

24. Evaluation 5 fold cross-validation: at each iteration, data with 4 out of the five bottles is used for training, and the rest used for testing Three classification algorithms evaluated: K-Nearest Neighbors Support Vector Machine (quadratic kernel) C4.5 Tree

25. Chance Accuracy: 50%

26. Can the robot boost recognition rate by applying a behavior multiple times?

28. How much training data is necessary?

29. (lift)

30. Application to Regression X =[J i, E i, ?] Recognition Model Find N closest neighbors to X in joint-feature space Train regression model C on the N neighbors that maps effort features to class label Use trained regression model C to label X

31. Regression Results

32. Mean Abs. Error = 0.08827 lbs

33. Regression Results Mean Abs. Error = 0.08827 lbs Chance error = 0.2674 lbs

34. Application to Sorting Task Sorting task: Place empty bottles in trash Move full bottles on other side of table

35. Application to Sorting Task

37. Sorting Task: video

38. Application to a new recognition task Full or empty?

39. Behavior: 40 trials with full box and 40 trials with empty box Recognition Accuracy: 98.75 % (all three algorithms) slide object across table

40. Sliding task: video

41. Conclusion Behavior-grounded approach to proprioceptive perception Implemented as a ROS package: -http://www.ros.org/wiki/proprioceptionhttp://www.ros.org/wiki/proprioception This work has been submitted to ICRA 2011.

42. Future Work More advanced proprioceptive feature extraction Multi-modal object perception: Auditory 3D Tactile