Intel & Carnegie Mellon University Presented by Tim Haines HERB 1.0 : Home Exploring Robotic Butler

Ideal Uses for Assistive Agent Assist elderly or disabled  Doing jobs currently done by service animals Cleaning Washing Dishes Laundry Ironing Moving heavy objects

Challenges to Operate in a Human Environment Efficient navigation and mapping Robust object recognition and pose estimating Sophisticated trajectory planning All done in unstructured constantly changing environment

The First Solution!!!

Principles of System Architecture Unlimited computational power is available  This is achieve by using on board and off board computing Sensing and planning algorithms should require minimal human input  Allows for the robot to adapt to new environments

Object recognition using sift Flea- Locating objects Narrow View, Large depth of field Dragonfly-Manipulate objects Wide View, small depth of field

Checkerboard Localization Found to be better than using the laser Down side  Slow, taking 10 to 30 sec  Needs at least 3 checkerboards in 1 image  Tried children's drawings, Failed

Navigating using GATMO Generalized Approach to Tracking Movable Objects Two part maps  Static  Lists of objects

Classification

Vision

Planning Opening doors Planning based on Kinematics, no physics Often Herbs fingers would jam into the door causing a stall

Planning Manipulating objects WGR-Workspace Goal Regions Videos:  QQ QQ  Wy-M&feature=related