Closed-loop Servoing using Real-time Markerless Arm Tracking

Matthew Klingensmith, Thomas Galluzzo, Christopher Dellin, Moslem Kazemi, J. Andrew (Drew) Bagnell, and Nancy Pollard
International Conference on Robotics And Automation (Humanoids Workshop), May, 2013.


Download
  • Adobe portable document format (pdf) (14MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
We present a simple, efficient method of realtime articulated arm pose estimation using stochastic gradient descent to correct unmodeled errors in the robot’s kinematics with point cloud data from commercial depth sensors. We show that our method is robust to error in both the robot’s joint encoders and in the extrinsic calibration of the sensor; and that it is both fast and accurate enough to provide realtime performance for autonomous manipulation tasks. The efficiency of our technique allows us to embed it in a closedloop position servoing strategy; which we extensively use to perform manipulation tasks. Our method is generalizable to any articulated robot, including dexterous humanoids and mobile manipulators with multiple kinematic chains.

Keywords
visual servoing, depth camera, pose estimation, manipulation, robotics

Notes
Sponsor: DARPA ARM-S Project
Associated Center(s) / Consortia: National Robotics Engineering Center

Text Reference
Matthew Klingensmith, Thomas Galluzzo, Christopher Dellin, Moslem Kazemi, J. Andrew (Drew) Bagnell, and Nancy Pollard, "Closed-loop Servoing using Real-time Markerless Arm Tracking," International Conference on Robotics And Automation (Humanoids Workshop), May, 2013.

BibTeX Reference
@inproceedings{Klingensmith_2013_7502,
   author = "Matthew Klingensmith and Thomas Galluzzo and Christopher Dellin and Moslem Kazemi and J. Andrew (Drew) Bagnell and Nancy Pollard",
   title = "Closed-loop Servoing using Real-time Markerless Arm Tracking",
   booktitle = "International Conference on Robotics And Automation (Humanoids Workshop)",
   month = "May",
   year = "2013",
}