Active Learning using Mean Shift Optimization for Robot Grasping

Oliver Kroemer, Renaud Detry, Justus Piater and Jan Peters
Conference Paper, International Conference on Intelligent Robots and Systems (IROS), January, 2009

Download Publication

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.


When children learn to grasp a new object, they often know several possible grasping points from observing a parent’s demonstration and subsequently learn better grasps by trial and error. From a machine learning point of view, this process is an active learning approach. In this paper, we present a new robot learning framework for reproducing this ability in robot grasping. For doing so, we chose a straightforward approach: first, the robot observes a few good grasps by demonstration and learns a value function for these grasps using Gaussian process regression. Subsequently, it chooses grasps which are optimal with respect to this value function using a mean-shift optimization approach, and tries them out on the real system. Upon every completed trial, the value function is updated, and in the following trials it is more likely to choose even better grasping points. This method exhibits fast learning due to the data-efficiency of the Gaussian process regression framework and the fact that the mean-shift method provides maxima of this cost function. Experiments were repeatedly carried out successfully on a real robot system. After less than sixty trials, our system has adapted its grasping policy to consistently exhibit successful grasps.

author = {Oliver Kroemer and Renaud Detry and Justus Piater and Jan Peters},
title = {Active Learning using Mean Shift Optimization for Robot Grasping},
booktitle = {International Conference on Intelligent Robots and Systems (IROS)},
year = {2009},
month = {January},
} 2019-03-12T15:02:51-04:00