/Combining Active Learning and Reactive Control for Robot Grasping

Combining Active Learning and Reactive Control for Robot Grasping

Oliver Kroemer, Renaud Detry, Justus Piater and Jan Peters
Journal Article, Robotics and Autonomous Systems (RAS), January, 2010

Download Publication (PDF)

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author’s copyright. These works may not be reposted without the explicit permission of the copyright holder.


Grasping an object is a task that inherently needs to be treated in a hybrid fashion. The system must decide both where and how to grasp the object. While selecting where to grasp requires learning about the object as a whole, the execution only needs to reactively adapt to the context close to the grasp’s location. We propose a hierarchical controller that reects the structure of these two sub-problems, and attempts to learn solutions that work for both. A hybrid architecture is employed by the controller to make use of various machine learning methods that can cope with the large amount of uncertainty inherent to the task. The controller’s upper level selects where to grasp the object using a reinforcement learner, while the lower level comprises an imitation learner and a vision-based reactive controller to determine appropriate grasping motions. The resulting system is able to quickly learn good grasps of a novel object in an unstructured environment, by executing smooth reaching motions and preshaping the hand depending on the object’s geometry. The system was evaluated both in simulation and on a real robot.

BibTeX Reference
author = {Oliver Kroemer and Renaud Detry and Justus Piater and Jan Peters},
title = {Combining Active Learning and Reactive Control for Robot Grasping},
journal = {Robotics and Autonomous Systems (RAS)},
year = {2010},
month = {January},