Grasping with Vision Descriptors and Motor Primitives

Oliver Kroemer, Renaud Detry, Justus Piater and Jan Peters
Conference Paper, International Conference on Informatics in Control, Automation and Robotics (ICINCO), January, 2010

Download Publication

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.


Grasping is one of the most important abilities needed for future service robots. Given the task of picking up an object from betweem clutter, traditional robotics approaches would determine a suitable grasping point and then use a movement planner to reach the goal. The planner would require precise and accurate information about the environment and long computation times, both of which may not always be available. Therefore, methods for executing grasps are required, which perform well with information gathered from only standard stereo vision, and make only a few necessary assumptions about the task environment. We propose techniques that reactively modify the robot’s learned motor primitives based on information derived from Early Cognitive Vision descriptors. The proposed techniques employ non-parametric potential fields centered on the Early Cognitive Vision descriptors to allow for curving hand trajectories around objects, and finger motions that adapt to the object’s local geometry. The methods were tested on a real robot and found to allow for easier imitation learning of human movements and give a considerable improvement to the robot’s performance in grasping tasks.

author = {Oliver Kroemer and Renaud Detry and Justus Piater and Jan Peters},
title = {Grasping with Vision Descriptors and Motor Primitives},
booktitle = {International Conference on Informatics in Control, Automation and Robotics (ICINCO)},
year = {2010},
month = {January},
} 2019-03-12T13:34:49-04:00