Learning Robot Grasping from 3-D Images with Markov Random Fields

Abdeslam Boularias, Oliver Kroemer and Jan Peters
Conference Paper, International Conference on Intelligent Robots and Systems (IROS), January, 2011

Download Publication

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.


Learning to grasp novel objects is an essential skill for robots operating in unstructured environments. We therefore propose a probabilistic approach for learning to grasp. In particular, we learn a function that predicts the success probability of grasps performed on surface points of a given object. Our approach is based on Markov Random Fields (MRF), and motivated by the fact that points that are geometrically close to each other tend to have similar grasp success probabilities. The MRF approach is successfully tested in simulation, and on a real robot using 3-D scans of various types of objects. The empirical results show a significant improvement over methods that do not utilize the smoothness assumption and classify each point separately from the others.

author = {Abdeslam Boularias and Oliver Kroemer and Jan Peters},
title = {Learning Robot Grasping from 3-D Images with Markov Random Fields},
booktitle = {International Conference on Intelligent Robots and Systems (IROS)},
year = {2011},
month = {January},
} 2019-03-12T14:21:27-04:00