Towards Precise Robotic Grasping by Probabilistic Post-grasp Displacement Estimation

Jialiang Zhao, Jacky Liang and Oliver Kroemer
Conference Paper, Field and Service Robotics (FSR) 2019, August, 2019

Download Publication

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.


Precise robotic grasping is important for many industrial applications, such as assembly and palletizing, where the location of the object needs to be controlled and known. However, achieving precise grasps is challenging due to noise in sensing and control, as well as unknown object properties. We propose a method to plan robotic grasps that are both robust and precise by training two convolutional neural networks – one to predict the robustness of a grasp and another to predict a distribution of post-grasp object displacements. Our networks are trained with depth images in simulation on a dataset of over 1000 industrial parts and were successfully deployed on a real robot without having to be further fine-tuned. The proposed displacement estimator achieves a mean prediction errors of 0.68cm and 3.42deg on novel objects in real world experiments.

author = {Jialiang Zhao and Jacky Liang and Oliver Kroemer},
title = {Towards Precise Robotic Grasping by Probabilistic Post-grasp Displacement Estimation},
booktitle = {Field and Service Robotics (FSR) 2019},
year = {2019},
month = {August},
publisher = {Springer},
keywords = {robotic grasping, self-supervised learning},
} 2019-08-01T15:28:50-04:00