Contact Localization on Grasped Objects using Tactile Sensing

Artem Molchanov, Oliver Kroemer, Zhe Su and Gaurav S. Sukhatme
Conference Paper, International Conference on Intelligent Robots and Systems (IROS), January, 2016

Download Publication

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.


Manipulation tasks often require robots to make contact between a grasped tool and another object in the robot’s environment. The ability to detect and estimate the positions and directions of these contact points is crucial for monitoring the progress of the task, and detecting failures. In this paper, we present a data-driven approach for detecting and localizing contacts between a grasped object and the environment using tactile sensing. We explore framing the contact localization as both a regression and a classification problem and train neural networks accordingly to estimate the contact parameters. We also compare the neural networks with Gaussian process regression and support vector machine classification with spatiotemporal hierarchical matching pursuit feature learning. We evaluate the presented approach using hundreds of contact events on eighteen objects with different shapes, sizes and material properties. The experiments show that the neural network approach can learn to localize contact events for individual objects with a mean absolute error of less than 2.5 cm for the positions and less than 10◦ for the directions.

author = {Artem Molchanov and Oliver Kroemer and Zhe Su and Gaurav S. Sukhatme},
title = {Contact Localization on Grasped Objects using Tactile Sensing},
booktitle = {International Conference on Intelligent Robots and Systems (IROS)},
year = {2016},
month = {January},
} 2019-03-12T14:39:33-04:00