/Learning Robot Tactile Sensing for Object Manipulation

Learning Robot Tactile Sensing for Object Manipulation

Yevgen Chebotar, Oliver Kroemer and Jan Peters
Conference Paper, International Conference on Intelligent Robots and Systems (IROS), January, 2014

Download Publication (PDF)

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author’s copyright. These works may not be reposted without the explicit permission of the copyright holder.


Tactile sensing is a fundamental component of object manipulation and tool handling skills. With robots entering unstructured environments, tactile feedback also becomes an important ability for robot manipulation.

In this work, we explore how a robot can learn to use tactile sensing in object manipulation tasks. We first address the problem of in-hand object localization and adapt three pose estimation algorithms from computer vision. Second, we employ dynamic motor primitives to learn robot movements from human demonstrations and record desired tactile signal trajectories. Then, we add tactile feedback to the control loop and apply relative entropy policy search to learn the parameters of the tactile coupling. Additionally, we show how the learning of tactile feedback can be performed more efficiently by reducing the dimensionality of the tactile information through spectral clustering and principal component analysis. Our approach is implemented on a real robot, which learns to perform a scraping task with a spatula in an altered environment.

BibTeX Reference
author = {Yevgen Chebotar and Oliver Kroemer and Jan Peters},
title = {Learning Robot Tactile Sensing for Object Manipulation},
booktitle = {International Conference on Intelligent Robots and Systems (IROS)},
year = {2014},
month = {January},