A Comparison of Contact Distribution Representations for Learning to Predict Object Interactions

Simon Leischnig, Stefan Luettgen, Oliver Kroemer and Jan Peters
Conference Paper, International Conference on Humanoid Robots (Humanoids), January, 2015

Download Publication

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.


Different contacts between objects afford different interactions between them. For example, while contacts below an object can provide support, contacts on opposing sides can be used for pinching. Hence, a robot can learn to predict which interactions are currently afforded based on the set of contacts.

However, representing sets of contacts is not trivial, as the number of contacts is not fixed nor are the contacts ordered. In this paper, we compare different methods for representing contacts, including bag-of-features, probability product kernels, and random forests. These approaches model the distribution over the contacts without relying on task-specific features. The methods were evaluated on both simulated grasping data, as well as real robot grasps. The random forest and the normalized expected likelihood kernel approaches achieved the highest accuracies for the simulated experiments. In the case of the real robot data, the more robust exponential χ2 and Bhattacharyya kernels achieved higher accuracies.

author = {Simon Leischnig and Stefan Luettgen and Oliver Kroemer and Jan Peters},
title = {A Comparison of Contact Distribution Representations for Learning to Predict Object Interactions},
booktitle = {International Conference on Humanoid Robots (Humanoids)},
year = {2015},
month = {January},
} 2019-03-12T14:10:37-04:00