Maximally Informative Interaction Learning for Scene Exploration

Herke van Hoof, Oliver Kroemer, Heni Ben Amor and Jan Peters
Conference Paper, International Conference on Intelligent Robots and Systems (IROS), January, 2012

Download Publication

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.


Creating robots that can act autonomously in dynamic, unstructured environments is a major challenge. In such environments, learning to recognize and manipulate novel objects is an important capability. A truly autonomous robot acquires knowledge through interaction with its environment without using heuristics or prior information encoding human domain insights. Static images often provide insufficient information for inferring the relevant properties of the objects in a scene. Hence, a robot needs to explore these objects by interacting with them. However, there may be many exploratory actions possible, and a large portion of these actions may be non-informative. To learn quickly and efficiently, a robot must select actions that are expected to have the most informative outcomes. In the proposed bottom-up approach, the robot achieves this goal by quantifying the expected informativeness of its own actions. We use this approach to segment a scene into its constituent objects as a first step in learning the properties and affordances of objects. Evaluations showed that the proposed information-theoretic approach allows a robot to efficiently infer the composite structure of its environment.

@conference{van Hoof-2012-112209,
author = {Herke van Hoof and Oliver Kroemer and Heni Ben Amor and Jan Peters},
title = {Maximally Informative Interaction Learning for Scene Exploration},
booktitle = {International Conference on Intelligent Robots and Systems (IROS)},
year = {2012},
month = {January},
} 2019-03-12T13:11:59-04:00