/HerbDisc: Towards Lifelong Robotic Object Discovery

HerbDisc: Towards Lifelong Robotic Object Discovery

Alvaro Collet Romea, Bo Xiong, Corina Gurau, Martial Hebert and Siddhartha Srinivasa
Conference Paper, International Journal of Robotics Research (IJRR), January, 2014

Download Publication (PDF)

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author’s copyright. These works may not be reposted without the explicit permission of the copyright holder.


Our long-term goal is to develop a general solution to the Life- long Robotic Object Discovery (LROD) problem: to discover new objects in the environment while the robot operates, for as long as the robot operates. In this paper, we consider the first step towards LROD: we automatically process the raw data stream of an entire workday of a robotic agent to discover objects. Our key contribution to achieve this goal is to incorporate domain knowledge—robotic metadata—in the discovery process, in addition to visual data. We propose a general graph-based formulation for LROD in which generic domain knowledge is encoded as constraints. To make long-term object discovery feasible, we encode into our formulation the natural constraints and non-visual sensory information in service robotics. A key advantage of our generic formulation is that we can add, modify, or remove sources of domain knowledge dynamically, as they become available or as conditions change. In our experiments, we show that by adding domain knowl- edge we discover 2.7x more objects and decrease processing time 190 times. With our optimized implementation, Herb- Disc, we show for the first time a system that processes a video stream of 6 h 20 min of continuous exploration in cluttered human environments (and over half a million images) in 18 min 34 s, to discover 206 new objects with their 3D models.

BibTeX Reference
author = {Alvaro Collet Romea and Bo Xiong and Corina Gurau and Martial Hebert and Siddhartha Srinivasa},
title = {HerbDisc: Towards Lifelong Robotic Object Discovery},
booktitle = {International Journal of Robotics Research (IJRR)},
year = {2014},
month = {January},