Exploiting Domain Knowledge for Object Discovery

Alvaro Collet Romea, Bo Xiong, Corina Gurau, Martial Hebert, and Siddhartha Srinivasa
IEEE International Conference on Robotics and Automation (ICRA), May, 2013.


Download
  • Adobe portable document format (pdf) (3MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
In this paper, we consider the problem of Lifelong Robotic Object Discovery (LROD) as the long-term goal of discovering novel objects in the environment while the robot operates, for as long as the robot operates. As a first step towards LROD, we automatically process the raw video stream of an entire workday of a robotic agent to discover objects. We claim that the key to achieve this goal is to incorporate domain knowledge whenever available, in order to detect and adapt to changes in the environment. We propose a general graph-based formulation for LROD in which generic domain knowledge is encoded as constraints. Our formulation enables new sources of domain knowledge —metadata— to be added dynamically to the system, as they become available or as conditions change. By adding domain knowledge, we discover 2.7 more objects and decrease processing time 190 times. Our optimized implementation, HerbDisc, processes 6 h 20 min of RGBD video of real human environments in 18 min 30 s, and discovers 121 correct novel objects with their 3D models.

Keywords
vision, perception, object discovery, lifelong, HERB, perception, grasping, manipulation

Notes
Associated Center(s) / Consortia: Quality of Life Technology Center, National Robotics Engineering Center, and Center for the Foundations of Robotics
Associated Lab(s) / Group(s): Personal Robotics

Text Reference
Alvaro Collet Romea, Bo Xiong, Corina Gurau, Martial Hebert, and Siddhartha Srinivasa, "Exploiting Domain Knowledge for Object Discovery," IEEE International Conference on Robotics and Automation (ICRA), May, 2013.

BibTeX Reference
@inproceedings{Collet_Romea_2013_7414,
   author = "Alvaro {Collet Romea} and Bo Xiong and Corina Gurau and Martial Hebert and Siddhartha Srinivasa",
   editor = "IEEE",
   title = "Exploiting Domain Knowledge for Object Discovery",
   booktitle = "IEEE International Conference on Robotics and Automation (ICRA)",
   month = "May",
   year = "2013",
}