/Deliberative Object Pose Estimation in Clutter

Deliberative Object Pose Estimation in Clutter

Venkatraman Narayanan and Maxim Likhachev
Conference Paper, 2017 IEEE International Conference on Robotics and Automation (ICRA), May, 2017

Download Publication (PDF)

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author’s copyright. These works may not be reposted without the explicit permission of the copyright holder.


A fundamental robot perception task is that of identifying and estimating the poses of objects with known 3D models in RGB-D data. While feature-based and discriminative approaches have been traditionally used for this task, recent work on deliberative approaches such as PERCH and D2P have shown improved robustness in handling scenes with severe inter-object occlusions. These deliberative approaches work by treating multi-object pose estimation as a combinatorial search over the space of possible rendered scenes of the objects, thereby inherently being able to predict and account for occlusions. However, these methods have so far been restricted to scenes comprising only of known objects, and have been unable to handle extraneous clutter—a common occurrence in many real-world settings. This work significantly increases the practical relevance of deliberative perception methods by developing a formulation that: i) accounts for extraneous unmodeled clutter in scenes, and ii) provides object pose uncertainty estimates. Our algorithm is complete and provides bounded suboptimality guarantees for the cost function chosen to be optimized. Empirically, we demonstrate successful object recognition and uncertainty-aware localization in challenging scenes with unmodeled clutter, where previous deliberative methods perform unsatisfactorily. In addition, this work was used as part of the perception system by Carnegie Mellon University’s Team HARP in the 2016 Amazon Picking Challenge.

BibTeX Reference
author = {Venkatraman Narayanan and Maxim Likhachev},
title = {Deliberative Object Pose Estimation in Clutter},
booktitle = {2017 IEEE International Conference on Robotics and Automation (ICRA)},
year = {2017},
month = {May},
keywords = {rgb-d perception, object recognition, instance detection, deliberative perception},