/Mapping the MIT Stata Center: Large-scale Integrated Visual and RGB-D SLAM

Mapping the MIT Stata Center: Large-scale Integrated Visual and RGB-D SLAM

Maurice F. Fallon, Hordur Johannsson, Michael Kaess, David M. Rosen, Elias Muggler and John J. Leonard
Journal Article, Carnegie Mellon University, RSS Workshop on RGB-D: Advanced Reasoning with Depth Cameras, July, 2012

Download Publication (PDF)

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author’s copyright. These works may not be reposted without the explicit permission of the copyright holder.


This paper describes progress towards creating an integrated large-scale visual and RGB-D mapping and localiza- tion system to operate in the MIT Stata Center. The output of a real-time, temporally scalable 6-DOF visual SLAM system is used to generate low fidelity maps that are used by the Kinect Monte Carlo Localization (KMCL) algorithm. This localization algorithm can track the camera pose during aggressive motion and can aid in recovery from visual odometry failures. The localization algorithm uses dense depth information to track its location in the map, which is less sensitive to large viewpoint changes than feature-based approaches, e.g. traversing in oppo- site direction up and down a hallway. The low fidelity map also makes the system more resilient to clutter and small changes in the environment. The integration of the localization algorithm with the mapping algorithm enables the system to operate in novel environments and allows for robust navigation through the mapped area—even under aggressive motion. A major part of this project has been the collection of a large dataset of the ten-floor MIT Stata Center with a PR2 robot, which currently consists of approximately 40 kilometers of distance traveled. This paper describes ongoing efforts to obtain centimenter-level ground-truth for the robot motion, using prior building models.

BibTeX Reference
author = {Maurice F. Fallon and Hordur Johannsson and Michael Kaess and David M. Rosen and Elias Muggler and John J. Leonard},
title = {Mapping the MIT Stata Center: Large-scale Integrated Visual and RGB-D SLAM},
journal = {RSS Workshop on RGB-D: Advanced Reasoning with Depth Cameras},
year = {2012},
month = {July},