The Robotics Institute

Carnegie Mellon Robotics Institute

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

We propose PALM -- a Portable sensor-Augmented vision system for Large-scene Modeling. The system is for recovering large structures in arbitrary scenes from video streams taken by a sensor-augmented camera. Central to the solution method is the combined use of multiple constraints derived from GPS measurements, camera orientation sensor readings, and image features. The knowledge of camera orientation allows for a linear formulation of perspective ray constraints, which results in sub- stantial improvement of computational eciency. The overall scene is reconstructed by merging smaller shape segments. Shape merging errors are minimized using the concept of shape hierarchy, which is realized through a \landmarking" technique. The features of the system include its use of a small number of images and feature points, its portability, and its low-cost interface for synchronizing sensor measurements with the video stream. The synchronization is achieved by storing the sensor readings in the audio channel of the camcorder. We built a hardware interface to convert RS232 signals to analog audio signals, and designed a software algorithm to decode the dig- itized audio signals back to the original sensor readings. Example reconstruction of a football stadium and three large buildings are presented and these results are compared with the ground truth.

Notes

Text Reference

Teck Khim Ng, "PALM: Portable Sensor-Augmented Vision System for Large Scene Modeling," doctoral dissertation, tech. report CMU-RI-TR-99-27, Robotics Institute, Carnegie Mellon University, August, 1999

BibTeX Reference

@phdthesis{Ng_1999_2877,
   author = "Teck Khim Ng",
   title = "PALM: Portable Sensor-Augmented Vision System for Large Scene Modeling",
   booktitle = "",
   school = "Robotics Institute, Carnegie Mellon University",
   month = "August",
   year = "1999",
   number= "CMU-RI-TR-99-27",
   address= "Pittsburgh, PA",
}

The Robotics Institute

Menu