Real-time Photo-realistic Visualization of 3D Environments for Enhanced Tele-operation of Vehicles

Daniel Huber, Herman Herman, Alonzo Kelly, Peter Rander, and Jason Ziglar
Proceedings of the International Conference on 3-D Digital Imaging and Modeling (3DIM), October, 2009.


Download
  • Adobe portable document format (pdf) (2MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
This paper describes a method for creating photorealistic three-dimensional (3D) models of real-world environments in real-time for the purpose of improving and extending the capabilities of vehicle tele-operation. Our approach utilizes the combined data from a laser scanner (for modeling 3D geometry) and a video camera (for modeling surface appearance). The sensors are mounted on a moving vehicle platform, and a photo-realistic 3D model of the vehicle’s environment is generated and displayed to the remote operator in real time. Our model consists of three main components: a textured ground surface, textured or colorized non-ground objects, and a textured background for representing regions beyond the laser scanner’s sensing horizon. Our approach enables many unique capabilities for vehicle tele-operation, including viewing the scene from virtual viewpoints (e.g., behind the vehicle or top down), seamless augmentation of the environment with digital objects, and improved robustness to transmission latencies and data dropouts.

Notes

Text Reference
Daniel Huber, Herman Herman, Alonzo Kelly, Peter Rander, and Jason Ziglar, "Real-time Photo-realistic Visualization of 3D Environments for Enhanced Tele-operation of Vehicles," Proceedings of the International Conference on 3-D Digital Imaging and Modeling (3DIM), October, 2009.

BibTeX Reference
@inproceedings{Huber_2009_6519,
   author = "Daniel Huber and Herman Herman and Alonzo Kelly and Peter Rander and Jason Ziglar",
   title = "Real-time Photo-realistic Visualization of 3D Environments for Enhanced Tele-operation of Vehicles",
   booktitle = "Proceedings of the International Conference on 3-D Digital Imaging and Modeling (3DIM)",
   month = "October",
   year = "2009",
}