Mosaicing a Large Number of Widely Dispersed, Noisy, and Distorted Images: A Bayesian Approach

Frank Dellaert, Sebastian Thrun, and Chuck Thorpe
tech. report CMU-RI-TR-99-34, Robotics Institute, Carnegie Mellon University, March, 1999


Download
  • Adobe portable document format (pdf) (179KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
In this paper we extend existing mosaicing algorithms to deal with image se-quences that are captured over a wide spatial area, exhibit large geometric and photometric distortions, and contain significant additive noise and other contami-nations, such as light reflections. The paper focuses on three main contributions. (1) We extend the camera model used for mosaicing to deal, not only with geomet-ric lens distortion, but with vignetting and permanent occluders as well. (2) We introduce a novel method for global image alignment based on a technique from the robotics literature, together with a novel optimization strategy, the folding al-gorithm, to guarantee global convergence. (3) We utilize techniques developed in the super-resolution literature for restoration of the final image mosaic from the contaminated input images. The estimation of camera parameters, the global alignment and the final mosaic are all derived within a unifying Bayesian frame-work, starting with the single objective of obtaining the maximum a posteriori estimate of the final mosaic, given the input images. Our approach is illustrated with results on a complex and challenging image sequence obtained from a state of the art robotics application.

Notes

Text Reference
Frank Dellaert, Sebastian Thrun, and Chuck Thorpe, "Mosaicing a Large Number of Widely Dispersed, Noisy, and Distorted Images: A Bayesian Approach," tech. report CMU-RI-TR-99-34, Robotics Institute, Carnegie Mellon University, March, 1999

BibTeX Reference
@techreport{Dellaert_1999_3244,
   author = "Frank Dellaert and Sebastian Thrun and Chuck Thorpe",
   title = "Mosaicing a Large Number of Widely Dispersed, Noisy, and Distorted Images: A Bayesian Approach",
   booktitle = "",
   institution = "Robotics Institute",
   month = "March",
   year = "1999",
   number= "CMU-RI-TR-99-34",
   address= "Pittsburgh, PA",
}