Interactive 3D Modeling from Multiple Images Using Scene Regularities

Heung-Yeung Shum, Rick Szeliski, Simon Baker, Mei Han, and P. Anandan
Proceedings of the European Workshop on 3D Structure from Multiple Images of Large-scale Environments (at ECCV '98), 1998.


Download
  • Adobe portable document format (pdf) (345KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
We present some recent progress in designing and implementing two interactive image-based 3D modeling systems. The first system constructs 3D models from a collection of panoramic image mosaics. A panoramic mosaic consists of a set of images taken around the same viewpoint, and a camera matrix associated with each input image. The user first interactively specifies features such as points, lines, and planes. Our system recovers the camera pose for each mosaic from known line directions and reference points. It then constructs the 3D model using all available geometrical constraints. The second system extracts structure from stereo by representing the scene as a collection of approximately planar layers. The user first interactively segments the images into corresponding planar regions. Our system recovers a composite mosaic for each layer, estimates the plane equation for the layer, and optionally recovers the camera locations as well as out-of-plane displacements. By taking advantage of known scene regularities, our interactive systems avoid difficult feature correspondence problems that occur in traditional automatic modeling systems. They also shift the interactive high-level structural model specification stage to precede (or intermix with) the 3D geometry recovery. They are thus able to extract accurate wire frame and texture-mapped 3D models from multiple image sequences.

Notes
Associated Project(s): Modeling by Videotape

Text Reference
Heung-Yeung Shum, Rick Szeliski, Simon Baker, Mei Han, and P. Anandan, "Interactive 3D Modeling from Multiple Images Using Scene Regularities," Proceedings of the European Workshop on 3D Structure from Multiple Images of Large-scale Environments (at ECCV '98), 1998.

BibTeX Reference
@inproceedings{Shum_1998_880,
   author = "Heung-Yeung Shum and Rick Szeliski and Simon Baker and Mei Han and P. Anandan",
   title = "Interactive 3D Modeling from Multiple Images Using Scene Regularities",
   booktitle = "Proceedings of the European Workshop on 3D Structure from Multiple Images of Large-scale Environments (at ECCV '98)",
   year = "1998",
}