Virtualized Reality: Constructing Time-Varying Virtual Worlds from Real Events

Peter Rander, P J. Narayanan, and Takeo Kanade
Proceedings of IEEE Visualization '97, October, 1997, pp. 277-283.


Download
  • Adobe portable document format (pdf) (540KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
Virtualized reality is a modeling technique that constructs full 3D virtual representations of dynamic events from multiple video streams. Image-based stereo is used to compute a range image corresponding to each intensity image in each video stream. Each range and intensity image pair encodes the scene structure and appearance of the scene visible to the camera at that moment, and is therefore called a visible surface model (VSM). A single time instant of the dynamic event can be modeled as a collection of VSMs from different viewpoints, and the full event can be modeled as a sequence of static scenes-the 3D equivalent of video. Alternatively, the collection of VSMs at a single time can be fused into a global 3D surface model, thus creating a traditional virtual representation out of real world events. Global modeling has the added benefit of eliminating the need to hand-edit the range images to correct errors made in stereo, a drawback of previous techniques. Like image-based rendering models, these virtual representations can be used to synthesize nearly any view of the virtualized event. For this reason, the paper includes a detailed comparison of existing view synthesis techniques with the authors' own approach. In the virtualized representations, however, scene structure is explicitly represented and therefore easily manipulated, for example by adding virtual objects to (or removing virtualized objects from) the model without interfering with real event. Virtualized reality, then, is a platform not only for image-based rendering but also for 3D scene manipulation.

Notes
Associated Center(s) / Consortia: Vision and Autonomous Systems Center
Associated Lab(s) / Group(s): Virtualized RealityTM
Number of pages: 7

Text Reference
Peter Rander, P J. Narayanan, and Takeo Kanade, "Virtualized Reality: Constructing Time-Varying Virtual Worlds from Real Events," Proceedings of IEEE Visualization '97, October, 1997, pp. 277-283.

BibTeX Reference
@inproceedings{Rander_1997_951,
   author = "Peter Rander and P J Narayanan and Takeo Kanade",
   title = "Virtualized Reality: Constructing Time-Varying Virtual Worlds from Real Events",
   booktitle = "Proceedings of IEEE Visualization '97",
   pages = "277-283",
   month = "October",
   year = "1997",
}