Multi-view Spatial and Temporal Interpolation for Dynamic Event Visualization

Sundar Vedula
tech. report CMU-RI-TR-99-15, Robotics Institute, Carnegie Mellon University, July, 1999


Download
  • Adobe portable document format (pdf) (975KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
The problem of visualizing dynamic real-world events on a digital computer has been a challenging one so far. We present a framework and algorithm to model and visualize these events by creating virtual images from synthetic cameras located at arbitrary viewpoints, at arbitrary time instants. We discuss Geometry, Radiance, and Motion Map (GRAMM) as an image based representation of shape, texture, and instantaneous motion of a scene. A GRAMM allows us to create virtual images, by interpolating between sets of images taken at finitely sampled positions in location and in time. This interpolation requires algorithms for estimation of 3-D scene motion, image based interpolation, and imposition of multi-camera geometric constraints. Applications include visualization of complex surgical procedures, entertainment, or training, where the physical locations and/or image capture rates of cameras are constrained, but there is a need to accurately reconstruct the appearance from any position, at any time instant.

Keywords
image based modeling, virtualized reality, dynamic scene reconstruction

Notes
Associated Center(s) / Consortia: Vision and Autonomous Systems Center
Associated Lab(s) / Group(s): Vision for Virtual Environments and Virtualized RealityTM
Associated Project(s): Virtualized RealityTM and Scene Flow

Text Reference
Sundar Vedula, "Multi-view Spatial and Temporal Interpolation for Dynamic Event Visualization," tech. report CMU-RI-TR-99-15, Robotics Institute, Carnegie Mellon University, July, 1999

BibTeX Reference
@techreport{Vedula_1999_3107,
   author = "Sundar Vedula",
   title = "Multi-view Spatial and Temporal Interpolation for Dynamic Event Visualization",
   booktitle = "",
   institution = "Robotics Institute",
   month = "July",
   year = "1999",
   number= "CMU-RI-TR-99-15",
   address= "Pittsburgh, PA",
}