The Robotics Institute
Search the site
RI | Publications | Spatio-Temporal View Interpolation

Text only version of this site

Spatio-Temporal View Interpolation
S. Vedula, S. Baker, and T. Kanade
Proceedings of the 13th ACM Eurographics Workshop on Rendering, June, 2002.

Jump to: Download | Abstract | Notes | Text Reference | BibTeX Reference

Download [Help]

Adobe portable document format (pdf) [2394 KB]
Compressed postscript (ps.gz) [19353 KB]

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

We propose a fully automatic algorithm for view interpolation of a completely non-rigid dynamic event across both space and time. The algorithm operates by combining images captured across space to compute voxel models of the scene shape at each time instant, and images captured across time to compute the ``scene flow'' between the voxel models. The scene-flow is the non-rigid 3D motion of every point in the scene. To interpolate in time, the voxel models are ``flowed'' using an appropriate multiple of the scene flow and a smooth surface fit to the result. The novel image is then computed by ray-casting to the surface at the intermediate time instant, following the scene flow to the neighboring time instants, projecting into the input images at those times, and finally blending the results. We use our algorithm to create re-timed slow-motion fly-by movies of dynamic real-world events.

Notes

Associated center: VASC
Associated labs/groups: Vision for Virtual Environments and Virtualized RealityTM
Associated projects: Spatio-Temporal View Interpolation and Scene Flow

Text Reference

S. Vedula, S. Baker, and T. Kanade, "Spatio-Temporal View Interpolation," Proceedings of the 13th ACM Eurographics Workshop on Rendering, June, 2002.

BibTeX Reference

@inproceedings{Vedula_2002_3975,
   author = "Sundar Vedula and Simon Baker and Takeo Kanade",
   title = "Spatio-Temporal View Interpolation",
   booktitle = "Proceedings of the 13th ACM Eurographics Workshop on Rendering",
   month = "June",
   year = "2002"
}


The Robotics Institute is part of the School of Computer Science, Carnegie Mellon University.
For updates and comments, please see these instructions.
This page maintained by robotwebmaster@ri.cmu.edu