Shape and Motion Carving in 6D

Sundar Vedula, Simon Baker, Steven Seitz, and Takeo Kanade
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR '00), June, 2000.


Download
  • Adobe portable document format (pdf) (485KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
The motion of a non-rigid scene over time imposes more constraints on its structure than those derived from images at a single time instant alone. An algorithm is presented for simultaneously recovering dense scene shape and scene flow (i.e., the instantaneous 3D motion at every point in the scene). The algorithm operates by carving away hexels, or points in the 6D space of all possible shapes and flows that are inconsistent with the images captured at either time instant, or across time. The recovered shape is demonstrated to be more accurate than that recovered using images at a single time instant. Applications of the combined scene shape and flow include motion capture for animation, re-timing of videos, and non-rigid motion analysis.

Keywords
shape recovery, motion analysis, scene reconstruction, scene flow

Notes
Associated Center(s) / Consortia: Vision and Autonomous Systems Center
Associated Lab(s) / Group(s): Vision for Virtual Environments and Virtualized RealityTM
Associated Project(s): Virtualized RealityTM and Scene Flow

Text Reference
Sundar Vedula, Simon Baker, Steven Seitz, and Takeo Kanade, "Shape and Motion Carving in 6D," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR '00), June, 2000.

BibTeX Reference
@inproceedings{Vedula_2000_3295,
   author = "Sundar Vedula and Simon Baker and Steven Seitz and Takeo Kanade",
   title = "Shape and Motion Carving in 6D",
   booktitle = "Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR '00)",
   month = "June",
   year = "2000",
}