The Robotics Institute

Carnegie Mellon Robotics Institute

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

The motion of a non-rigid scene over time imposes more constraints on its structure than those derived from images at a single time instant alone. An algorithm is presented for simultaneously recovering dense scene shape and scene flow (i.e., the instantaneous 3D motion at every point in the scene). The algorithm operates by carving away hexels, or points in the 6D space of all possible shapes and flows that are inconsistent with the images captured at either time instant, or across time. The recovered shape is demonstrated to be more accurate than that recovered using images at a single time instant. Applications of the combined scene shape and flow include motion capture for animation, re-timing of videos, and non-rigid motion analysis.

Keywords

shape recovery, motion analysis, scene reconstruction, scene flow

Notes

Associated Center(s) / Consortia: Vision and Autonomous Systems Center

Associated Lab(s) / Group(s): Vision for Virtual Environments and Virtualized Reality^TM

Associated Project(s): Virtualized Reality^TM and Scene Flow

Text Reference

Sundar Vedula, Simon Baker, Steven Seitz, and Takeo Kanade, "Shape and Motion Carving in 6D," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR '00), June, 2000.

BibTeX Reference

@inproceedings{Vedula_2000_3295,
   author = "Sundar Vedula and Simon Baker and Steven Seitz and Takeo Kanade",
   title = "Shape and Motion Carving in 6D",
   booktitle = "Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR '00)",
   month = "June",
   year = "2000",
}

The Robotics Institute

Menu