The Robotics Institute

Carnegie Mellon Robotics Institute

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

Scene flow is the three-dimensional motion field of points in the world, just as optical flow is the two-dimensional motion field of points in an image. Any optical flow is simply the projection of the scene flow onto the image plane of a camera. We present a framework for the computation of dense, non-rigid scene flow from optical flow. Our approach leads to straightforward linear algorithms and a classification of the task into three major scenarios: complete instantaneous knowledge of the scene structure; knowledge only of correspondence information; and no knowledge of the scene structure. We also show that multiple estimates of the normal flow cannot be used to estimate dense scene flow directly without some form of smoothing or regularization.

Notes

Associated Center(s) / Consortia: Vision and Autonomous Systems Center

Associated Lab(s) / Group(s): Vision for Virtual Environments and Virtualized Reality^TM

Associated Project(s): Scene Flow and Spatio-Temporal View Interpolation

Text Reference

Sundar Vedula, Simon Baker, Peter Rander, Robert Collins, and Takeo Kanade, "Three-Dimensional Scene Flow," Proceedings of the 7th International Conference on Computer Vision, September, 1999, pp. 722 - 729.

BibTeX Reference

@inproceedings{Vedula_1999_2121,
   author = "Sundar Vedula and Simon Baker and Peter Rander and Robert Collins and Takeo Kanade",
   title = "Three-Dimensional Scene Flow",
   booktitle = "Proceedings of the 7th International Conference on Computer Vision",
   pages = "722 - 729",
   month = "September",
   year = "1999",
   volume = "2",
}

The Robotics Institute

Menu