Advanced Search   
  Look in
       Title     Description
  Include
       Inactive Projects
 

 
Scene Flow
This project is no longer active.
Head: Simon Baker
Contact: Simon Baker
Mailing address:
Carnegie Mellon University
Robotics Institute
5000 Forbes Avenue
Pittsburgh, PA 15213
Associated center(s) / consortia:
 Vision and Autonomous Systems Center (VASC)
Associated lab(s) / group(s):
 Vision for Virtual Environments
 Virtualized RealityTM
Overview
Scene flow is the three-dimensional motion field of points in the world, just as optical flow is the two-dimensional motion field of points in an image. Any optical flow is simply the projection of the scene flow onto the image plane of a camera. We have developed a framework for the computation of dense, non-rigid scene flow from optical flow. We have also developed an algorithm for computing 3D scene flow and 3D scene shape simultaneously. This second algorithm does not require the prior computation of optical flow. See the movie below for an example of a reconstructed 3D voxel model and the corresponding 3D scene flow. As the movie plays, the voxels in the 3D are "flowed" along the scene flow.

Image shows video sequence.

See our Spatio-Temporal View Interpolation algorithm for a better way of rendering such scenes across both space and time.