Search

Navigator: RI | Research | Projects | Scene Flow

Graphics enhanced version of this site

Scene Flow
This project is no longer active.

Head: Simon Baker
Contact: Simon Baker

Mailing address:
Carnegie Mellon University
Robotics Institute
5000 Forbes Avenue
Pittsburgh, PA 15213

Associated center: VASC
Associated labs/groups: Vision for Virtual Environments and Virtualized RealityTM

Jump to: Project Description | Personnel | Publications

Project Description

Scene flow is the three-dimensional motion field of points in the world, just as optical flow is the two-dimensional motion field of points in an image. Any optical flow is simply the projection of the scene flow onto the image plane of a camera. We have developed a framework for the computation of dense, non-rigid scene flow from optical flow. We have also developed an algorithm for computing 3D scene flow and 3D scene shape simultaneously. This second algorithm does not require the prior computation of optical flow. See the movie below for an example of a reconstructed 3D voxel model and the corresponding 3D scene flow. As the movie plays, the voxels in the 3D are "flowed" along the scene flow.

Image shows video sequence.

See our Spatio-Temporal View Interpolation algorithm for a better way of rendering such scenes across both space and time.

Past members

Publications

Note: This list may not be comprehensive. It contains only those publications in the RI publications database. Entries are listed in reverse chronological order.

The Robotics Institute is part of the School of Computer Science, Carnegie Mellon University.
For updates and comments, please see these instructions.
This page maintained by robotwebmaster@ri.cmu.edu