A Sequential Factorization Method for Recovering Shape and Motion from Image Streams

T. Morita and Takeo Kanade
Proceedings of the 1994 ARPA Image Understanding Workshop, December, 1994, pp. 1177 - 1188.


Download
  • Adobe portable document format (pdf) (149KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
We present a sequential factorization method for recovering the three-dimensional shape of an object and the motion of the camera from a sequence of images, using tracked features. The factorization method originally proposed by Tomasi and Kanade produces robust and accurate results incorporating the singular value decomposition. However, it is still difficult to apply the method to real-time applications since it is based on a batch-type operation and the cost of the singular value decomposition is large. We develop the factorization method into a sequential method by regarding the feature positions as a vector time series. The new method produces estimates of shape and motion at each frame. The singular value decomposition is replaced with an updating computation of only three dominant eigenvectors, which can be performed in time, while the complete singular value decomposition requires operations for an matrix. Also, the method is able to handle infinite sequences since it does not store any increasingly large matrices. Experiments using synthetic and real images illustrate that the method has nearly the same accuracy and robustness as the original method.

Notes
Associated Project(s): Modeling by Videotape

Text Reference
T. Morita and Takeo Kanade, "A Sequential Factorization Method for Recovering Shape and Motion from Image Streams," Proceedings of the 1994 ARPA Image Understanding Workshop, December, 1994, pp. 1177 - 1188.

BibTeX Reference
@inproceedings{Kanade_1994_2682,
   author = "T. Morita and Takeo Kanade",
   title = "A Sequential Factorization Method for Recovering Shape and Motion from Image Streams",
   booktitle = "Proceedings of the 1994 ARPA Image Understanding Workshop",
   pages = "1177 - 1188",
   month = "December",
   year = "1994",
   volume = "2",
}