Non-Rigid Shape and Motion Recovery: Degenerate Deformations

Jing Xiao and Takeo Kanade
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, June, 2004, pp. 668 - 675.

  • Adobe portable document format (pdf) (512KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

This paper studies the problem of 3D non-rigid shape and motion recovery from a monocular video sequence, under the degenerate deformations. The shape of a deformable object is regarded as a linear combination of certain shape bases. When the bases are non-degenerate, i.e. of full rank 3, a closed-form solution exists by enforcing linear constraints on both the camera rotation and the shape bases [18]. In practice, degenerate deformations occur often, i.e. some bases are of rank 1 or 2. For example, cars moving or pedestrians walking independently on a straight road refer to rank-1 deformations of the scene. This paper quantitatively shows that, when the shape is composed of only rank-3 and rank-1 bases, i.e. the 3D points either are static or independently move along straight lines, the linear rotation and basis constraints are sufficient to achieve a unique solution. When the shape bases contain rank-2 ones, imposing only the linear constraints results in an ambiguous solution space. In such cases, we propose an alternating linear approach that imposes the positive semi-definite constraint to determine the desired solution in the solution space. The performance of the approach is evaluated quantitatively on synthetic data and qualitatively on real videos.

structure from Motion, degenerate deformations, factorization

Sponsor: National Institute of Mental Health
Grant ID: R01 MH51435
Associated Center(s) / Consortia: Vision and Autonomous Systems Center
Associated Lab(s) / Group(s): Vision for Safe Driving, People Image Analysis Consortium, Human Identification at a Distance, Face Group, Component Analysis
Associated Project(s): Facial Expression Analysis, Face Model Building and Fitting, AAM Fitting Algorithms, 2D->3D Face Model Construction
Number of pages: 8

Text Reference
Jing Xiao and Takeo Kanade, "Non-Rigid Shape and Motion Recovery: Degenerate Deformations," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, June, 2004, pp. 668 - 675.

BibTeX Reference
   author = "Jing Xiao and Takeo Kanade",
   title = "Non-Rigid Shape and Motion Recovery: Degenerate Deformations",
   booktitle = "Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition",
   pages = "668 - 675",
   month = "June",
   year = "2004",
   volume = "1",