Uncalibrated perspective reconstruction of deformable structures

Jing Xiao and Takeo Kanade
Tenth IEEE International Conference on Computer Vision (ICCV '05), October, 2005, pp. 1075 - 1082.

  • Adobe portable document format (pdf) (289KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Reconstruction of 3D structures from uncalibrated image sequences has a wealthy history. Most work has been focused on rigid objects or static scenes. This paper studies the problem of perspective reconstruction of deformable structures such as dynamic scenes from an uncalibrated image sequence. The task requires decomposing the image measurements into a composition of three factors: 3D deformable structures, rigid rotations and translations, and intrinsic camera parameters. We develop a factorization algorithm that consists of two steps. In the first step we recover the protective depths iteratively using the sub-space constraints embedded in the image measurements of the deformable structures. In the second step, we scale the image measurements by the reconstructed projective depths. We then extend the linear closed-form solution for weak-perspective reconstruction by J. Xiao, et al. (2004) to factorize the scaled measurements and simultaneously reconstruct the deformable shapes and underlying shape model, the rigid motions, and the varying camera parameters such as focal lengths. The accuracy and robustness of the proposed method is demonstrated quantitatively on synthetic data and qualitatively on real image sequences.

Associated Center(s) / Consortia: Vision and Autonomous Systems Center
Number of pages: 6

Text Reference
Jing Xiao and Takeo Kanade, "Uncalibrated perspective reconstruction of deformable structures," Tenth IEEE International Conference on Computer Vision (ICCV '05), October, 2005, pp. 1075 - 1082.

BibTeX Reference
   author = "Jing Xiao and Takeo Kanade",
   title = "Uncalibrated perspective reconstruction of deformable structures",
   booktitle = "Tenth IEEE International Conference on Computer Vision (ICCV '05)",
   pages = "1075 - 1082",
   month = "October",
   year = "2005",
   volume = "2",