Nonrigid Structure from Motion in Trajectory Space

Ijaz Akhter, Yaser Ajmal Sheikh, Sohaib Khan, and Takeo Kanade
Neural Information Processing Systems, December, 2008.


Download
  • Adobe portable document format (pdf) (2MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
Existing approaches to nonrigid structure from motion assume that the instantaneous 3D shape of a deforming object is a linear combination of basis shapes, which have to be estimated anew for each video sequence. In contrast, we propose that the evolving 3D structure be described by a linear combination of basis trajectories. The principal advantage of this approach is that we do not need to estimate any basis vectors during computation. We show that generic bases over trajectories, such as the Discrete Cosine Transform (DCT) basis, can be used to compactly describe most real motions. This results in a significant reduction in unknowns, and corresponding stability in estimation. We report empirical performance, quantitatively using motion capture data, and qualitatively on several video sequences exhibiting nonrigid motions including piece-wise rigid motion, partially nonrigid motion (such as a facial expression), and highly nonrigid motion (such as a person dancing).

Notes
Associated Center(s) / Consortia: Vision and Autonomous Systems Center

Text Reference
Ijaz Akhter, Yaser Ajmal Sheikh, Sohaib Khan, and Takeo Kanade, "Nonrigid Structure from Motion in Trajectory Space," Neural Information Processing Systems, December, 2008.

BibTeX Reference
@inproceedings{Sheikh_2008_6196,
   author = "Ijaz Akhter and Yaser Ajmal Sheikh and Sohaib Khan and Takeo Kanade",
   title = "Nonrigid Structure from Motion in Trajectory Space",
   booktitle = "Neural Information Processing Systems",
   month = "December",
   year = "2008",
}