Principal Component Analysis with Missing Data and its Application to Polyhedral Object Modeling

Heung-Yeung Shum, Katsushi Ikeuchi, and Raj Reddy
IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 17, No. 9, September, 1995, pp. 854-867.


Download
  • Adobe portable document format (pdf) (1MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
Observation-based object modeling often requires integration of shape descriptions from different views. To overcome the problems of errors and their accumulation, we have developed a weighted least-squares (WLS) approach which simultaneously recovers object shape and transformation among different views without recovering interframe motion. We show that object modeling from a range image sequence is a problem of principal component analysis with missing data (PCAMD), which can be generalized as a WLS minimization problem. An efficient algorithm is devised. After we have segmented planar surface regions in each view and tracked them over the image sequence, we construct a normal measurement matrix of surface normals, and a distance measurement matrix of normal distances to the origin for all visible regions over the whole sequence of views, respectively. These two matrices, which have many missing elements due to noise, occlusion, and mismatching, enable us to formulate multiple view merging as a combination of two WLS problems. A two-step algorithm is presented. After surface equations are extracted, spatial connectivity among the surfaces is established to enable the polyhedral object model to be constructed. Experiments using synthetic data and real range images show that our approach is robust against noise and mismatching and generates accurate polyhedral object models.

Notes
Note: note that this paper has been previously published in CVPR'94

Text Reference
Heung-Yeung Shum, Katsushi Ikeuchi, and Raj Reddy, "Principal Component Analysis with Missing Data and its Application to Polyhedral Object Modeling," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 17, No. 9, September, 1995, pp. 854-867.

BibTeX Reference
@article{Shum_1995_1791,
   author = "Heung-Yeung Shum and Katsushi Ikeuchi and Raj Reddy",
   title = "Principal Component Analysis with Missing Data and its Application to Polyhedral Object Modeling",
   journal = "IEEE Transactions on Pattern Analysis and Machine Intelligence",
   pages = "854-867",
   month = "September",
   year = "1995",
   volume = "17",
   number = "9",
   Notes = "note that this paper has been previously published in CVPR'94"
}