Integrating Monolithic and Free-parts Representations for Improved Face Verification in the Presence of Pose Mismatch

Simon Lucey and Tsuhan Chen
tech. report , Electrical and Computer Engineering, Carnegie Mellon University, October, 2004


Download
  • Adobe portable document format (pdf) (263KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
Face images, varying under pose, are dramatically different in their ?ixel?appearance even if they stem from the same subject. Our work concentrates specifically on the task of verifying faces when the gallery set stems from frontal face images, with the probe set stemming from a number of alternate poses (i.e. pose mismatch). An argument is put forward for attempting to recognize faces through integrating holistic/monolithic and free-parts representations. Canonical monolithic representations are investigated such as Eigenface and Fisherface techniques, as well as recent techniques that are able to deal with pose specifically, such as Eigen-light fields. Similarly, parts representations are investigated, with particular attention being paid to Free- Parts Gaussian Mixture Models (FP-GMMs) as a useful representation. A contribution is made via the analysis of what traits, in a face, are most useful for each representation. Finally, we are able to demonstrate that there is: a) benefit in combining free-parts and monolithic representations, and b) further benefit can be obtained by varying the weight placed on each representation as a function of view point.

Notes
Associated Center(s) / Consortia: Vision and Autonomous Systems Center
Associated Lab(s) / Group(s): Face Group

Text Reference
Simon Lucey and Tsuhan Chen, "Integrating Monolithic and Free-parts Representations for Improved Face Verification in the Presence of Pose Mismatch," tech. report , Electrical and Computer Engineering, Carnegie Mellon University, October, 2004

BibTeX Reference
@techreport{Lucey_2004_5279,
   author = "Simon Lucey and Tsuhan Chen",
   title = "Integrating Monolithic and Free-parts Representations for Improved Face Verification in the Presence of Pose Mismatch",
   booktitle = "",
   institution = "Electrical and Computer Engineering",
   month = "October",
   year = "2004",
}