Bilinear Active Appearance Models

Jose Gonzalez, Fernando De la Torre Frade, Rajesh Murthi, Nicolas Guil Mata, and E. Zapata
Workshop on Non-rigid Registration and Tracking through Learning, October, 2007.


Download
  • Adobe portable document format (pdf) (965KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
Appearance Models have been applied to model the space of human faces over the last two decades. In particular, Active Appearance Models (AAMs) have been successfully used for face tracking, synthesis and recognition, and they are one of the state-of-the-art approaches due to its efficiency and representational power. Although widely employed, AAMs suffer from a few drawbacks, such as the inability to isolate pose, identity and expression changes. This paper proposes Bilinear Active Appearance Models (BAAMs), an extension of AAMs, that effectively decouple changes due to pose and expression/identity. We derive a gradient-descent algorithm to efficiently fit BAAMs to new images. Experimental results show how BAAMs improve generalization and convergence with respect to the linear model. In addition, we illustrate decoupling benefits of BAAMs in face recognition across pose. We show how the pose normalization provided by BAAMs increase the recognition performance of commercial systems.

Keywords
Face tracking, Active Appearance Models, Bilinear models

Notes
Associated Center(s) / Consortia: Vision and Autonomous Systems Center
Associated Lab(s) / Group(s): Face Group and Component Analysis
Associated Project(s): Component Analysis for Data Analysis and Facial Expression Analysis
Number of pages: 8

Text Reference
Jose Gonzalez, Fernando De la Torre Frade, Rajesh Murthi, Nicolas Guil Mata, and E. Zapata, "Bilinear Active Appearance Models," Workshop on Non-rigid Registration and Tracking through Learning, October, 2007.

BibTeX Reference
@inproceedings{Gonzalez_2007_5845,
   author = "Jose Gonzalez and Fernando {De la Torre Frade} and Rajesh Murthi and Nicolas {Guil Mata} and E. Zapata",
   title = "Bilinear Active Appearance Models",
   booktitle = "Workshop on Non-rigid Registration and Tracking through Learning",
   month = "October",
   year = "2007",
}