Resolution-Aware Fitting of Active Appearance Models to Low-Resolution Images

Goksel Dedeoglu, Simon Baker, and Takeo Kanade
Proceedings of the 9th European Conference on Computer Vision, ECCV 2006, May, 2006, pp. 83 - 97.


Download
  • Adobe portable document format (pdf) (2MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
Active Appearance Models (AAM) are compact representations of the shape and appearance of objects. Fitting AAMs to images is a difficult, non-linear optimization task. Traditional approaches minimize the L2 norm error between the model instance and the input image warped onto the model coordinate frame. While this works well for high resolution data, the fitting accuracy degrades quickly at lower resolutions. In this paper, we show that a careful design of the fitting criterion can overcome many of the low resolution challenges. In our resolution-aware formulation (RAF), we explicitly account for the finite size sensing elements of digital cameras, and simultaneously model the processes of object appearance variation, geometric deformation, and image formation. As such, our Gauss-Newton gradient descent algorithm not only synthesizes model instances as a function of estimated parameters, but also simulates the formation of low resolution images in a digital camera. We compare the RAF algorithm against a state-of-the-art tracker across a variety of resolution and model complexity levels. Experimental results show that RAF considerably improves the estimation accuracy of both shape and appearance parameters when fitting to low resolution data.

Keywords
Active Appearance Models, tracking, image analysis

Notes
Associated Center(s) / Consortia: Vision and Autonomous Systems Center
Associated Lab(s) / Group(s): Face Group
Associated Project(s): Image Enhancement for Faces
Number of pages: 14

Text Reference
Goksel Dedeoglu, Simon Baker, and Takeo Kanade, "Resolution-Aware Fitting of Active Appearance Models to Low-Resolution Images," Proceedings of the 9th European Conference on Computer Vision, ECCV 2006, May, 2006, pp. 83 - 97.

BibTeX Reference
@inproceedings{Dedeoglu_2006_5318,
   author = "Goksel Dedeoglu and Simon Baker and Takeo Kanade",
   title = "Resolution-Aware Fitting of Active Appearance Models to Low-Resolution Images",
   booktitle = "Proceedings of the 9th European Conference on Computer Vision, ECCV 2006",
   pages = "83 - 97",
   publisher = "Springer-Verlag",
   month = "May",
   year = "2006",
   volume = "II",
   number = "3952",
}