Graphics enhanced version of this site

Face View Synthesis Across Large Angles
J. Ni and H. Schneiderman
in Proceedings of the Second International Workshop on Analysis and Modeling of Faces and Gestures (AMFG 2005) held in conjunction with ICCV 2005, October, 2005.

Jump to: Download | Abstract | Notes | Text Reference | BibTeX Reference

Adobe portable document format (pdf) [1086 KB]

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Pose variations, especially large out-of-plane rotations, make face recognition a difficult problem. In this paper, we propose an algorithm that uses a single input image to accurately synthesize an image of the person in a different pose. We represent the two poses by stacking their information (pixels and feature locations) in a combined feature space. A given test vector will consist of a known part corresponding to the input image and a missing part corresponding to the synthesized image. We then solve for the missing part by maximizing the test vector's probability. This approach combines the ``distance-from-feature-space'' and ``distance-in-feature-space'', and maximizes the test vector's probability by minimizing a weighted sum of these two distances. Our approach does not require either 3D training data or a 3D model, and does not require correspondence between different poses. The algorithm is computationally efficient, and only takes 4 - 5 seconds to generate a face. Experimental results show that our approach produces more accurate results than the commonly used linear-object-class approach. Such technique can help face recognition to overcome the pose variation problem.

Number of pages: 17

J. Ni and H. Schneiderman, "Face View Synthesis Across Large Angles," in Proceedings of the Second International Workshop on Analysis and Modeling of Faces and Gestures (AMFG 2005) held in conjunction with ICCV 2005, October, 2005.

@inproceedings{Ni_2005_5137,
   author = "Jiang Ni and Henry Schneiderman",
   title = "Face View Synthesis Across Large Angles",
   booktitle = "in Proceedings of the Second International Workshop on Analysis and Modeling of Faces and Gestures (AMFG 2005) held in conjunction with ICCV 2005",
   month = "October",
   year = "2005"
}