Graphics enhanced version of this site

Appearance-Based Face Recognition and Light-Fields
R. Gross, I. Matthews, and S. Baker
IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 26, No. 4, April, 2004, pp. 449 - 465.

Jump to: Download | Abstract | Notes | Text Reference | BibTeX Reference

Adobe portable document format (pdf) [775 KB]

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Arguably the most important decision to be made when developing an object recognition algorithm is selecting the scene measurements or features on which to base the algorithm. In appearance-based object recognition the features are chosen to be the pixel intensity values in an image of the object. These pixel intensities correspond directly to the radiance of light emitted from the object along certain rays in space. The set of all such radiance values over all possible rays is known as the plenoptic function or light-field. In this paper we develop a theory of appearance-based object recognition from light-fields. This theory leads directly to an algorithm for face recognition across pose that uses as many images of the face as are available, from one upwards. All of the pixels, whichever image they come from, are treated equally and used to estimate the (eigen) light-field of the object. The eigen light-field is then used as the set of features on which to base recognition, analogously to how the pixel intensities are used in appearance-based face and object recognition.

Sponsor: US Office of Naval Research
Grant ID: N00014-00-1-0915

Associated center: VASC
Associated labs/groups: Human Identification at a Distance and Face Group
Associated projects: Light-fields, Face Recognition Across Pose, and Face Recognition

Number of pages: 37

R. Gross, I. Matthews, and S. Baker, "Appearance-Based Face Recognition and Light-Fields," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 26, No. 4, April, 2004, pp. 449 - 465.

@article{Gross_2004_4506,
   author = "Ralph Gross and Iain Matthews and Simon Baker",
   title = "Appearance-Based Face Recognition and Light-Fields",
   journal = "IEEE Transactions on Pattern Analysis and Machine Intelligence",
   month = "April",
   year = "2004",
   volume = "26",
   number = "4",
   pages = "449 - 465"
}