Quo Vadis Face Recognition?

Ralph Gross, Jianbo Shi, and Jeffrey Cohn
Third Workshop on Empirical Evaluation Methods in Computer Vision, December, 2001.

  • Adobe portable document format (pdf) (534KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Within the past decade, major advances have occurred in face recognition. With few exceptions, however, most research has been limited to training and testing on frontal views. Little is known about the extent to which face pose, illumination, expression, occlusion, and individual differences, such as those associated with gender, influence recognition accuracy. We systematically varied these factors to test the performance of two leading algorithms, one template based and the other feature based. Image data consisted of over 21000 images from 3 publicly available databases: CMU PIE, Cohn-Kanade, and AR databases. In general, both algorithms were robust to variation in illumination and expression. Recognition accuracy was highly sensitive to variation in pose. For frontal training images, performance was attenuated beginning at about 15 degrees. Beyond about 30 degrees, performance became unacceptable. For non-frontal training images, fall off was more severe. Small but consistent differences were found for individual differences in subjects. These findings suggest direction for future research, including design of experiments and data collection.

Associated Center(s) / Consortia: Vision and Autonomous Systems Center
Associated Lab(s) / Group(s): Human Identification at a Distance, Face Group, Component Analysis
Associated Project(s): Face Recognition Across Pose, Face Recognition, Facial Expression Analysis

Text Reference
Ralph Gross, Jianbo Shi, and Jeffrey Cohn, "Quo Vadis Face Recognition?," Third Workshop on Empirical Evaluation Methods in Computer Vision, December, 2001.

BibTeX Reference
   author = "Ralph Gross and Jianbo Shi and Jeffrey Cohn",
   title = "Quo Vadis Face Recognition?",
   booktitle = "Third Workshop on Empirical Evaluation Methods in Computer Vision",
   month = "December",
   year = "2001",