Eye-State Action Unit Detection by Gabor Wavelets

Ying-Li Tian, Takeo Kanade, and Jeffrey Cohn
Proceedings of the Third International Conference on Advances in Multimodal Interfaces (ICMI 2000), October, 2000.


Download
  • Adobe portable document format (pdf) (159KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
Eyes play important roles in emotion and paralinguistic communications. Detection of eye state is necessary for applications such as driver awareness systems. In this paper, we develop an automatic system to detect eye-state action units (AU) based on Facial Action Coding System (FACS) by use of Gabor wavelets in a nearly frontal-viewed image sequence. Three eye-state AU (AU 41, AU42, and AU43) are detected. After tracking the eye corners in the whole sequence, the eye appearance information is extracted at three points of each eye (i.e., inner corner, outer corner, and the point between the inner corner and the outer corner) as a set of multi-scale and multi-orientation Gabor coefficients. Then, the normalized Gabor coefficients are fed into a neural-network-based eye-state AU detector. An average recognition rate of 83% is obtained for 112 images from 17 image sequences of 12 subjects.

Notes
Associated Center(s) / Consortia: Vision and Autonomous Systems Center
Associated Lab(s) / Group(s): Face Group
Number of pages: 8

Text Reference
Ying-Li Tian, Takeo Kanade, and Jeffrey Cohn, "Eye-State Action Unit Detection by Gabor Wavelets," Proceedings of the Third International Conference on Advances in Multimodal Interfaces (ICMI 2000), October, 2000.

BibTeX Reference
@inproceedings{Tian_2000_4603,
   author = "Ying-Li Tian and Takeo Kanade and Jeffrey Cohn",
   title = "Eye-State Action Unit Detection by Gabor Wavelets",
   booktitle = "Proceedings of the Third International Conference on Advances in Multimodal Interfaces (ICMI 2000)",
   month = "October",
   year = "2000",
}