RI | Publications | Eye-State Action Unit Detection by Gabor Wavelets

Text only version of this site

Eye-State Action Unit Detection by Gabor Wavelets
Y. Tian, T. Kanade, and J. Cohn
Proceedings of the Third International Conference on Advances in Multimodal Interfaces (ICMI 2000), October, 2000.

Jump to: Download | Abstract | Notes | Text Reference | BibTeX Reference

Download [Help]

Adobe portable document format (pdf) [158 KB]

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

Eyes play important roles in emotion and paralinguistic communications. Detection of eye state is necessary for applications such as driver awareness systems. In this paper, we develop an automatic system to detect eye-state action units (AU) based on Facial Action Coding System (FACS) by use of Gabor wavelets in a nearly frontal-viewed image sequence. Three eye-state AU (AU 41, AU42, and AU43) are detected. After tracking the eye corners in the whole sequence, the eye appearance information is extracted at three points of each eye (i.e., inner corner, outer corner, and the point between the inner corner and the outer corner) as a set of multi-scale and multi-orientation Gabor coefficients. Then, the normalized Gabor coefficients are fed into a neural-network-based eye-state AU detector. An average recognition rate of 83% is obtained for 112 images from 17 image sequences of 12 subjects.

Notes

Associated center: VASC
Associated lab/group: Face Group

Number of pages: 8

Text Reference

Y. Tian, T. Kanade, and J. Cohn, "Eye-State Action Unit Detection by Gabor Wavelets," Proceedings of the Third International Conference on Advances in Multimodal Interfaces (ICMI 2000), October, 2000.

BibTeX Reference

@inproceedings{Tian_2000_4603,
   author = "Ying-Li Tian and Takeo Kanade and Jeffrey Cohn",
   title = "Eye-State Action Unit Detection by Gabor Wavelets",
   booktitle = "Proceedings of the Third International Conference on Advances in Multimodal Interfaces (ICMI 2000)",
   month = "October",
   year = "2000"
}