The Robotics Institute
Search the site
RI | Publications | Automatic recognition of eye blinking in spontaneously occurring behavior

Text only version of this site

Automatic recognition of eye blinking in spontaneously occurring behavior
T. Moriyama, T. Kanade, J. Cohn, J. Xiao, Z. Ambadar, J. Gao, and M. Imanura
Proceedings of the 16th International Conference on Pattern Recognition (ICPR '2002), Vol. 4, August, 2002, pp. 78 - 81.

Jump to: Download | Abstract | Notes | Text Reference | BibTeX Reference

Download [Help]

Adobe portable document format (pdf) [458 KB]

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

Previous research in automatic facial expression recognition has been limited to recognition of gross expression categories (e.g., joy or anger) in posed facial behavior under well-controlled conditions (e.g., frontal pose and minimal out-of-plane head motion). We developed a system that detects discrete and important facial actions, (e.g., eye blinking), in spontaneously occurring facial behavior with non-frontal pose, moderate out-of-plane head motion, and occlusion. The system recovers 3D motion parameters, stabilizes facial regions, extracts motion and appearance information, and recognizes discrete facial actions in spontaneous facial behavior. We tested the system in video data from a 2-person interview. Subjects were ethnically diverse, action units occurred during speech, and out-of-plane motion and occlusion from head motion and glasses were common. The video data were originally collected to answer substantive questions in psychology, and represent a substantial challenge to automated AU recognition. In the analysis of 335 single and multiple blinks and non-blinks, the system achieved 98% accuracy.

Notes

Associated center: VASC
Associated lab/group: Face Group
Associated project: Facial Expression Analysis

Number of pages: 4

Text Reference

T. Moriyama, T. Kanade, J. Cohn, J. Xiao, Z. Ambadar, J. Gao, and M. Imanura, "Automatic recognition of eye blinking in spontaneously occurring behavior," Proceedings of the 16th International Conference on Pattern Recognition (ICPR '2002), Vol. 4, August, 2002, pp. 78 - 81.

BibTeX Reference

@inproceedings{Moriyama_2002_4004,
   author = "Tsuyoshi Moriyama and Takeo Kanade and Jeffrey Cohn and Jing Xiao and Z. Ambadar and Jiang Gao and M. Imanura",
   title = "Automatic recognition of eye blinking in spontaneously occurring behavior",
   booktitle = "Proceedings of the 16th International Conference on Pattern Recognition (ICPR '2002)",
   month = "August",
   year = "2002",
   volume = "4",
   pages = "78 - 81"
}


The Robotics Institute is part of the School of Computer Science, Carnegie Mellon University.
For updates and comments, please see these instructions.
This page maintained by robotwebmaster@ri.cmu.edu