Graphics enhanced version of this site

Automatic analysis and recognition of brow actions and head motion in spontaneous facial behavior
J. Cohn, L.I. Reed, Z. Ambadar, J. Xiao, and T. Moriyama
Proceedings of the IEEE Conference on Systems, Man, and Cybernetics, Vol. 1, October, 2004, pp. 610 - 616.

Jump to: Download | Abstract | Notes | Text Reference | BibTeX Reference

Adobe portable document format (pdf) [219 KB]

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Previous efforts in automatic facial expression recognition have been limited to posed facial behavior under well-controlled conditions (e.g., frontal pose and minimal out-of-plane head motion). The CMU/Pitt automated facial image analysis system (AFA) accommodates varied pose, moderate out-of-plane head motion, and occlusion. AFA was tested in video of two-person interviews originally collected to answer substantive questions in psychology, and represent a substantial challenge to automatic recognition of facial expression. This report focuses on two action units, brow raising and brow lowering because of their importance to emotion expression and paralinguistic communication. For two-state recognition, AFA achieved 89% accuracy. For three-state recognition (brow raising, brow lowering, and no brow action), accuracy was 76%. Brow and head motion were temporally coordinated. These findings demonstrate the feasibility of action unit recognition in spontaneous facial behavior.

Associated center: VASC
Associated lab/group: Face Group
Associated project: Facial Expression Analysis

Number of pages: 7

Note: in press

J. Cohn, L.I. Reed, Z. Ambadar, J. Xiao, and T. Moriyama, "Automatic analysis and recognition of brow actions and head motion in spontaneous facial behavior," Proceedings of the IEEE Conference on Systems, Man, and Cybernetics, Vol. 1, October, 2004, pp. 610 - 616.

@inproceedings{Cohn_2004_4810,
   author = "Jeffrey Cohn and L.I. Reed and Zara Ambadar and Jing Xiao and Tsuyoshi Moriyama",
   title = "Automatic analysis and recognition of brow actions and head motion in spontaneous facial behavior",
   booktitle = "Proceedings of the IEEE Conference on Systems, Man, and Cybernetics",
   month = "October",
   year = "2004",
   volume = "1",
   pages = "610 - 616",
   note = "in press"
}