A Multi-Method Approach for Discriminating Between Similar Facial Expressions, Including Expression Intensity Estimation

Jenn-Jier James Lien, Takeo Kanade, Jeffrey Cohn, and C. Li
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR '98), June, 1998.


Download
  • Adobe portable document format (pdf) (607KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
Facial expression provides sensitive cues about emotion and plays a major role in interpersonal and human-computer interaction. Most facial expression recognition systems have focused on only six basic emotions and their concomitant prototypic expressions posed by a small set of subjects. In reality, humans are capable of producing thousands of expressions that vary in complexity, intensity, and meaning. To represent the full range of facial expression, we developed a computer vision system that automatically recognizes individual action units (AUs) or AU combinations using Hidden Markov Models and estimates expression intensity. Three modules are used to extract facial expression information: (1) facial feature point tracking, (2) dense flow tracking with principal component analysis (PCA), and (3) high gradient component detection (i.e. furrow detection). The average recognition rate of upper and lower face expressions is 85% and 88%, respectively, using feature point tracking, 93% (upper face) using dense flow tracking with PCA, and 85% and 81%, upper and lower face respectively, using high gradient component detection.

Notes
Associated Center(s) / Consortia: Vision and Autonomous Systems Center
Associated Lab(s) / Group(s): Face Group

Text Reference
Jenn-Jier James Lien, Takeo Kanade, Jeffrey Cohn, and C. Li, "A Multi-Method Approach for Discriminating Between Similar Facial Expressions, Including Expression Intensity Estimation," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR '98), June, 1998.

BibTeX Reference
@inproceedings{Lien_1998_3109,
   author = "Jenn-Jier James Lien and Takeo Kanade and Jeffrey Cohn and C. Li",
   title = "A Multi-Method Approach for Discriminating Between Similar Facial Expressions, Including Expression Intensity Estimation",
   booktitle = "Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR '98)",
   month = "June",
   year = "1998",
}