RI | Publications | Automated Facial Expression Recognition Based on FACS Action Units

Text only version of this site

Automated Facial Expression Recognition Based on FACS Action Units
J.J. Lien, T. Kanade, J. Cohn, and C. Li
Third IEEE International Conference on Automatic Face and Gesture Recognition, April, 1998, pp. 390-395.

Jump to: Download | Abstract | Notes | Text Reference | BibTeX Reference

Download [Help]

Adobe portable document format (pdf) [998 KB]
Compressed postscript (ps.gz) [1154 KB]

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

Automated recognition of facial expression is an important addition to computer vision research because of its relevance to the study of psychological phenomena and the development of human-computer interaction (HCI). We developed a computer vision system that automatically recognizes individual action units or action unit combinations in the upper face using hidden Markov models (HMMs). Our approach to facial expression recognition is based an the Facial Action Coding System (FACS), which separates expressions into upper and lower face action. We use three approaches to extract facial expression information: (1) facial feature point tracking; (2) dense flow tracking with principal component analysis (PCA); and (3) high gradient component detection (i.e. furrow detection). The recognition results of the upper face expressions using feature point tracking, dense flow tracking, and high gradient component detection are 85%, 93% and 85%,

respectively.

Notes

Associated center: VASC
Associated labs/groups: Face Group, Human Sensing, and Component Analysis
Associated projects: Facial Expression Analysis and Face Databases

Text Reference

J.J. Lien, T. Kanade, J. Cohn, and C. Li, "Automated Facial Expression Recognition Based on FACS Action Units," Third IEEE International Conference on Automatic Face and Gesture Recognition, April, 1998, pp. 390-395.

BibTeX Reference

@inproceedings{Lien_1998_1018,
   author = "Jenn-Jier James Lien and Takeo Kanade and Jeffrey Cohn and Ching-Chung Li",
   title = "Automated Facial Expression Recognition Based on FACS Action Units",
   booktitle = "Third IEEE International Conference on Automatic Face and Gesture Recognition",
   month = "April",
   year = "1998",
   pages = "390-395"
}