Beyond Prototypic Expressions: Discriminating Subtle Changes in the Face

Jeffrey Cohn, Jenn-Jier James Lien, Takeo Kanade, Wei Hua, and Adena Zlochower
Proc. of the 7th IEEE Robot and Human Communications Workshop, 1998.


Download
  • Adobe portable document format (pdf) (727KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
Current approaches to automated analysis have focused on a small set of prototypic expressions (e.g., joy or anger). Prototypic expressions occur infrequently in everyday life, however, and emotion expression is far more varied. To capture the full range of emotion expression, automated discrimination of fine-grained changes in facial expression is needed. We developed and implemented a computer vision system, Automated Face Analysis, that is sensitive to subtle changes in the face. Three convergent modules extract feature information and discriminate FACS action units using Hidden Markov Models. The modules include feature-point and dense-flow tracking and high-gradient component detection. In image sequences from 100 young adults, action units and action unit combinations in the brow, eye, and mouth regions were selected for analysis if they occurred a minimum of 25 times in the image database. Selected facial features were automatically tracked using hierarchical algorithms to estimate optical flow and high-gradient components. Image sequences were randomly divided into training and test sets. Automated Face Analysis demonstrated high concurrent validity with manual FACS coding.

Notes
Associated Center(s) / Consortia: Vision and Autonomous Systems Center
Associated Lab(s) / Group(s): Face Group and Component Analysis
Associated Project(s): Facial Expression Analysis

Text Reference
Jeffrey Cohn, Jenn-Jier James Lien, Takeo Kanade, Wei Hua, and Adena Zlochower, "Beyond Prototypic Expressions: Discriminating Subtle Changes in the Face," Proc. of the 7th IEEE Robot and Human Communications Workshop, 1998.

BibTeX Reference
@inproceedings{Cohn_1998_2165,
   author = "Jeffrey Cohn and Jenn-Jier James Lien and Takeo Kanade and Wei Hua and Adena Zlochower",
   title = "Beyond Prototypic Expressions: Discriminating Subtle Changes in the Face",
   booktitle = "Proc. of the 7th IEEE Robot and Human Communications Workshop",
   year = "1998",
}