Feature-point tracking by optical flow discriminates subtle differences in facial expression

Jeffrey Cohn, Adena Zlochower, Jenn-Jier James Lien, and Takeo Kanade
Proceedings of the 3rd IEEE International Conference on Automatic Face and Gesture Recognition (FG '98), April, 1998, pp. 396 - 401.


Download
  • Adobe portable document format (pdf) (758KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
Current approaches to automated analysis have focused an a small set of prototypic expressions (e.g. joy or anger). Prototypic expressions occur infrequently in everyday life, however, and emotion expression is far more varied. To capture the full range of emotion expression, automated discrimination of fine grained changes in facial expression is needed. We developed and implemented an optical flow based approach (feature point tracking) that is sensitive to subtle changes in facial expression. In image sequences from 100 young adults, action units and action unit combinations in the brow and mouth regions were selected for analysis if they occurred a minimum of 25 times in the image database. Selected facial features were automatically tracked using a hierarchical algorithm for estimating optical flow. Image sequences were randomly divided into training and test sets. Feature point tracking demonstrated high concurrent validity with human coding using the Facial Action Coding System (FACS).

Notes
Associated Center(s) / Consortia: Vision and Autonomous Systems Center
Associated Lab(s) / Group(s): Face Group

Text Reference
Jeffrey Cohn, Adena Zlochower, Jenn-Jier James Lien, and Takeo Kanade, "Feature-point tracking by optical flow discriminates subtle differences in facial expression," Proceedings of the 3rd IEEE International Conference on Automatic Face and Gesture Recognition (FG '98), April, 1998, pp. 396 - 401.

BibTeX Reference
@inproceedings{Cohn_1998_2075,
   author = "Jeffrey Cohn and Adena Zlochower and Jenn-Jier James Lien and Takeo Kanade",
   title = "Feature-point tracking by optical flow discriminates subtle differences in facial expression",
   booktitle = "Proceedings of the 3rd IEEE International Conference on Automatic Face and Gesture Recognition (FG '98)",
   pages = "396 - 401",
   month = "April",
   year = "1998",
}