RI Homepage Carnegie Mellon Homepage RI Homepage

The Robotics Institute

Carnegie Mellon Robotics Institute

Unsupervised Discovery of Facial Events

Feng Zhou, Fernando De la Torre Frade, and Jeffrey Cohn
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June, 2010.


Download
  • Adobe portable document format (pdf) (8MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
Automatic facial image analysis has been a long standing research problem in computer vision. A key component in facial image analysis, largely conditioning the success of subsequent algorithms (e.g., facial expression recognition), is to define a vocabulary of possible dynamic facial events. To date, that vocabulary has come from the anatomically-based Facial Action Coding System (FACS) or more subjective approaches (i.e., emotion-specified expressions). The aim of this paper is to discover facial events directly from video of naturally occurring facial behavior, without recourse to FACS or other labeling schemes. To discover facial events, we propose a novel temporal clustering algorithm, Aligned Cluster Analysis (ACA), and a multi-subject correspondence algorithm for matching expressions. We use a variety of video sources: posed facial behavior (Cohn-Kanade database), unscripted facial behavior (RU-FACS database) and some video in infants. ACA achieved moderate intersystem agreement with manual FACS coding and proved informative as a visualization/summarization tool.

Notes

Text Reference
Feng Zhou, Fernando De la Torre Frade, and Jeffrey Cohn, "Unsupervised Discovery of Facial Events," IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June, 2010.

BibTeX Reference
@inproceedings{Zhou_2010_7020,
   author = "Feng Zhou and Fernando {De la Torre Frade} and Jeffrey Cohn",
   title = "Unsupervised Discovery of Facial Events",
   booktitle = "IEEE Conference on Computer Vision and Pattern Recognition (CVPR)",
   month = "June",
   year = "2010",
}

The Robotics Institute is part of the School of Computer Science, Carnegie Mellon University.
Contact Us | Update Instructions