Simultaneous registration and clustering for temporal segmentation of facial gestures from video

Fernando De la Torre Frade, Joan Campoy, Jeffrey Cohn, and Takeo Kanade
2nd International Conference on Computer Vision Theory and Applications, March, 2007.


Abstract
Temporal segmentation of facial gestures from video sequences is an important unsolved problem for automatic facial image analysis. At least two problems contribute to the challenge of temporal segmentation. These are the difficulty to register the rigid and non-rigid motion of the face, and the large variability in temporal scale of facial gestures. To address these challenges, we propose a two-step approach to temporally segment facial gestures. The first step clusters shape and appearance features invariantly to geometric transformations using Parameterized Cluster Analysis (PaCA). PaCA is a novel method that jointly performs registration and clustering. The second step temporally groups the resulting clusters into temporally coherent facial gestures. Analysis of simulated and real examples illustrates the benefits of our approach for temporal facial gesture segmentation.

Keywords
Clustering, registration, facial expression analysis, temporal segmentation

Notes
Associated Center(s) / Consortia: Vision and Autonomous Systems Center
Associated Lab(s) / Group(s): People Image Analysis Consortium and Face Group
Associated Project(s): Spatio-Temporal Facial Expression Segmentation and Component Analysis for Data Analysis

Text Reference
Fernando De la Torre Frade, Joan Campoy, Jeffrey Cohn, and Takeo Kanade, "Simultaneous registration and clustering for temporal segmentation of facial gestures from video," 2nd International Conference on Computer Vision Theory and Applications, March, 2007.

BibTeX Reference
@inproceedings{De_la_Torre_Frade_2007_5716,
   author = "Fernando {De la Torre Frade} and Joan Campoy and Jeffrey Cohn and Takeo Kanade",
   title = "Simultaneous registration and clustering for temporal segmentation of facial gestures from video",
   booktitle = "2nd International Conference on Computer Vision Theory and Applications",
   month = "March",
   year = "2007",
}