RI | Publications | Simultaneous registration and clustering for temporal segmentation of facial gestures from video

Text only version of this site

Simultaneous registration and clustering for temporal segmentation of facial gestures from video
F. De la Torre Frade, J. Campoy, J. Cohn, and T. Kanade
2nd International Conference on Computer Vision Theory and Applications, March, 2007.

Jump to: Abstract | Notes | Text Reference | BibTeX Reference

Abstract

Temporal segmentation of facial gestures from video sequences is an important unsolved problem for automatic facial image analysis. At least two problems contribute to the challenge of temporal segmentation. These are the difficulty to register the rigid and non-rigid motion of the face, and the large variability in temporal scale of facial gestures. To address these challenges, we propose a two-step approach to temporally segment facial gestures. The first step clusters shape and appearance features invariantly to geometric transformations using Parameterized Cluster Analysis (PaCA). PaCA is a novel method that jointly performs registration and clustering. The second step temporally groups the resulting clusters into temporally coherent facial gestures. Analysis of simulated and real examples illustrates the benefits of our approach for temporal facial gesture segmentation.

Notes

Associated center: VASC
Associated labs/groups: People Image Analysis Consortium and Face Group
Associated projects: Spatio-Temporal Facial Expression Segmentation and Component Analysis for Data Analysis

Text Reference

F. De la Torre Frade, J. Campoy, J. Cohn, and T. Kanade, "Simultaneous registration and clustering for temporal segmentation of facial gestures from video," 2nd International Conference on Computer Vision Theory and Applications, March, 2007.

BibTeX Reference

@inproceedings{De la Torre Frade_2007_5716,
   author = "Fernando De la Torre Frade and Joan Campoy and Jeffrey Cohn and Takeo Kanade",
   title = "Simultaneous registration and clustering for temporal segmentation of facial gestures from video",
   booktitle = "2nd International Conference on Computer Vision Theory and Applications",
   month = "March",
   year = "2007"
}