RI | Research | Projects | Spatio-Temporal Facial Expression Segmentation

Text only version of this site

Spatio-Temporal Facial Expression Segmentation Head: Fernando De la Torre Frade Contact: Fernando De la Torre Frade (ftorre@cs.cmu.edu) Mailing address: Carnegie Mellon University Robotics Institute 211 Smith Hall Pittsburgh, PA 15213 Associated center: VASC Associated labs/groups: People Image Analysis Consortium and Face Group

Jump to: Project Description | Personnel | Publications

Project Description

Temporal segmentation of facial gestures from video sequences is an important unsolved problem for automatic facial image analysis. At least two problems contribute to the challenge of temporal segmentation. These are the difficulty to register the rigid and non-rigid motion of the face, and the large variability in temporal scale of facial gestures. To address these challenges, we propose a two-step approach to temporally segment facial gestures. The first step clusters shape and appearance features invariantly to geometric transformations using Parameterized Cluster Analysis (PaCA). PaCA is a novel method that jointly performs registration and clustering. The second step temporally groups the resulting clusters into temporally coherent facial gestures.

Personnel

	Name	Title	Email Address
	Joan Campoy	Research Associate	tm08308@salle.url.edu
	Jeffrey Cohn	Adjunct Faculty (Adjunct)	jeffcohn@cs.cmu.edu
	Fernando De la Torre Frade	Research Scientist	ftorre@cs.cmu.edu
	Takeo Kanade	U.A. and Helen Whitaker University Prof., RI/CS	tk@cs.cmu.edu

Publications

Note: This list may not be comprehensive. It contains only those publications in the RI publications database. Entries are listed in reverse chronological order.

• Temporal Segmentation of Facial Behavior
  F. De la Torre Frade, J. Campoy, Z. Ambadar, and J.F. Cohn
  International Conference on Computer Vision, October, 2007. [Abstract]
  Download: pdf [3061 KB] copyrighted

• Simultaneous registration and clustering for temporal segmentation of facial gestures from video
  F. De la Torre Frade, J. Campoy, J. Cohn, and T. Kanade
  2nd International Conference on Computer Vision Theory and Applications, March, 2007. [Abstract]