|
|
|
|
RI | Publications | MultiState Based Facial Feature Tracking and Detection
|
|
Text only version of this site
MultiState Based Facial Feature Tracking and Detection
Y. Tian, T. Kanade, and J. Cohn
tech. report CMU-RI-TR-99-18, Robotics Institute, Carnegie Mellon University, August, 1999.
Jump to: Download | Abstract | Notes | Text Reference | BibTeX Reference
| Download [Help] |
Adobe portable document format (pdf) [1445 KB] Compressed postscript (ps.gz) [7262 KB]
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.
| Abstract |
Accurately and robustly tracking facial features must cope with the large variation in appearance across subjects and the combination of rigid and nonrigid motion. We present a work toward a robust system to detect and track facial features including both permanent (e.g. mouth, eye, and brow) and transient (e.g. furrows and wrinkles) facial features in a nearly frontal image sequence. Multistate facial component models are proposed for tracking and modeling different facial features. Based on these multistate models, and without any artificial enhancement, we detect and track the facial features, including mouth, eyes, brows, cheeks, and their related wrinkles and facial furrows by combining color, shape, edge and motion information. Given the initial location of the facial features in the first frame, the facial features can be detected or tracked in remainder images automatically. Our system is tested on 500 image sequences from the PittsburghCarnegie Mellon University (PittCMU) Facial Expression Action Unit (AU) Coded Database, which includes image sequences from children and adults of European, African, and Asian ancestry. Accurate tracking results are obtained in 98% of image sequences.
| Notes |
Sponsor: NIMH
Grant ID: 1R01MH51435
Associated center: VASC
Associated labs/groups: Face Group and Human Sensing
Associated project: Face Databases
| Text Reference |
Y. Tian, T. Kanade, and J. Cohn, MultiState Based Facial Feature Tracking and Detection, tech. report CMU-RI-TR-99-18, Robotics Institute, Carnegie Mellon University, August, 1999.
| BibTeX Reference |
@techreport{Tian_1999_3192,
author = "Ying-Li Tian and Takeo Kanade and Jeffrey Cohn",
title = "MultiState Based Facial Feature Tracking and Detection",
institution = "Robotics Institute, Carnegie Mellon University",
month = "August",
year = "1999",
number = "CMU-RI-TR-99-18",
address = "Pittsburgh, PA"
}