Robust Full Motion Recovery of Head by Dynamic Templates and Re-registration Techniques

Jing Xiao, Takeo Kanade, and Jeffrey Cohn
Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition (FG'02), May, 2002, pp. 156 - 162.


Download
  • Adobe portable document format (pdf) (7MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
This paper presents a method to recover the full-motion (3 rotations and 3 translations) of the head using a cylindrical model. The robustness of the approach is achieved by a combination of three techniques. First, we use the iteratively re-weighted least squares (IRLS) technique in conjunction with the image gradient to deal with non-rigid motion and occlusion. Second, while tracking, the templates are dynamically updated to diminish the effects of self-occlusion and gradual lighting changes and keep tracking the head when most of the face is not visible. Third, because the dynamic templates may cause error accumulation, we re-register images to a reference frame when head pose is close to a reference pose. The performance of the real-time tracking program was evaluated in three separate experiments using image sequences (both synthetic and real) for which ground truth head motion is known. The real sequences included pitch and yaw of as large as 40?and 75? respectively. The average recovery accuracy of the 3D rotations was found to be about 3?

Notes
Associated Center(s) / Consortia: Vision and Autonomous Systems Center
Associated Lab(s) / Group(s): Face Group and Component Analysis
Associated Project(s): Facial Expression Analysis
Number of pages: 7

Text Reference
Jing Xiao, Takeo Kanade, and Jeffrey Cohn, "Robust Full Motion Recovery of Head by Dynamic Templates and Re-registration Techniques," Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition (FG'02), May, 2002, pp. 156 - 162.

BibTeX Reference
@inproceedings{Xiao_2002_4005,
   author = "Jing Xiao and Takeo Kanade and Jeffrey Cohn",
   title = "Robust Full Motion Recovery of Head by Dynamic Templates and Re-registration Techniques",
   booktitle = "Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition (FG'02)",
   pages = "156 - 162",
   month = "May",
   year = "2002",
}