Non-rigid Face Tracking with Local Appearance Consistency Constraint

Yang Wang, Simon Lucey, Jeffrey Cohn, and Jason M. Saragih
8th IEEE International Conference on Automatic Face and Gesture Recognition, October, 2008.


Download
  • Adobe portable document format (pdf) (379KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
In this paper we present a new discriminative approach to achieve consistent and efficient tracking of non-rigid object motion, such as facial expressions. By utilizing both spatial and temporal appearance coherence at the patch level, the proposed approach can reduce ambiguity and increase accuracy. Recent research demonstrates that feature based approaches, such as constrained local models (CLMs), can achieve good performance in non-rigid object alignment/tracking using local region descriptors and a non-rigid shape prior. However, the matching performance of the learned generic patch experts is susceptible to local appearance ambiguity. Since there is no motion continuity constraint between neighboring frames of the same sequence, the resultant object alignment might not be consistent from frame to frame and the motion field is not temporally smooth. In this paper, we extend the CLM method into the spatio-temporal domain by enforcing the appearance consistency constraint of each local patch between neighboring frames. More importantly, we show that the global warp update can be optimized jointly in an efficient manner using convex quadratic fitting. Finally, we demonstrate that our approach receives improved performance for the task of non-rigid facial motion tracking on the videos of clinical patients.

Notes

Text Reference
Yang Wang, Simon Lucey, Jeffrey Cohn, and Jason M. Saragih, "Non-rigid Face Tracking with Local Appearance Consistency Constraint," 8th IEEE International Conference on Automatic Face and Gesture Recognition, October, 2008.

BibTeX Reference
@inproceedings{Wang_2008_6361,
   author = "Yang Wang and Simon Lucey and Jeffrey Cohn and Jason M Saragih",
   title = "Non-rigid Face Tracking with Local Appearance Consistency Constraint",
   booktitle = "8th IEEE International Conference on Automatic Face and Gesture Recognition",
   month = "October",
   year = "2008",
}