Graphics enhanced version of this site

Face and Facial Feature Tracking
This project is no longer active.

Head: Simon Baker
Contact: Simon Baker

Mailing address:
Carnegie Mellon University
Robotics Institute
5000 Forbes Avenue
Pittsburgh, PA 15213

Associated center: VASC
Associated lab/group: Face Group

We have been developing a variety of techniques for the rigid tracking of peoples heads and faces, and the non-rigid tracking of their facial features such as eyes, eyebrows, lips, and cheeks. Please see the projects below for more details.

Name - Title <Email Address>
• Simon Baker - Adjunct Faculty (Adjunct)
• [Home] Jeffrey Cohn - Adjunct Faculty (Adjunct) <jeffcohn@cs.cmu.edu>
• [Home] Takeo Kanade - U.A. and Helen Whitaker University Prof., RI/CS <tk@cs.cmu.edu>
• [Home] Iain Matthews - Senior Systems Scientist <iainm@cs.cmu.edu (Currently On Leave)>
• [Home] Jing Xiao - PhD Student, RI

• 3D Head Motion Recovery in Real Time - A cylindrical model-based algorithm recovers the full motion (3D rotations and 3D translations) of the head in real time.
• AAM Fitting Algorithms - Many varieties of algorithms for fitting Cootes and Taylor's "Active Appearance Models" are developed.

Note: This list may not be comprehensive. It contains only those publications in the RI publications database. Entries are listed in reverse chronological order.

• Lucas-Kanade 20 Years On: A Unifying Framework
  S. Baker and I. Matthews
  International Journal of Computer Vision, Vol. 56, No. 3, March, 2004, pp. 221 - 255. [Abstract]
  Download: pdf [462 KB] copyrighted

• Lucas-Kanade 20 Years On: A Unifying Framework: Part 3
  S. Baker, R. Gross, and I. Matthews
  tech. report CMU-RI-TR-03-35, Robotics Institute, Carnegie Mellon University, November, 2003. [Abstract]
  Download: pdf [580 KB] copyrighted

• Active Appearance Models Revisited
  I. Matthews and S. Baker
  tech. report CMU-RI-TR-03-02, Robotics Institute, Carnegie Mellon University, April, 2003. [Abstract]
  Download: pdf [444 KB] copyrighted

• Lucas-Kanade 20 Years On: A Unifying Framework: Part 2
  S. Baker, R. Gross, I. Matthews, and T. Ishikawa
  tech. report CMU-RI-TR-03-01, Robotics Institute, Carnegie Mellon University, February, 2003. [Abstract]
  Download: pdf [467 KB] copyrighted

• Lucas-Kanade 20 Years On: A Unifying Framework: Part 1
  S. Baker and I. Matthews
  tech. report CMU-RI-TR-02-16, Robotics Institute, Carnegie Mellon University, July, 2002. [Abstract]
  Download: pdf [521 KB], ps.gz [436 KB] copyrighted

• Equivalence and Efficiency of Image Alignment Algorithms
  S. Baker and I. Matthews
  Proceedings of the 2001 IEEE Conference on Computer Vision and Pattern Recognition, Vol. 1, December, 2001, pp. 1090 - 1097. [Abstract]
  Download: pdf [165 KB], ps.gz [619 KB] copyrighted

• A Comparative Study of Alternative FACS Coding Algorithms
  J. Cohn, T. Kanade, T. Moriyama, Z. Ambadar, J. Xiao, J. Gao, and H. Imamura
  tech. report CMU-RI-TR-02-06, Robotics Institute, Carnegie Mellon University, November, 2001.
  Download: pdf [308 KB] copyrighted

• Aligning Images Incrementally Backwards
  S. Baker, F. Dellaert, and I. Matthews
  tech. report CMU-RI-TR-01-03, Robotics Institute, Carnegie Mellon University, February, 2001.
  Download: pdf [244 KB] copyrighted