Graphics enhanced version of this site

Face Model Building and Fitting
This project is no longer active.

Head: Simon Baker
Contact: Simon Baker

Mailing address:
Carnegie Mellon University
Robotics Institute
5000 Forbes Avenue
Pittsburgh, PA 15213

Associated center: VASC
Associated lab/group: Face Group

We have been developing a variety of techniques to automatically build, update, and fit 2D and 3D models of human faces and heads. Please see the sub-projects below for more details.

Name - Title <Email Address>
• Simon Baker - Adjunct Faculty (Adjunct)
• Jordi Casoliva-Rodon - Research Associate II
• [Home] Fernando De la Torre Frade - Research Scientist <ftorre@cs.cmu.edu>
• [Home] Ralph Gross - PhD Student, ISRI <rgross@cs.cmu.edu>
• Takahiro Ishikawa - Visiting Industrial Scholar
• [Home] Takeo Kanade - U.A. and Helen Whitaker University Prof., RI/CS <tk@cs.cmu.edu>
• [Home] Simon Lucey - Systems Scientist <slucey+@andrew.cmu.edu>
• [Home] Iain Matthews - Senior Systems Scientist <iainm@cs.cmu.edu (Currently On Leave)>
• Krishnan Ramnath - Masters Student, RI
• [Home] Jeff Schneider - Assoc. Research Professor <schneide@cs.cmu.edu>
• [Home] Jing Xiao - PhD Student, RI

• 2D->3D Face Model Construction - We develop a linear algorithm that uniquely recovers the 3D non-rigid shapes and poses of a human face from a 2D monocular video.
• AAM Fitting Algorithms - Many varieties of algorithms for fitting Cootes and Taylor's "Active Appearance Models" are developed.
• Automatic Construction of Active Appearance Models - An algorithm for the automatic (unsupervised) construction of an Active Appearance Model.
• Template Update - We are developing an algorithm to update template tracking that avoids the "drifting" problem of the naive update algorithm.

• On the Multi-View Fitting and Construction of Dense Deformable Face Models
  K. Ramnath
  master's thesis, tech. report CMU-RI-TR-07-10, Robotics Institute, Carnegie Mellon University, May, 2007. [Abstract]
  Download: pdf [9822 KB] copyrighted

• Multi-View AAM Fitting and Camera Calibration
  S.C. Koterba, S. Baker, I. Matthews, C. Hu, J. Xiao, J. Cohn, and T. Kanade
  Proc. International Conference on Computer Vision, Vol. 1, October, 2005, pp. 511 - 518. [Abstract]
  Download: pdf [2053 KB] copyrighted

• Automatic Construction of Active Appearance Models as an Image Coding Problem
  S. Baker, I. Matthews, and J. Schneider
  IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 26, No. 10, October, 2004, pp. 1380 - 1384. [Abstract]
  Download: pdf [212 KB] copyrighted

• Fitting a Single Active Appearance Model Simultaneously to Multiple Images
  C. Hu, J. Xiao, I. Matthews, S. Baker, J. Cohn, and T. Kanade
  Proceedings of the British Machine Vision Conference, September, 2004. [Abstract]
  Download: pdf [2885 KB] copyrighted

• Generic vs. Person Specific Active Appearance Models
  R. Gross, I. Matthews, and S. Baker
  British Machine Vision Conference, September, 2004. [Abstract]
  Download: pdf [859 KB] copyrighted

• Constructing and Fitting Active Appearance Models With Occlusion
  R. Gross, I. Matthews, and S. Baker
  Proceedings of the IEEE Workshop on Face Processing in Video, June, 2004. [Abstract]
  Download: pdf [1008 KB] copyrighted

• Non-Rigid Shape and Motion Recovery: Degenerate Deformations
  J. Xiao and T. Kanade
  Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Vol. 1, June, 2004, pp. 668 - 675. [Abstract]
  Download: pdf [511 KB] copyrighted

• Real-Time Combined 2D+3D Active Appearance Models
  J. Xiao, S. Baker, I. Matthews, and T. Kanade
  Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Vol. 2, June, 2004, pp. 535 - 542. [Abstract]
  Download: pdf [5306 KB] copyrighted

• The Template Update Problem
  I. Matthews, T. Ishikawa, and S. Baker
  IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 26, No. 6, June, 2004, pp. 810 - 815. [Abstract]
  Download: pdf [340 KB] copyrighted

• Lucas-Kanade 20 Years On: A Unifying Framework
  S. Baker and I. Matthews
  International Journal of Computer Vision, Vol. 56, No. 3, March, 2004, pp. 221 - 255. [Abstract]
  Download: pdf [462 KB] copyrighted