Graphics enhanced version of this site

Facial Expression Analysis
Head: Jeffrey Cohn
Contact: Jeffrey Cohn (jeffcohn@cs.cmu.edu)

Mailing address:
Carnegie Mellon University
Robotics Institute
5000 Forbes Avenue
Pittsburgh, PA 15213

Associated center: VASC
Associated lab/group: Face Group

Facial expression provides cues about emotion, regulates interpersonal behavior, and communicates psychopathology. Human-observer based methods for measuring facial expression are labor intensive, qualitative, and difficult to standardize across laboratories, clinical settings, and over time. To make feasible more rigorous, quantitative measurement of facial expression in diverse applications, computer and behavioral scientists at Carnegie Mellon University and the University of Pittsburgh formed an interdisciplinary research team. The team has developed the CMU/Pitt Automated Facial Image Analysis (AFA) system that is capable of automatically recognizing facial action units, analyzing their timing in facial behavior, and rendering real-time photorealistic avatars.

Current efforts use AFA to enable reliable, valid, and efficient measurement of emotion expression, assess symptom severity in depression and physical pain, and investigate human social dynamics. To meet these goals, we pursue basic research to further improve algorithms and capabilities of the AFA system.

Name - Title <Email Address>
• Zara Ambadar - Postdoctoral Fellow, UPitt <ambadar+@pitt.edu>
• [Home] Jeffrey Cohn - Adjunct Faculty (Adjunct) <jeffcohn@cs.cmu.edu>
• [Home] Fernando De la Torre Frade - Research Scientist <ftorre@cs.cmu.edu>
• [Home] Takeo Kanade - U.A. and Helen Whitaker University Prof., RI/CS <tk@cs.cmu.edu>
• Simon Lucey - Systems Scientist <slucey+@andrew.cmu.edu>
• [Home] Iain Matthews - Senior Systems Scientist <iainm@cs.cmu.edu (Currently On Leave)>
• Jason M Saragih - Postdoctoral Fellow <jsaragih@andrew.cmu.edu>
• [Home] Yang Wang - Postdoctoral Fellow <wangy@andrew.cmu.edu>

• Bilinear Active Appearance Models
  J. Gonzalez, F. De la Torre Frade, R. Murthi, N. Guil Mata, and E. Zapata
  Workshop on Non-rigid Registration and Tracking through Learning, October, 2007. [Abstract]
  Download: pdf [965 KB] copyrighted

• Non-Rigid Object Alignment with a Mismatch Template Based on Exhaustive Local Search
  Y. Wang, S. Lucey, and J. Cohn
  IEEE Workshop on Non-rigid Registration and Tracking through Learning - NRTL 2007, October, 2007. [Abstract]
  Download: pdf [1845 KB], ps.gz [3043 KB] copyrighted

• Temporal Segmentation of Facial Behavior
  F. De la Torre Frade, J. Campoy, Z. Ambadar, and J.F. Cohn
  International Conference on Computer Vision, October, 2007. [Abstract]
  Download: pdf [3061 KB] copyrighted

• Investigating Spontaneous Facial Action Recognition through AAM Representations of the Face
  S. Lucey, A.B. Ashraf, and J. Cohn
  Face Recognition Book, K. Kurihara, ed., Pro Literatur Verlag, Mammendorf, Germany, April, 2007. [Abstract]
  Download: pdf [1256 KB] copyrighted

• Facial image synthesis
  B.J. Theobald and J. Cohn
  Oxford companion to affective sciences: An encyclopedic dictionary for the affective sciences, D. Sander & K. R. Scherer, ed., Oxford University Press, NY, 2007.
  Download: pdf [452 KB] copyrighted

• Multi-view AAM fitting and construction
  K. Ramnath, S.C. Koterba, J. Xiao, C. Hu, I. Matthews, S. Baker, J. Cohn, and T. Kanade
  International Journal of Computer Vision, 2007.

• Real-time expression cloning using active appearance models
  B. Theobald, I. Matthews, J. Cohn, and S. Boker
  Proceedings of the ACM International Conference on Multimodal Interfaces (ICMI'07), 2007, pp. 134 - 139. [Abstract]
  Download: pdf [1749 KB] copyrighted

• The painful face: Pain expression recognition using active appearance models
  A.B. Ashraf, S. Lucey, T. Chen, K. Prkachin, P. Solomon, Z. Ambadar, and J. Cohn
  Proceedings of the ACM International Conference on Multimodal Interfaces (ICMI'07), 2007, pp. 9 - 14.

• Learning patch dependencies for improved pose mismatched face verification
  S. Lucey and T. Chen
  IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), June, 2006. [Abstract]
  Download: pdf [538 KB] copyrighted

• Meticulously detailed eye model and its application to analysis of facial image
  T. Moriyama, J. Xiao, J. Cohn, and T. Kanade
  IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 28, No. 5, May, 2006, pp. 738 - 752. [Abstract]
  Download: pdf [6185 KB] copyrighted