RI | Research | Projects | Facial Expression Analysis

Text only version of this site

Facial Expression Analysis Head: Jeffrey Cohn Contact: Jeffrey Cohn (jeffcohn@cs.cmu.edu) Mailing address: Carnegie Mellon University Robotics Institute 5000 Forbes Avenue Pittsburgh, PA 15213 Associated center: VASC Associated labs/groups: Face Group and Human Sensing

Jump to: Project Description | Personnel | Publications

Project Description

Facial expression provides cues about emotion, regulates interpersonal behavior, and communicates psychopathology. Human-observer based methods for measuring facial expression are labor intensive, qualitative, and difficult to standardize across laboratories, clinical settings, and over time. To make feasible more rigorous, quantitative measurement of facial expression in diverse applications, computer and behavioral scientists at Carnegie Mellon University and the University of Pittsburgh formed an interdisciplinary research team. The team has developed the CMU/Pitt Automated Facial Image Analysis (AFA) system that is capable of automatically recognizing facial action units, analyzing their timing in facial behavior, and rendering real-time photorealistic avatars.

Current efforts use AFA to enable reliable, valid, and efficient measurement of emotion expression, assess symptom severity in depression and physical pain, and investigate human social dynamics. To meet these goals, we pursue basic research to further improve algorithms and capabilities of the AFA system.

Personnel [Past Members]

	Name	Title	Email Address
	Zara Ambadar	Postdoctoral Fellow, UPitt	ambadar+@pitt.edu
	Jeffrey Cohn	Adjunct Faculty (Adjunct)	jeffcohn@cs.cmu.edu
	Fernando De la Torre Frade	Research Scientist	ftorre@cs.cmu.edu
	Takeo Kanade	U.A. and Helen Whitaker University Prof., RI/CS	tk@cs.cmu.edu
	Simon Lucey	Systems Scientist	slucey+@andrew.cmu.edu
	Iain Matthews	Senior Systems Scientist	iainm@cs.cmu.edu (Currently On Leave)
	Jason M Saragih	Postdoctoral Fellow	jsaragih@andrew.cmu.edu
	Yang Wang	Postdoctoral Fellow	wangy@andrew.cmu.edu

Recent publications [View all 61 publications]

• Bilinear Active Appearance Models
  J. Gonzalez, F. De la Torre Frade, R. Murthi, N. Guil Mata, and E. Zapata
  Workshop on Non-rigid Registration and Tracking through Learning, October, 2007. [Abstract]
  Download: pdf [965 KB] copyrighted

• Non-Rigid Object Alignment with a Mismatch Template Based on Exhaustive Local Search
  Y. Wang, S. Lucey, and J. Cohn
  IEEE Workshop on Non-rigid Registration and Tracking through Learning - NRTL 2007, October, 2007. [Abstract]
  Download: pdf [1845 KB], ps.gz [3043 KB] copyrighted

• Temporal Segmentation of Facial Behavior
  F. De la Torre Frade, J. Campoy, Z. Ambadar, and J.F. Cohn
  International Conference on Computer Vision, October, 2007. [Abstract]
  Download: pdf [3061 KB] copyrighted

• Investigating Spontaneous Facial Action Recognition through AAM Representations of the Face
  S. Lucey, A.B. Ashraf, and J. Cohn
  Face Recognition Book, K. Kurihara, ed., Pro Literatur Verlag, Mammendorf, Germany, April, 2007. [Abstract]
  Download: pdf [1256 KB] copyrighted

• Facial image synthesis
  B.J. Theobald and J. Cohn
  Oxford companion to affective sciences: An encyclopedic dictionary for the affective sciences, D. Sander & K. R. Scherer, ed., Oxford University Press, NY, 2007.
  Download: pdf [452 KB] copyrighted

• Multi-view AAM fitting and construction
  K. Ramnath, S.C. Koterba, J. Xiao, C. Hu, I. Matthews, S. Baker, J. Cohn, and T. Kanade
  International Journal of Computer Vision, 2007.

• Real-time expression cloning using active appearance models
  B. Theobald, I. Matthews, J. Cohn, and S. Boker
  Proceedings of the ACM International Conference on Multimodal Interfaces (ICMI'07), 2007, pp. 134 - 139. [Abstract]
  Download: pdf [1749 KB] copyrighted

• The painful face: Pain expression recognition using active appearance models
  A.B. Ashraf, S. Lucey, T. Chen, K. Prkachin, P. Solomon, Z. Ambadar, and J. Cohn
  Proceedings of the ACM International Conference on Multimodal Interfaces (ICMI'07), 2007, pp. 9 - 14.

• Learning patch dependencies for improved pose mismatched face verification
  S. Lucey and T. Chen
  IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), June, 2006. [Abstract]
  Download: pdf [538 KB] copyrighted

• Meticulously detailed eye model and its application to analysis of facial image
  T. Moriyama, J. Xiao, J. Cohn, and T. Kanade
  IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 28, No. 5, May, 2006, pp. 738 - 752. [Abstract]
  Download: pdf [6185 KB] copyrighted