Graphics enhanced version of this site

Publications, Facial Expression Analysis

Note: This list may not be comprehensive. It contains only those publications in the RI publications database. Entries are listed in reverse chronological order.

• Bilinear Active Appearance Models
  J. Gonzalez, F. De la Torre Frade, R. Murthi, N. Guil Mata, and E. Zapata
  Workshop on Non-rigid Registration and Tracking through Learning, October, 2007. [Abstract]
  Download: pdf [965 KB] copyrighted

• Non-Rigid Object Alignment with a Mismatch Template Based on Exhaustive Local Search
  Y. Wang, S. Lucey, and J. Cohn
  IEEE Workshop on Non-rigid Registration and Tracking through Learning - NRTL 2007, October, 2007. [Abstract]
  Download: pdf [1845 KB], ps.gz [3043 KB] copyrighted

• Temporal Segmentation of Facial Behavior
  F. De la Torre Frade, J. Campoy, Z. Ambadar, and J.F. Cohn
  International Conference on Computer Vision, October, 2007. [Abstract]
  Download: pdf [3061 KB] copyrighted

• Investigating Spontaneous Facial Action Recognition through AAM Representations of the Face
  S. Lucey, A.B. Ashraf, and J. Cohn
  Face Recognition Book, K. Kurihara, ed., Pro Literatur Verlag, Mammendorf, Germany, April, 2007. [Abstract]
  Download: pdf [1256 KB] copyrighted

• Facial image synthesis
  B.J. Theobald and J. Cohn
  Oxford companion to affective sciences: An encyclopedic dictionary for the affective sciences, D. Sander & K. R. Scherer, ed., Oxford University Press, NY, 2007.
  Download: pdf [452 KB] copyrighted

• Multi-view AAM fitting and construction
  K. Ramnath, S.C. Koterba, J. Xiao, C. Hu, I. Matthews, S. Baker, J. Cohn, and T. Kanade
  International Journal of Computer Vision, 2007.

• Real-time expression cloning using active appearance models
  B. Theobald, I. Matthews, J. Cohn, and S. Boker
  Proceedings of the ACM International Conference on Multimodal Interfaces (ICMI'07), 2007, pp. 134 - 139. [Abstract]
  Download: pdf [1749 KB] copyrighted

• The painful face: Pain expression recognition using active appearance models
  A.B. Ashraf, S. Lucey, T. Chen, K. Prkachin, P. Solomon, Z. Ambadar, and J. Cohn
  Proceedings of the ACM International Conference on Multimodal Interfaces (ICMI'07), 2007, pp. 9 - 14.

• Learning patch dependencies for improved pose mismatched face verification
  S. Lucey and T. Chen
  IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), June, 2006. [Abstract]
  Download: pdf [538 KB] copyrighted

• Meticulously detailed eye model and its application to analysis of facial image
  T. Moriyama, J. Xiao, J. Cohn, and T. Kanade
  IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 28, No. 5, May, 2006, pp. 738 - 752. [Abstract]
  Download: pdf [6185 KB] copyrighted

• AAM derived face representations for robust facial action recognition
  S. Lucey, I. Matthews, C. Hu, Z. Ambadar, F. De la Torre Frade, and J. Cohn
  Proceedings of the Seventh IEEE International Conference on Automatic Face and Gesture Recognition (FG'06), 2006, pp. 155 - 160.
  Download: pdf [828 KB] copyrighted

• Depression, smiling and facial paralysis
  J.M. VanSwearingen and J. Cohn
  Facial palsies, R. vanGelder, ed., Lemma Holland, Amsterdam, the Netherlands, 2006.

• Movement differences between deliberate and spontaneous facial expressions: Zygomaticus major action in smiling
  K. Schmidt, Z. Ambadar, J. Cohn, and L.I. Reed
  Journal of Nonverbal Behavior, 2006.

• Observer-based measurement of facial expression with the Facial Action Coding System
  J. Cohn, Z. Ambadar, and P. Ekman
  The handbook of emotion elicitation and assessment. Oxford University Press Series in Affective Science, J. A. Coan & J. B. Allen, ed., 2006.
  Download: pdf [1667 KB] copyrighted

• Use of automated facial image analysis for measurement of emotion expression
  J. Cohn and T. Kanade
  The handbook of emotion elicitation and assessment. Oxford University Press Series in Affective Science, J. A. Coan & J. B. Allen, ed., 2006.
  Download: pdf [1971 KB] copyrighted

• Improved face recognition through mismatch driven representations of the face
  S. Lucey and T. Chen
  International Conference on Computer Vision (ICCV) Workshop, PETS, October, 2005. [Abstract]
  Download: pdf [198 KB] copyrighted

• Multi-View AAM Fitting and Camera Calibration
  S.C. Koterba, S. Baker, I. Matthews, C. Hu, J. Xiao, J. Cohn, and T. Kanade
  Proc. International Conference on Computer Vision, Vol. 1, October, 2005, pp. 511 - 518. [Abstract]
  Download: pdf [2053 KB] copyrighted

• Using overlapping distributions to deal with face pose mismatch
  S. Lucey
  British Machine Vision Conference (BMVC), September, 2005. [Abstract]
  Download: pdf [184 KB] copyrighted

• Adult perceptions of positive and negative infant expressions
  L.H.B. Dinehart, D.S. Messinger, S.I. Acosta, T. Cassel, Z. Ambadar, and J. Cohn
  Infancy, Vol. 6, 2005, pp. 279 - 306.

• Automated analysis of the configuration and timing of facial expression
  J. Cohn
  What the face reveals (2nd edition): Basic and applied studies of spontaneous expression using the Facial Action Coding System (FACS), P. Ekman & E. Rosenberg, ed., 2005, pp. 388 - 392.
  Download: pdf [25 KB] copyrighted

• Deciphering the enigmatic face: The importance of facial dynamics to interpreting subtle facial expressions
  Z. Ambadar, J. Schooler, and J. Cohn
  Psychological Science, 2005. [Abstract]
  Download: pdf [582 KB] copyrighted

• Measuring facial action by manual coding, facial EMG, and automatic facial image analysis.
  J. Cohn and P. Ekman
  Handbook of nonverbal behavior research methods in the affective sciences, J. A. Harrigan, R. Rosenthal & K. Scherer, ed., 2005, pp. 9 - 64.

• The CMU/Pitt Automated Facial Image Analysis System
  T. Kanade and J. Cohn
  Proceedings of the International Conference on Methods and Techniques in Behavioral Research, Wageningen, The Netherlands, 2005.

• Automatic analysis and recognition of brow actions and head motion in spontaneous facial behavior
  J. Cohn, L.I. Reed, Z. Ambadar, J. Xiao, and T. Moriyama
  Proceedings of the IEEE Conference on Systems, Man, and Cybernetics, Vol. 1, October, 2004, pp. 610 - 616. [Abstract]
  Download: pdf [219 KB] copyrighted

• Non-Rigid Shape and Motion Recovery: Degenerate Deformations
  J. Xiao and T. Kanade
  Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Vol. 1, June, 2004, pp. 668 - 675. [Abstract]
  Download: pdf [511 KB] copyrighted

• The timing of facial motion in posed and spontaneous smiles
  J. Cohn and K. Schmidt
  International Journal of Wavelets, Multiresolution and Information Processing, Vol. 2, March, 2004, pp. 1 - 12. [Abstract]
  Download: pdf [657 KB] copyrighted

• Meticulously detailed eye model and its application to analysis of facial image
  T. Moriyama, J. Xiao, J. Cohn, and T. Kanade
  Proceedings of the IEEE Conference on Systems, Man, and Cybernetics, 2004, pp. 629 - 634. [Abstract]
  Download: pdf [2383 KB] copyrighted

• Multimodal coordination of facial action, head rotation, and eye motion during spontaneous smiles
  J. Cohn, L.I. Reed, T. Moriyama, J. Xiao, K. Schmidt, and Z. Ambadar
  Proceedings of the Sixth IEEE International Conference on Automatic Face and Gesture Recognition (FG'04), 2004, pp. 129 - 138. [Abstract]
  Download: pdf [204 KB] copyrighted

• Automated analysis of the configuration and timing of facial expression
  J. Cohn
  What the face reveals (2nd edition): Basic and applied studies of spontaneous expression using the Facial Action Coding System (FACS), Oxford University Press Series in Affective Science, P. Ekman & E. Rosenberg, ed., October, 2003.
  Download: pdf [25 KB] copyrighted

• Facial expression analysis
  Y. Tian, T. Kanade, and J. Cohn
  Handbook of face recognition, S.Z. Li & A.K. Jain, ed., Springer, October, 2003.
  Download: pdf [737 KB] copyrighted

• Measuring Facial Action by Manual Coding, Facial EMG, and Automatic Facial Image Analysis
  J. Cohn and P. Ekman
  Handbook of nonverbal behavior research methods in the affective sciences, J.A. Harrigan, R. Rosenthal, & K. Scherer, ed., October, 2003.
  Download: pdf [1869 KB] copyrighted

• Signal characteristics of spontaneous facial expressions: Automatic movement in solitary and social smiles
  K. Schmidt, J. Cohn, and Y. Tian
  Biological Psychology, Vol. 65, October, 2003, pp. 49 - 66. [Abstract]
  Download: pdf [421 KB] copyrighted

• Robust Full-Motion Recovery of Head by Dynamic Templates and Re-registration Techniques
  J. Xiao, T. Moriyama, T. Kanade, and J. Cohn
  International Journal of Imaging Systems and Technology, Vol. 13, September, 2003, pp. 85 - 94. [Abstract]
  Download: pdf [851 KB] copyrighted

• Automatic recognition of eye blinking in spontaneously occurring behavior
  J. Cohn, J. Xiao, T. Moriyama, Z. Ambadar, and T. Kanade
  Behavior Research Methods, Instruments, and Computers, Vol. 35, 2003, pp. 420 - 428. [Abstract]
  Download: pdf [246 KB] copyrighted

• Individual differences in facial expression: Stability over time, relation to self-reported emotion, and ability to inform person identification
  J. Cohn, K. Schmidt, R. Gross, and P. Ekman
  Proceedings of the International Conference on Multimodal User Interfaces, October, 2002. [Abstract]
  Download: pdf [86 KB] copyrighted

• Automatic recognition of eye blinking in spontaneously occurring behavior
  T. Moriyama, T. Kanade, J. Cohn, J. Xiao, Z. Ambadar, J. Gao, and M. Imanura
  Proceedings of the 16th International Conference on Pattern Recognition (ICPR '2002), Vol. 4, August, 2002, pp. 78 - 81. [Abstract]
  Download: pdf [458 KB] copyrighted

• Human facial asymmetry for expression-invariant facial identification
  Y. Liu, K. Schmidt, J. Cohn, and R.L. Weaver
  Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition (FG'02), May, 2002.
  Download: pdf [1127 KB] copyrighted

• Robust Full Motion Recovery of Head by Dynamic Templates and Re-registration Techniques
  J. Xiao, T. Kanade, and J. Cohn
  Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition (FG'02), May, 2002, pp. 156 - 162. [Abstract]
  Download: pdf [7423 KB] copyrighted

• Human facial expressions as adaptations: Evolutionary questions in facial expression
  K. Schmidt and J. Cohn
  Yearbook of Physical Anthropology, Vol. 44, 2002, pp. 3 - 24. [Abstract]
  Download: pdf [796 KB] copyrighted

• Quo Vadis Face Recognition?
  R. Gross, J. Shi, and J. Cohn
  Third Workshop on Empirical Evaluation Methods in Computer Vision, December, 2001. [Abstract]
  Download: pdf [534 KB], ps.gz [5411 KB] copyrighted

• A Comparative Study of Alternative FACS Coding Algorithms
  J. Cohn, T. Kanade, T. Moriyama, Z. Ambadar, J. Xiao, J. Gao, and H. Imamura
  tech. report CMU-RI-TR-02-06, Robotics Institute, Carnegie Mellon University, November, 2001.
  Download: pdf [308 KB] copyrighted

• Dynamics of facial expression: Normative characteristics and individual differences
  K. Schmidt and J. Cohn
  IEEE International Conference on Multimedia and Expo ( ICME2001), August, 2001, pp. 728 - 731. [Abstract]
  Download: pdf [284 KB] copyrighted

• Recognizing action units for facial expression analysis
  Y. Tian, T. Kanade, and J. Cohn
  IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 23, No. 2, February, 2001, pp. 97 - 115. [Abstract]
  Download: pdf [3784 KB] copyrighted

• A psychometric evaluation of the Facial Action Coding System for assessing spontaneous expression
  M.A. Sayette, J. Cohn, J.M. Wertz, M.A. Perrott, and D.J. Parrott
  Journal of Nonverbal Behavior, Vol. 25, 2001, pp. 167 - 186. [Abstract]
  Download: pdf [131 KB] copyrighted

• Detection, Tracking, and Classification of Action Units in Facial Expression
  J.J. Lien, T. Kanade, J. Cohn, and C. Li
  Journal of Robotics and Autonomous Systems, Vol. 31, No. 3, May, 2000, pp. 131 - 146.
  Download: pdf [1902 KB] copyrighted

• Comprehensive Database for Facial Expression Analysis
  T. Kanade, J. Cohn, and Y. Tian
  Proceedings of the 4th IEEE International Conference on Automatic Face and Gesture Recognition (FG'00), March, 2000, pp. 46 - 53. [Abstract]
  Download: pdf [108 KB] copyrighted

• Dual-state Parametric Eye Tracking
  Y. Tian, T. Kanade, and J. Cohn
  Proceedings of the 4th IEEE International Conference on Automatic Face and Gesture Recognition (FG'00), March, 2000, pp. 110 - 115. [Abstract]
  Download: pdf [332 KB], ps.gz [1334 KB] copyrighted

• Recognizing Lower Face Action Units for Facial Expression Analysis
  Y. Tian, T. Kanade, and J. Cohn
  Proceedings of the 4th IEEE International Conference on Automatic Face and Gesture Recognition (FG'00), March, 2000, pp. 484 - 490. [Abstract]
  Download: pdf [501 KB], ps.gz [2248 KB] copyrighted

• Robust Lip Tracking by Combining Shape, Color and Motion
  Y. Tian, T. Kanade, and J. Cohn
  Proceedings of the 4th Asian Conference on Computer Vision (ACCV'00), January, 2000.
  Download: pdf [776 KB], ps.gz [3195 KB] copyrighted

• Detection, tracking, and classification of subtle changes in facial expression
  J.J. Lien, T. Kanade, J. Cohn, and C. Li
  Journal of Robotics and Autonomous Systems, Vol. 31, 2000, pp. 131 - 146. [Abstract]
  Download: pdf [548 KB] copyrighted

• Image registration using wavelet-based motion model
  Y. Wu, T. Kanade, C. Li, and J. Cohn
  International Journal of Computer Vision, Vol. 38, 2000, pp. 129 - 152.

• Detection, Tracking, and Classification of Action Units in Facial Expression
  J.J. Lien, T. Kanade, J. Cohn, and C. Li
  Journal of Robotics and Autonomous Systems, July, 1999.
  Download: pdf [548 KB] copyrighted

• Automated face analysis by feature point tracking has high concurrent validity with manual FACS coding
  J. Cohn, A. Zlochower, J.J. Lien, and T. Kanade
  Psychophysiology, Vol. 36, 1999, pp. 35 - 43. [Abstract]
  Download: pdf [245 KB] copyrighted

• Specific impairment of smiling increases severity of depressive symptoms in patients with facial neuromuscular disorders
  J.M. VanSwearingen, J. Cohn, and A. Bajaj-Luthra
  Journal of Aesthetic Plastic Surgery, Vol. 23, 1999, pp. 416 - 423.

• Bimodal expression of emotion by face and voice
  J. Cohn and G.S. Katz
  Workshop on Face / Gesture Recognition and Their Applications, The Sixth ACM International Multimedia Conference, September, 1998. [Abstract]
  Download: pdf [117 KB] copyrighted

• Subtly Different Facial Expression Recognition and Expression Intensity Estimation
  J.J. Lien, T. Kanade, J. Cohn, and C. Li
  IEEE Conference on Computer Vison and Pattern Recogntion, June, 1998, pp. 853 - 859. [Abstract]
  Download: pdf [1888 KB], ps.gz [2220 KB] copyrighted

• Automated Facial Expression Recognition Based on FACS Action Units
  J.J. Lien, T. Kanade, J. Cohn, and C. Li
  Third IEEE International Conference on Automatic Face and Gesture Recognition, April, 1998, pp. 390-395. [Abstract]
  Download: pdf [998 KB], ps.gz [1154 KB] copyrighted

• Automatic Recognition of Facial Expressions Using Hidden Markov Models and Estimation of Expression Intensity
  J.J. Lien
  doctoral dissertation, tech. report CMU-RI-TR-98-31, Robotics Institute, Carnegie Mellon University, April, 1998. [Abstract]
  Download: pdf [6472 KB] copyrighted

• Beyond Prototypic Expressions: Discriminating Subtle Changes in the Face
  J. Cohn, J.J. Lien, T. Kanade, W. Hua, and A. Zlochower
  Proc. of the 7th IEEE Robot and Human Communications Workshop, 1998. [Abstract]
  Download: pdf [726 KB] copyrighted

• Automatically Recognizing Facial Expressions in the Spatio-Temporal Domain Using Hidden Markov Models
  J.J. Lien, T. Kanade, A. Zlochower, J. Cohn, and C. Li
  Workshop on Perceptual User Interfaces, October, 1997, pp. 94 - 97.
  Download: pdf [893 KB], ps.gz [1020 KB] copyrighted

• Automated face coding: A computer-vision based method of facial expression analysis
  J. Cohn, A. Zlochower, J.J. Lien, Y.T. Wu, and T. Kanade
  7th European Conference on Facial Expression Measurement and Meaning, July, 1997, pp. 329-333.