RI | People | Jiang Gao

Text only version of this site

Jiang Gao
Systems Scientist

No longer a member of RI.

Email address: jgao@cs.cmu.edu

For more information, see my personal homepage.

Jump to: Research interests | Keywords | Labs & Groups | Projects | Publications

Research interests

My research interests lie primarily in the area of computer vision and robotics, with special focus on understanding an environment of human, including activities, faces and written symbols. The progress in this area will impact our daily lives in a profound way. Some past and current projects include:

HumanID and Caremedia projects. We are developing a system for activity analysis from video cameras in a nursing home, based on robust motion features and a hidden Markov model. The focus is on event understanding and knowledge mining from video.

Interactive Systems Labs, Human Computer Interaction Institute. I developed a fully automatic, real time system for detection, recognition, and translation of text /signs from a natural environment. I also became interested in natural language processing (NLP) and machine translation through this work.

Face expression analysis. My work is focused on generic 3D face modeling from video and rigid head motion stabilization for face expression analysis.

These works play a central role in a variety of applications, including human-computer interaction, intelligent systems / interfaces, and medical applications. Besides, I am also interested in statistics, estimation, operational research, and control engineering, through my previous research experience.

Research interest keywords

artificial intelligence, computer vision, control, gesture recognition, human-computer interaction, image processing, inspection, machine learning, machine translation, medical applications, natural language processing, object recognition, operations research, pattern recognition, and statistics

Past Labs & Groups

Human Identification at a Distance - We are developing and evaluating human identification technologies as part of the Defense Advanced Research Projects Agency (DARPA) sponsored program in Human Identification at a Distance (HumanID).

Past Projects

Facial Expression Analysis - Automatic facial expression encoding, extraction and recognition, and expression intensity estimation for the applications of MPEG4 application: teleconferencing, human-computer interaction/interface.

Publications

Note: This list may not be comprehensive. It contains only those publications in the RI publications database. Entries are listed in reverse chronological order.

• Inferring Human Upper Body Motion Using Belief Propagation
  J. Gao and J. Shi
  tech. report CMU-RI-TR-03-06, Robotics Institute, Carnegie Mellon University, June, 2003. [Abstract]
  Download: pdf [2908 KB] copyrighted

• Automatic recognition of eye blinking in spontaneously occurring behavior
  T. Moriyama, T. Kanade, J. Cohn, J. Xiao, Z. Ambadar, J. Gao, and M. Imanura
  Proceedings of the 16th International Conference on Pattern Recognition (ICPR '2002), Vol. 4, August, 2002, pp. 78 - 81. [Abstract]
  Download: pdf [458 KB] copyrighted

• An Adaptive Algorithm for Text Detection from Natural Scenes
  J. Gao and J. Yang
  Proceedings of the 2001 IEEE Conference on Computer Vision and Pattern Recognition, December, 2001. [Abstract]
  Download: pdf [544 KB] copyrighted

• A Comparative Study of Alternative FACS Coding Algorithms
  J. Cohn, T. Kanade, T. Moriyama, Z. Ambadar, J. Xiao, J. Gao, and H. Imamura
  tech. report CMU-RI-TR-02-06, Robotics Institute, Carnegie Mellon University, November, 2001.
  Download: pdf [308 KB] copyrighted

• An Automatic Sign Recognition and Translation System
  J. Yang, J. Gao, Y. Zang, X. Chen, and unknown
  Proceedings of the Workshop on Perceptive User Interfaces (PUI'01), November, 2001. [Abstract]
  Download: pdf [1311 KB] copyrighted

• Text Detection and Translation from Natural Scenes
  J. Gao, J. Yang, Y. Zhang, and unknown
  tech. report CMU-CS-01-139, Computer Science Department, Carnegie Mellon University, June, 2001. [Abstract]
  Download: pdf [2583 KB] copyrighted

• Toward Automatic Sign Translation
  J. Yang, J. Gao, Y. Zhang, and unknown
  Proceedings of the First International Conference on Human Language Technology Conference (HLT 2001), March, 2001. [Abstract]
  Download: pdf [981 KB] copyrighted