Graphics enhanced version of this site

Human Sensing
Heads: Jessica K Hodgins, Jeffrey Cohn, Takeo Kanade, and Fernando De la Torre Frade
Contact: Fernando De la Torre Frade (ftorre@cs.cmu.edu)

Mailing address:
Carnegie Mellon University
Robotics Institute
5000 Forbes Avenue
Pittsburgh, PA 15213

For more information, see this lab's homepage.

The goal of the Human Sensing Lab is to develop new machine learning algorithms to model and understand human behavior from sensory data (e.g. video, motion capture, audio). Our work is motivated by applications in the fields of human health, biometrics and human-machine interface. For more information see www.humansensing.cs.cmu.edu

Name - Title <Email Address>
• Joan Campoy - Research Associate <tm08308@salle.url.edu>
• [Home] Jeffrey Cohn - Adjunct Faculty (Adjunct) <jeffcohn@cs.cmu.edu>
• [Home] Fernando De la Torre Frade - Research Scientist <ftorre@cs.cmu.edu>
• Jessica K Hodgins - Faculty, RI/CS <jkh@cs.cmu.edu>
• [Home] Takeo Kanade - U.A. and Helen Whitaker University Prof., RI/CS <tk@cs.cmu.edu>
• Javier Montano Martinez - Research Associate I <jmontano.84@gmail.com>
• David Monzo Ferrer - Visiting Scholar <damonfer@gmail.com>
• [Home] Minh Hoai Nguyen - PhD Student, RI <minhhoan@andrew.cmu.edu>
• Joan Perez - Visiting Research Assistant <joan.jpi@gmail.com>
• Tomas Simon Kreuz - Research Associate <tsimon@andrew.cmu.edu>
• [Home] James Tolbert, II - Graduate Assistant <jatolber@andrew.cmu.edu>
• Feng Zhou - Research Associate I <zhfe99@gmail.com>

• Deception Detection - Learning facial indicators of deception
• Depression Assessment - This project aims to compute quantitative behavioral measures related to depression severity from facial expression, body gestures, and vocal prosody in clinical interviews.
• Face Recognition - Recognizing people from images and videos.
• Facial Expression Analysis - Automatic facial expression encoding, extraction and recognition, and expression intensity estimation for the applications of MPEG4 application: teleconferencing, human-computer interaction/interface.
• Facial Feature Detection - Detecting facial features in images.
• Forecasting the Anterior Cruciate Ligament Rupture Patterns - Use of machine learning techniques to predict the injury pattern of the Anterior Cruciate Ligament (ACL) using non-invasive methods.
• Hot Flash Detection - Machine learning algorithms to detect hot flashes in women using physiological measures.
• Indoor People Localization - Tracking multiple people in indoor environments with the connectivity of Bluetooth devices.
• Intelligent Diabetes Assistant - We are working to create an intelligent assistant to help patients and clinicians work together to manage diabetes at a personal and social level. This project uses machine learning to predict the effect that patient specific behaviors have on blood glucose.
• Multimodal Data Collection - A multimodal database of subjects performing the tasks involved in cooking, captured with several sensors (audio, video, motion capture, accelerometer/gyroscope).
• Multimodal Diaries - Summarization of daily activity from multimodal data (audio, video, body sensors and computer monitoring)
• Quality of Life Technology Center - QoLT is a unique partnership between Carnegie Mellon and the University of Pittsburgh that brings together a cross-disciplinary team of technologists, clinicians, industry partners, end users, and other stakeholders to create revolutionary technologies that will improve and sustain the quality of life for all people.
• Temporal Segmentation of Human Motion - Temporal segmentation of human motion

• Aligned Cluster Analysis for Temporal Segmentation of Human Motion
  F. Zhou, F. De la Torre Frade, and J.K. Hodgins
  IEEE Conference on Automatic Face and Gestures Recognition, September, 2008. [Abstract]
  Download: pdf [779 KB] copyrighted

• Facial Feature Detection with Optimal Pixel Reduction SVMs
  M.H. Nguyen and F. De la Torre Frade
  8th IEEE International Conference on Automatic Face and Gesture Recognition, September, 2008. [Abstract]
  Download: pdf [980 KB] copyrighted

• Learning Image Alignment without Local Minima for Face Detection and Tracking
  M.H. Nguyen and F. De la Torre Frade
  8th IEEE International Conference on Automatic Face and Gesture Recognition, September, 2008. [Abstract]
  Download: pdf [980 KB] copyrighted

• Maximum Entropy Inverse Reinforcement Learning
  B.D. Ziebart, A. Maas, J. Bagnell, and A.K. Dey
  Proceeding of AAAI 2008, July, 2008. [Abstract]
  Download: pdf [293 KB] copyrighted

• The Robotic Busboy: Steps Towards Developing a Mobile Robotic Home Assistant
  S. Srinivasa, D. Ferguson, M. Vande Weghe, R. Diankov, D. Berenson, C. Helfrich, and H. Strasdat
  International Conference on Intelligent Autonomous Systems, July, 2008. [Abstract]
  Download: pdf [5040 KB] copyrighted

• BiSpace Planning: Concurrent Multi-Space Exploration
  R. Diankov, N. Ratliff, D. Ferguson, S. Srinivasa, and J. Kuffner
  Robotics: Science and Systems, June, 2008. [Abstract]
  Download: pdf [1526 KB] copyrighted

• Grasp Synthesis in Cluttered Environments for Dexterous Hands
  D. Berenson and S. Srinivasa
  Robotics Science and Systems (RSS) Workshop on Robot Manipulation: Intelligence in Human Environments, June, 2008. [Abstract]
  Download: pdf [2224 KB] copyrighted

• Learning Patch Correspondences for Improved Viewpoint Invariant Face Recognition
  A.B. Ashraf, S. Lucey, and T. Chen
  IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), June, 2008. [Abstract]
  Download: pdf [948 KB] copyrighted

• A Viewpoint Invariant, Sparsely Registered, Patch Based, Face Verifier
  S. Lucey and T. Chen
  International Journal of Computer Vision (IJCV), December, 2007. [Abstract]
  Download: pdf [734 KB] copyrighted

• Imitation Learning for Locomotion and Manipulation
  N. Ratliff, J. Bagnell, and S. Srinivasa
  tech. report CMU-RI-TR-07-45, Robotics Institute, Carnegie Mellon University, December, 2007. [Abstract]
  Download: pdf [2236 KB] copyrighted