Graphics enhanced version of this site

Human Kinematic Modeling and Motion Capture
Heads: Takeo Kanade and Simon Baker
Contact: Takeo Kanade (tk@cs.cmu.edu)

Mailing address:
Carnegie Mellon University
Robotics Institute
5000 Forbes Avenue
Pittsburgh, PA 15213

Associated center: VASC
Associated lab/group: Virtualized Reality^TM

For more information, see this project's homepage.

This page last updated - November 2006.

We have constructed a system for building 3D kinematic models (shape, body part segmentation, and joint information) of humans. This system is based on our temporal shape-from-silhouette algorithms. An overview of the system is as follows:

An example of the results of applying the system is the three kinematic models illustrated in the following movie.

These kinematic models can then be used to track new motions of the person using a tracking algorithm closely related to our temporal shape-from-silhouette algorithms. Examples of tracking the person in this way are shown below.

Name - Title <Email Address>
• [Home] Takeo Kanade - U.A. and Helen Whitaker University Prof., RI/CS <tk@cs.cmu.edu>

Note: This list may not be comprehensive. It contains only those publications in the RI publications database. Entries are listed in reverse chronological order.

• Shape-From-Silhouette Across Time: Part II: Applications to Human Modeling and Markerless Motion Tracking
  K.M. Cheung, S. Baker, and T. Kanade
  International Journal of Computer Vision, Vol. 63, No. 3, August, 2005, pp. 225 - 245.
  Download: pdf [2755 KB] copyrighted

• Shape-From-Silhouette Across Time Part I: Theory and Algorithms
  K.M. Cheung, S. Baker, and T. Kanade
  International Journal of Computer Vision, Vol. 62, No. 3, May, 2005, pp. 221 - 247. [Abstract]
  Download: pdf [2047 KB] copyrighted

• Markerless Human Motion Transfer
  K.M. Cheung, S. Baker, J.K. Hodgins, and T. Kanade
  Proceedings of the 2nd International Symposium on 3D Data Processing, Visualization and Transmission, September, 2004. [Abstract]
  Download: pdf [1216 KB] copyrighted

• Markerless Human Motion Transfer
  K.M. Cheung, S. Baker, J.K. Hodgins, and T. Kanade
  In Proceedings of the SIGGRAPH 2004 Conference on Sketches & Applications, ACM Press, August, 2004.
  Download: pdf [423 KB] copyrighted

• Visual Hull Construction, Alignment and Refinement for Human Kinematic Modeling, Motion Tracking and Rendering
  K.M. Cheung
  doctoral dissertation, tech. report CMU-RI-TR-03-44, Robotics Institute, Carnegie Mellon University, October, 2003. [Abstract]
  Download: pdf [8142 KB] copyrighted

• Shape-From-Silhouette of Articulated Objects and its Use for Human Body Kinematics Estimation and Motion Capture
  K.M. Cheung, S. Baker, and T. Kanade
  Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, June, 2003. [Abstract]
  Download: pdf [956 KB] copyrighted