Graphics enhanced version of this site

Markerless Human Motion Transfer
K.M. Cheung, S. Baker, J.K. Hodgins, and T. Kanade
Proceedings of the 2nd International Symposium on 3D Data Processing, Visualization and Transmission, September, 2004.

Jump to: Download | Abstract | Notes | Text Reference | BibTeX Reference

Adobe portable document format (pdf) [1216 KB]

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

In this paper we develop a computer vision-based system to transfer human motion from one subject to another. Our system uses a network of eight calibrated and synchronized cameras. We first build detailed kinematic models of the subjects based on our algorithms for extracting shape from silhouette across time. These models are then used to capture the motion (joint angles) of the subjects in new video sequences. Finally we describe an image-based rendering algorithm to render the captured motion applied to the articulated model of another person. Our rendering algorithm uses an ensemble of spatially and temporally distributed images to generate photo-realistic video of the transferred motion. We demonstrate the performance of the system by rendering throwing and kungfu motions on subjects who did not perform them.

Associated center: VASC
Associated lab/group: Virtualized Reality^TM
Associated projects: Temporal Shape-From-Silhouette, Human Motion Transfer, and Human Kinematic Modeling and Motion Capture

K.M. Cheung, S. Baker, J.K. Hodgins, and T. Kanade, "Markerless Human Motion Transfer," Proceedings of the 2nd International Symposium on 3D Data Processing, Visualization and Transmission, September, 2004.

@inproceedings{Cheung_2004_4701,
   author = "Kong Man Cheung and Simon Baker and Jessica K Hodgins and Takeo Kanade",
   title = "Markerless Human Motion Transfer",
   booktitle = "Proceedings of the 2nd International Symposium on 3D Data Processing, Visualization and Transmission",
   month = "September",
   year = "2004"
}