The Robotics Institute

Carnegie Mellon Robotics Institute

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

In this paper we develop a computer vision-based system to transfer human motion from one subject to another. Our system uses a network of eight calibrated and synchronized cameras. We first build detailed kinematic models of the subjects based on our algorithms for extracting shape from silhouette across time. These models are then used to capture the motion (joint angles) of the subjects in new video sequences. Finally we describe an image-based rendering algorithm to render the captured motion applied to the articulated model of another person. Our rendering algorithm uses an ensemble of spatially and temporally distributed images to generate photo-realistic video of the transferred motion. We demonstrate the performance of the system by rendering throwing and kungfu motions on subjects who did not perform them.

Notes

Associated Center(s) / Consortia: Vision and Autonomous Systems Center

Associated Lab(s) / Group(s): Virtualized Reality^TM

Associated Project(s): Temporal Shape-From-Silhouette, Human Motion Transfer, Human Kinematic Modeling and Motion Capture

Text Reference

Kong Man Cheung, Simon Baker, Jessica K Hodgins, and Takeo Kanade, "Markerless Human Motion Transfer," Proceedings of the 2nd International Symposium on 3D Data Processing, Visualization and Transmission, September, 2004.

BibTeX Reference

@inproceedings{Cheung_2004_4701,
   author = "Kong Man Cheung and Simon Baker and Jessica K Hodgins and Takeo Kanade",
   title = "Markerless Human Motion Transfer",
   booktitle = "Proceedings of the 2nd International Symposium on 3D Data Processing, Visualization and Transmission",
   month = "September",
   year = "2004",
}

The Robotics Institute

Menu