Performance Animation from Low-dimensional Control Signals

Jinxiang Chai and Jessica K Hodgins
ACM Transactions on Graphics (SIGGRAPH 2005), Vol. 24, No. 3, August, 2005

  • Adobe portable document format (pdf) (2MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

The ability to accurately reconstruct a user's motion in real time would allow the intuitive control of characters in computer games, the control of avatars for virtual reality or electronically mediated communication, and the rapid prototyping of character animations. This project introduces an approach to performance animation that employs video cameras and a small set of retro-reflective markers to create a low-cost, easy-to-use system that might someday be practical for home use. The low-dimensional control signals from the user's performance are supplemented by a database of pre-recorded human motion. At run time, the system automatically learns a series of local models from a set of motion capture examples that are a close match to the marker locations captured by the cameras. These local models are then used to reconstruct the motion of the user as a full-body animation. We demonstrate the power and flexibility of this approach by having users control six behaviors in real time without significant latency: walking, running, hopping, jumping, boxing, and Kendo (Japanese sword art). The reconstructed motion is based on a single large human motion database. Our experiments indicate that this approach scales well with the size and heterogeneity of the database and is robust to variations in kinematics between users. The resulting animation also captures the individual style of the user's motion through spatial-temporal interpolation of the data. Finally, we assess the quality of the reconstructed motion by comparing against ground truth data simultaneously captured with a full marker set in a commercial motion capture system.

Note: Quicktime Video available at:

Text Reference
Jinxiang Chai and Jessica K Hodgins, "Performance Animation from Low-dimensional Control Signals," ACM Transactions on Graphics (SIGGRAPH 2005), Vol. 24, No. 3, August, 2005

BibTeX Reference
   author = "Jinxiang Chai and Jessica K Hodgins",
   title = "Performance Animation from Low-dimensional Control Signals",
   journal = "ACM Transactions on Graphics (SIGGRAPH 2005)",
   month = "August",
   year = "2005",
   volume = "24",
   number = "3",
   Notes = "Quicktime Video available at:"