Learning Silhouette Features for Control of Human Motion - Robotics Institute Carnegie Mellon University

Learning Silhouette Features for Control of Human Motion

Liu Ren, Gregory Shakhnarovich, Jessica K. Hodgins, Hanspeter Pfister, and Paul Viola
Conference Paper, Proceedings of SIGGRAPH '04 Conference on Sketches & Applications: Session: Computer Vision, August, 2004

Abstract

We present a vision-based performance interface for controlling animated human characters. The system combines information about the user's motion contained in silhouettes from several viewpoints with domain knowledge contained in a motion capture database to interactively produce a high quality animation. Such an interactive system will be useful for authoring, teleconferencing, or as a control interface for a character in a game. In our system, the user performs in front of three video cameras; the resulting silhouettes are used to estimate his or her orientation and body configuration based on a set of discriminative local features. Those features are selected by a machine learning algorithm during a preprocessing step. Sequences of motions that approximate the user's actions are extracted from the motion database and scaled in time to match the speed of the user's motion. We use swing dancing, an example of complex human motion, to demonstrate the effectiveness of our approach and compare the results obtained with discriminative local features to those obtained with global features, Hu moments, and to ground truth measurement from a motion capture system.

Notes
Quicktime Video available at: http://graphics.cs.cmu.edu/projects/swing/videos/swingTOGsubNewMusic.mov

BibTeX

@conference{Ren-2004-9007,
author = {Liu Ren and Gregory Shakhnarovich and Jessica K. Hodgins and Hanspeter Pfister and Paul Viola},
title = {Learning Silhouette Features for Control of Human Motion},
booktitle = {Proceedings of SIGGRAPH '04 Conference on Sketches & Applications: Session: Computer Vision},
year = {2004},
month = {August},
publisher = {ACM Press},
}