Graphics enhanced version of this site

Vision-based Control of 3D Facial Animation
J. Chai, J. Xiao, and J.K. Hodgins
In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation, July, 2003.

Jump to: Download | Abstract | Notes | Text Reference | BibTeX Reference

Adobe portable document format (pdf) [16698 KB]

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Controlling and animating the facial expression of a computer-generated 3D character is a difficult problem because the face has many degrees of freedom while most available input devices have few. In this paper, we show that a rich set of lifelike facial actions can be created from a preprocessed motion capture database and that a user can control these actions by acting out the desired motions in front of a video camera. We develop a real-time facial tracking system to extract a small set of animation control parameters from video. Because of the nature of video data, these parameters may be noisy, low-resolution, and contain errors. The system uses the knowledge embedded in motion capture data to translate these low-quality 2D animation control signals into high-quality 3D facial expressions. To adapt the synthesized motion to a new character model, we introduce an efficient expression retargeting technique whose run-time computation is constant independent of the complexity of the character model. We demonstrate the power of this approach through two users who control and animate a wide range of 3D facial expressions of different avatars.

Note: PowerPoint presentation available at: http://graphics.cs.cmu.edu/projects/face-animation/face.ppt

J. Chai, J. Xiao, and J.K. Hodgins, "Vision-based Control of 3D Facial Animation," In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation, July, 2003.

@inproceedings{Chai_2003_5203,
   author = "Jinxiang Chai and Jing Xiao and Jessica K Hodgins",
   title = "Vision-based Control of 3D Facial Animation",
   booktitle = "In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation",
   month = "July",
   year = "2003",
   note = "PowerPoint presentation available at: http://graphics.cs.cmu.edu/projects/face-animation/face.ppt"
}