RI | Research | Projects | Feature-based 3D Head Tracking

Text only version of this site

Feature-based 3D Head Tracking Head: Takeo Kanade Contact: Jun-Su Jang (jsjang@cs.cmu.edu) Mailing address: Carnegie Mellon University Robotics Institute 5000 Forbes Avenue Pittsburgh, PA 15213 Associated center: VASC Associated lab/group: People Image Analysis Consortium

Jump to: Project Description | Personnel | Sub-projects

Project Description

We develop a feature-based tracking method to recover the full-motion (3 rotations and 3 translations) of the head using a cylindrical model. We introduce the SIFT features as a universal matching technique in tracking process. Tracking by detection approach can overcome a divergence problem, which frequently occurs in previous work (Region-based optical flow approach). Our system automatically generates view-based head model. It contains regions of the facial features, such as eyebrows, eyes, nose, mouth and also ears when they are visible. A set of SIFT features is stored and updated for each reference pose while tracking sequences. These templates are employed to rectify error accumulation and to avoid divergence in tracking. The robustness of the proposed system is experimentally shown in video sequences with occlusion and fast motion.

AVI Movie (xvid codec)

Personnel

	Name	Title	Email Address
	Jun-Su Jang	Postdoctoral Fellow	jsjang@cs.cmu.edu
	Takeo Kanade	U.A. and Helen Whitaker University Prof., RI/CS	tk@cs.cmu.edu

Current Sub-projects

3D Head Motion Recovery in Real Time - A cylindrical model-based algorithm recovers the full motion (3D rotations and 3D translations) of the head in real time.