Ambiguities in Visual Tracking of Articulated Objects Using Two- and Three-Dimensional Models

Jim Rehg, Daniel D. Morris, and Takeo Kanade
International Journal of Robotics Research, Vol. 22, No. 6, June, 2003, pp. 393 - 418.


Download
  • Adobe portable document format (pdf) (510KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
Three-dimensional (3D) kinematic models are widely-used in video-based figure tracking. We show that these models can suffer from singularities when motion is directed along the viewing axis of a single camera. The single camera case is important because it arises in many interesting applications, such as motion capture from movie footage, video surveillance, and vision-based user-interfaces. We describe a novel two-dimensional scaled prismatic model (SPM) for figure registration. In contrast to 3D kinematic models, the SPM has fewer singularity problems and does not require detailed knowledge of the 3D kinematics. We fully characterize the singularities in the SPM and demonstrate tracking through singularities using synthetic and real examples. We demonstrate the application of our model to motion capture from movies. Fred Astaire is tracked in a clip from the film "Shall We Dance". We also present the use of monocular hand tracking in a 3D user-interface. These results demonstrate the benefits of the SPM in tracking with a single source of video.

Notes
Number of pages: 26

Text Reference
Jim Rehg, Daniel D. Morris, and Takeo Kanade, "Ambiguities in Visual Tracking of Articulated Objects Using Two- and Three-Dimensional Models," International Journal of Robotics Research, Vol. 22, No. 6, June, 2003, pp. 393 - 418.

BibTeX Reference
@article{Rehg_2003_4531,
   author = "Jim Rehg and Daniel D. Morris and Takeo Kanade",
   title = "Ambiguities in Visual Tracking of Articulated Objects Using Two- and Three-Dimensional Models",
   journal = "International Journal of Robotics Research",
   pages = "393 - 418",
   month = "June",
   year = "2003",
   volume = "22",
   number = "6",
}