Inferring Human Upper Body Motion Using Belief Propagation

Jiang Gao and Jianbo Shi
tech. report CMU-RI-TR-03-06, Robotics Institute, Carnegie Mellon University, June, 2003


Download
  • Adobe portable document format (pdf) (3MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
We present an algorithm for automatic inference of human upper body motion in a natural scene. A graph model is proposed for inferring human upper body motion, and motion inference is posed as a mapping problem between state nodes in the graph model and features in image patches. A multiple-frame inference algorithm is proposed to combine both structural and temporal constraints in human upper body motion. Belief propagation and dynamic programming algorithms are utilized for Bayesian inference in this graph. We also present a method for capturing constraints of human body configuration under different view angles. The algorithm is applied in a prototype system that can automatically detect upper body motion from videos, without manual initialization of body parts. We present evaluation results of our algorithm.

Keywords
Human motion detection, upper body motion inference, graph model, Markov network, Bayesian inference, belief propagation

Notes
Associated Center(s) / Consortia: Vision and Autonomous Systems Center
Associated Lab(s) / Group(s): Human Identification at a Distance
Number of pages: 18

Text Reference
Jiang Gao and Jianbo Shi, "Inferring Human Upper Body Motion Using Belief Propagation," tech. report CMU-RI-TR-03-06, Robotics Institute, Carnegie Mellon University, June, 2003

BibTeX Reference
@techreport{Gao_2003_4432,
   author = "Jiang Gao and Jianbo Shi",
   title = "Inferring Human Upper Body Motion Using Belief Propagation",
   booktitle = "",
   institution = "Robotics Institute",
   month = "June",
   year = "2003",
   number= "CMU-RI-TR-03-06",
   address= "Pittsburgh, PA",
}