The Robotics Institute
Search the site
RI | Publications | A Cost Minimization Approach to Human Behavior Recognition

Text only version of this site

A Cost Minimization Approach to Human Behavior Recognition
G. Sukthankar and K. Sycara
Proceedings of Fourth International Joint Conference on Autonomous Agents and Multi-Agent Systems, July, 2005.

Jump to: Download | Abstract | Notes | Text Reference | BibTeX Reference

Download [Help]

Adobe portable document format (pdf) [364 KB]

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

This paper presents a cost minimization approach to the problem of human behavior recognition. Using full-body motion capture data acquired from human subjects, our system recognizes the behaviors that a human subject is performing from a set of military maneuvers, based on the subject's motion type and proximity to landmarks. Low-level motion classification is performed using support vector machines (SVMs) and a hidden Markov Model (HMM); output from the classifier is used as an input feature for the behavior recognizer. Given the dynamic and highly reactive nature of the domain, our system must handle behavior sequences that are frequently interrupted and often interleaved. To recognize such behavior sequences, we employ dynamic programming in conjunction with a behavior transition cost function to efficiently select the most parsimonious explanation for the human's actions. We demonstrate that our system is robust to action classification errors and deviations by the human subject from the expected set of behaviors. Our approach is well suited for incorporation into synthetic agents that cooperate or compete against human subjects in virtual reality training environments.

Notes

Sponsor: ONR
Grant ID: N00014-02-1-0438

Associated center: CIMDS
Associated lab/group: Intelligent Software Agents
Associated project: Agent-based Composition of Behavioral Models

Number of pages: 8

Text Reference

G. Sukthankar and K. Sycara, "A Cost Minimization Approach to Human Behavior Recognition," Proceedings of Fourth International Joint Conference on Autonomous Agents and Multi-Agent Systems, July, 2005.

BibTeX Reference

@inproceedings{Sukthankar_2005_5020,
   author = "Gita Sukthankar and Katia Sycara",
   title = "A Cost Minimization Approach to Human Behavior Recognition",
   booktitle = "Proceedings of Fourth International Joint Conference on Autonomous Agents and Multi-Agent Systems",
   month = "July",
   year = "2005"
}


The Robotics Institute is part of the School of Computer Science, Carnegie Mellon University.
For updates and comments, please see these instructions.
This page maintained by robotwebmaster@ri.cmu.edu