The Robotics Institute
Search the site
RI | Publications | A neural-network based approach for recognition of pose and motion gestures on a mobile robot

Text only version of this site

A neural-network based approach for recognition of pose and motion gestures on a mobile robot
S. Waldherr, S. Thrun, and R. Romero
Proceedings of the 5th Brazilian Symposium on Neural Networks, December, 1998, pp. 79 - 84.

Jump to: Download | Abstract | Text Reference | BibTeX Reference

Download [Help]

Adobe portable document format (pdf) [702 KB]

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

Since a variety of changes in both robotic hardware and software suggests that service robots will soon become possible, to find "natural" ways of communication between human and robots is of fundamental importance for the robotic field. The paper describes a gesture-based interface for human-robot interaction, which enables people to instruct robots through easy-to-perform arm gestures. Such gestures might be static pose gestures, which involve only a specific configuration of the person's arm, or they might be dynamic motion gestures, that is, they involve motion (such as waving). Gestures are recognized in real-time at approximate frame rate, using neural networks. A fast, color-based tracking algorithm enables the robot to track and follow a person reliably through office environments with drastically changing lighting conditions. Results are reported in the context of an interactive clean-up task, where a person guides the robot to specific locations that need to be cleaned, and the robot picks up trash which it then delivers to the nearest trash-bin.

Text Reference

S. Waldherr, S. Thrun, and R. Romero, "A neural-network based approach for recognition of pose and motion gestures on a mobile robot," Proceedings of the 5th Brazilian Symposium on Neural Networks, December, 1998, pp. 79 - 84.

BibTeX Reference

@inproceedings{Waldherr_1998_3589,
   author = "S. Waldherr and Sebastian Thrun and Richard Romero",
   title = "A neural-network based approach for recognition of pose and motion gestures on a mobile robot",
   booktitle = "Proceedings of the 5th Brazilian Symposium on Neural Networks",
   month = "December",
   year = "1998",
   pages = "79 - 84"
}


The Robotics Institute is part of the School of Computer Science, Carnegie Mellon University.
For updates and comments, please see these instructions.
This page maintained by robotwebmaster@ri.cmu.edu