Carnegie Mellon University
Hidden Markov Model for Gesture Recognition

Jie Yang and Yangsheng Xu
tech. report CMU-RI-TR-94-10, Robotics Institute, Carnegie Mellon University, May, 1994

  • Adobe portable document format (pdf) (1MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

This report presents a method for developing a gesture-based system using a multi-dimensional hidden Markov (HMM). Instead of using geometric features, gestures are converted into sequential symbols. HMMs are employed to represent the gestures and their parameters are learned from the training data. Based on "the most likely performance" criterion, the gestures can be recognized through evaluating the trained HMMs. We have developed a prototype system to demonstrate the feasibility of the proposed method. The system achieved 99.78% accuracy for an isolated recognition task with nine gestures. Encouraging results were also obtained from experiments of continuous gesture recognition. The proposed method is applicable to any gesture represented by a multi-dimensional signal, and will be a valuable tool in telerobotics and human computer interfaces.

Grant ID: DACA76-89-C-0014, DAAE07-90-C-R059
Number of pages: 23

Text Reference
Jie Yang and Yangsheng Xu, "Hidden Markov Model for Gesture Recognition," tech. report CMU-RI-TR-94-10, Robotics Institute, Carnegie Mellon University, May, 1994

BibTeX Reference
   author = "Jie Yang and Yangsheng Xu",
   title = "Hidden Markov Model for Gesture Recognition",
   booktitle = "",
   institution = "Robotics Institute",
   month = "May",
   year = "1994",
   number= "CMU-RI-TR-94-10",
   address= "Pittsburgh, PA",