Hidden Markov Model Approach to Skill Learning and Its Application to Telerobotics

Jie Yang, Yangsheng Xu, and Mei Chen
tech. report CMU-RI-TR-93-01, Robotics Institute, Carnegie Mellon University, January, 1993


Download
  • Adobe portable document format (pdf) (1MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
In this paper, we discuss the problem of how human skill can be represented as a parametric model using a hidden Markov model (HMM), and how a HMM-based skill model can be used to learn human skill. HMM is feasible to characterize two stochastic processes?easurable action and immeasurable mental states?hich are involved in the skill learning. We formulated the learning problem as a multi-dimensional HMM and developed a programming system which serves as a skill learning testbed for a variety of applications. Based on "the most likely performance" criterion, we can select the best action sequence from all previously measured action data by modeling the skill as HMM. This selection process can be updated in real-time by feeding new action data and modifying HMM parameters. We address the implementation of the proposed method in a teleoperation-controlled space robot. An operator specifies the control command by a hand controller for the task of exchanging Orbit Replaceable Unit, and the robot learns the operation skill by selecting the sequence which represents the most likely performance of the operator. The skill is learned in Cartesian space, joint space, and velocity domain. The experimental results demonstrate the feasibility of the proposed method in learning human skill and teleoperation control. The learning is significant in eliminating sluggish motion and correcting the motion command which the operator mistakenly generates.

Notes
Grant ID: DACA76-89-C-0014, DAAE07-90-C-R059
Number of pages: 28

Text Reference
Jie Yang, Yangsheng Xu, and Mei Chen, "Hidden Markov Model Approach to Skill Learning and Its Application to Telerobotics," tech. report CMU-RI-TR-93-01, Robotics Institute, Carnegie Mellon University, January, 1993

BibTeX Reference
@techreport{Yang_1993_291,
   author = "Jie Yang and Yangsheng Xu and Mei Chen",
   title = "Hidden Markov Model Approach to Skill Learning and Its Application to Telerobotics",
   booktitle = "",
   institution = "Robotics Institute",
   month = "January",
   year = "1993",
   number= "CMU-RI-TR-93-01",
   address= "Pittsburgh, PA",
}