Hidden Markov Model for Control Strategy Learning

Jie Yang and Yangsheng Xu
tech. report CMU-RI-TR-94-11, Robotics Institute, Carnegie Mellon University, May, 1994


Download
  • Adobe portable document format (pdf) (666KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
This report presents a method for learning a control strategy using the hidden Markov model (HMM), i.e., developing a feedback controller based on HMMs. The HMM is a parametric model for non-stationary pattern recognition and is feasible to characterize a doubly stochastic process involving observable actions and a hidden decision pattern. The control strategy is encoded by HMMs through a training process. The trained models are then employed to control the system. The proposed method has been investigated by simulations of a linear system and an inverted pendulum system. The HMM-based controller provides a novel way to learn control strategy and to model the humans decision making process.

Notes
Grant ID: DACA76-89-C-0014, DAAE07-90-C-R059
Number of pages: 18

Text Reference
Jie Yang and Yangsheng Xu, "Hidden Markov Model for Control Strategy Learning," tech. report CMU-RI-TR-94-11, Robotics Institute, Carnegie Mellon University, May, 1994

BibTeX Reference
@techreport{Yang_1994_330,
   author = "Jie Yang and Yangsheng Xu",
   title = "Hidden Markov Model for Control Strategy Learning",
   booktitle = "",
   institution = "Robotics Institute",
   month = "May",
   year = "1994",
   number= "CMU-RI-TR-94-11",
   address= "Pittsburgh, PA",
}