Search

Navigator: RI | Publications | Learning discrete Bayesian models for autonomous agent navigation

Graphics enhanced version of this site

Learning discrete Bayesian models for autonomous agent navigation
D. Nikovski and I. Nourbakhsh
Proceedings of IEEE Conference on Computational Intelligence in Robotics and Automation (CIRA '99), November, 1999, pp. 137 - 143.

Jump to: Download | Abstract | Text Reference | BibTeX Reference


Download [Help]

Adobe portable document format (pdf) [155 KB]
Compressed postscript (ps.gz) [49 KB]

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.


Abstract

Partially observable Markov decision processes (POMDPs) are a convenient representation for reasoning and planning in mobile robot applications. We investigate two algorithms for learning POMDPs from series of observation/action pairs by comparing their performance in fourteen synthetic worlds in conjunction with four planning algorithms. Experimental results suggest that the traditional Baum-Welch algorithm learns better the structure of worlds specifically designed to impede the agent, while a best-first model merging algorithm originally due to Stolcke and Omohundro (1993) performs better in more benign worlds, including such model of typical real-world robot fetching tasks.


Text Reference

D. Nikovski and I. Nourbakhsh, "Learning discrete Bayesian models for autonomous agent navigation," Proceedings of IEEE Conference on Computational Intelligence in Robotics and Automation (CIRA '99), November, 1999, pp. 137 - 143.


BibTeX Reference

@inproceedings{Nikovski_1999_3103,
   author = "Daniel Nikovski and Illah Nourbakhsh",
   title = "Learning discrete Bayesian models for autonomous agent navigation",
   booktitle = "Proceedings of IEEE Conference on Computational Intelligence in Robotics and Automation (CIRA '99)",
   month = "November",
   year = "1999",
   pages = "137 - 143"
}


The Robotics Institute is part of the School of Computer Science, Carnegie Mellon University.
For updates and comments, please see these instructions.
This page maintained by robotwebmaster@ri.cmu.edu