Unsupervised Learning of Probabilistic Models for Robot Navigation

Sven Koenig and Reid Simmons
Conference Paper, Proceedings of the 1996 IEEE International Conference on Robotics and Automation (ICRA '96), pp. 2301 - 2308, January, 1996

View Publication

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.


Navigation methods for office delivery robots need to take various sources of uncertainty into account in order to get robust performance. In previous work, we developed a reliable navigation technique that uses partially observable Markov models to represent metric, actuator, and sensor uncertainties. This paper describes an algorithm that adjusts the probabilities of the initial Markov model by passively observing the robot’s interactions with its environment. The learned probabilities more accurately reflect the actual uncertainties in the environment, which ultimately leads to improved navigation performance. The algorithm, an extension of the Baum-Welch algorithm, learns without a teacher and addresses the issues of limited memory and the cost of collecting training data. Empirical results show that the algorithm learns good Markov models with a small amount of training data.

author = {Sven Koenig and Reid Simmons},
title = {Unsupervised Learning of Probabilistic Models for Robot Navigation},
booktitle = {Proceedings of the 1996 IEEE International Conference on Robotics and Automation (ICRA '96)},
year = {1996},
month = {January},
pages = {2301 - 2308},
} 2017-09-13T10:46:45-04:00