Xavier: A Robot Navigation Architecture Based on Partially Observable Markov Decision Process Models

Sven Koenig and Reid Simmons
Book Section/Chapter, Artificial Intelligence Based Mobile Robotics: Case Studies of Successful Robot Systems, pp. 91 - 122, January, 1998


Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

Autonomous mobile robots need very reliable navigation capabilities in order to operate unattended for long periods of time. We present a technique for achieving this goal that uses partially observable Markov decision process models (POMDPs) to explicitly model navigation uncertainty, including actuator and sensor uncertainty and approximate knowledge of the environment. This allows the robot to maintain a probability distribution over its current pose. Thus, while the robot rarely knows exactly where it is, it always has some belief as to what its true pose is, and is never completely lost. We present a navigation architecture based on POMDPs that provides a uniform framework with an established theoretical foundation for pose estimation, path planning, robot control during navigation, and learning. Our experiments show that this architecture indeed leads to robust corridor navigation for an actual indoor mobile robot.


@incollection{Koenig-1998-16627,
author = {Sven Koenig and Reid Simmons},
title = {Xavier: A Robot Navigation Architecture Based on Partially Observable Markov Decision Process Models},
booktitle = {Artificial Intelligence Based Mobile Robotics: Case Studies of Successful Robot Systems},
publisher = {MIT Press},
editor = {D. Kortenkamp, R. Bonasso and R. Murphy},
year = {1998},
month = {January},
pages = {91 - 122},
} 2017-09-13T10:49:41-04:00