Xavier: A Robot Navigation Architecture Based on Partially Observable Markov Decision Process Models

Sven Koenig and Reid Simmons
Artificial Intelligence Based Mobile Robotics: Case Studies of Successful Robot Systems, D. Kortenkamp, R. Bonasso and R. Murphy, ed., MIT Press, 1998, pp. 91 - 122.


Abstract
Autonomous mobile robots need very reliable navigation capabilities in order to operate unattended for long periods of time. We present a technique for achieving this goal that uses partially observable Markov decision process models (POMDPs) to explicitly model navigation uncertainty, including actuator and sensor uncertainty and approximate knowledge of the environment. This allows the robot to maintain a probability distribution over its current pose. Thus, while the robot rarely knows exactly where it is, it always has some belief as to what its true pose is, and is never completely lost. We present a navigation architecture based on POMDPs that provides a uniform framework with an established theoretical foundation for pose estimation, path planning, robot control during navigation, and learning. Our experiments show that this architecture indeed leads to robust corridor navigation for an actual indoor mobile robot.

Notes
Associated Lab(s) / Group(s): Reliable Autonomous Systems Lab
Associated Project(s): Xavier

Text Reference
Sven Koenig and Reid Simmons, "Xavier: A Robot Navigation Architecture Based on Partially Observable Markov Decision Process Models," Artificial Intelligence Based Mobile Robotics: Case Studies of Successful Robot Systems, D. Kortenkamp, R. Bonasso and R. Murphy, ed., MIT Press, 1998, pp. 91 - 122.

BibTeX Reference
@incollection{Koenig_1998_3858,
   author = "Sven Koenig and Reid Simmons",
   editor = "D. Kortenkamp, R. Bonasso and R. Murphy",
   title = "Xavier: A Robot Navigation Architecture Based on Partially Observable Markov Decision Process Models",
   booktitle = "Artificial Intelligence Based Mobile Robotics: Case Studies of Successful Robot Systems",
   pages = "91 - 122",
   publisher = "MIT Press",
   year = "1998",
}