RI | Publications | Point-based value iteration: An anytime algorithm for POMDPs

Text only version of this site

Point-based value iteration: An anytime algorithm for POMDPs
J. Pineau, G. Gordon, and S. Thrun
International Joint Conference on Artificial Intelligence (IJCAI), August, 2003, pp. 1025 - 1032.

Jump to: Download | Abstract | Notes | Text Reference | BibTeX Reference

Download [Help]

Adobe portable document format (pdf) [171 KB]
Compressed postscript (ps.gz) [145 KB]

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

This paper introduces the Point-Based Value Iteration (PBVI) algorithm for POMDP planning. PBVI approximates an exact value iteration solution by selecting a small set of representative belief points and then tracking the value and its derivative for those points only. By using stochastic trajectories to choose belief points, and by maintaining only one value hyper-plane per point, PBVI successfully solves large problems: we present results on a robotic laser tag problem as well as three test domains from the literature.

Notes

Associated lab/group: Robot Learning Lab

Number of pages: 8

Text Reference

J. Pineau, G. Gordon, and S. Thrun, "Point-based value iteration: An anytime algorithm for POMDPs," International Joint Conference on Artificial Intelligence (IJCAI), August, 2003, pp. 1025 - 1032.

BibTeX Reference

@inproceedings{Pineau_2003_4826,
   author = "Joelle Pineau and Geoffrey Gordon and Sebastian Thrun",
   title = "Point-based value iteration: An anytime algorithm for POMDPs",
   booktitle = "International Joint Conference on Artificial Intelligence (IJCAI)",
   month = "August",
   year = "2003",
   pages = "1025 - 1032"
}