Learning Situation-Dependent Costs: Using Execution to Refine Planning Models

Karen Zita Haigh and Manuela Veloso
roceedings of the Ninth International Workshop on the Principles of Diagnosis (DX98), 1998.


Download
  • Adobe portable document format (pdf) (470KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
Physical environments are so complex that it is hard to hand-tune all of the domain knowledge, especially to model the dynamics of the environment. The work presented in this paper explores machine learning techniques to autonomously identify situations in the environment that affect plan quality. We introduce the concept of situation-dependent costs, where situational features can be attached to the costs used by the path planner. These costs effectively diagnose and predict situations the robot encounters so that the planner can generate paths that are appropriate for each situation.

We present an implementation of our situation-dependent learning approach in a real robotic system, ROGUE. ROGUE learns situation-dependent costs for arcs in a topological map of the environment; these costs are then used by the path planner to predict and avoid failures. In this article, we present the representation of the path planner and the navigation modules, and describe the execution trace. We show how training data is extracted from the execution trace. We present experimental results from a simulated, controlled environment as well as from data collected from the actual robot. Our approach effectively refines models of dynamic systems and improves the efficiency of generated plans.


Notes

Text Reference
Karen Zita Haigh and Manuela Veloso, "Learning Situation-Dependent Costs: Using Execution to Refine Planning Models," roceedings of the Ninth International Workshop on the Principles of Diagnosis (DX98), 1998.

BibTeX Reference
@inproceedings{Veloso_1998_2915,
   author = "Karen Zita Haigh and Manuela Veloso",
   title = "Learning Situation-Dependent Costs: Using Execution to Refine Planning Models",
   booktitle = "roceedings of the Ninth International Workshop on the Principles of Diagnosis (DX98)",
   publisher = "AAAI Press",
   year = "1998",
}