Learning Decisions: Robustness, Uncertainty, and Approximation

J. Andrew (Drew) Bagnell
doctoral dissertation, tech. report CMU-RI-TR-04-67, Robotics Institute, Carnegie Mellon University, August, 2004


Download
  • Adobe portable document format (pdf) (3MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
Decision making under uncertainty is a central problem in robotics and machine learning.This thesis explores three fundamental and intertwined aspects of the problem of learning to make decisions.

The first is the problem of uncertainty. Classical optimal control techniques typically rely on perfect state information. Real world problems never enjoy such conditions. Perhaps more critically, classical optimal control algorithms fail to degrade gracefully as this assumption is violated. Closely tied to the problem of uncertainty is that of approximation.In large scale problems, learning decisions inevitably requires approximation. The difficulties of approximation inside the framework of optimal control are well-known. [Gordon,1995]

Often, especially in robotics applications, we wish to operate learned controllers in domains where failure has relatively serious consequences. It is important to ensure that decision policies we generate are robust both to uncertainty in our models of systems and to our inability to accurately capture true system dynamics.

We present new classes of algorithms that gracefully handle uncertainty, approximation, and robustness. We pay attention to the computational aspects of both the problems and algorithms developed. Finally, we provide case studies that serve as both motivation for the techniques as well as illustrate their applicability.


Notes
Number of pages: 160

Text Reference
J. Andrew (Drew) Bagnell, "Learning Decisions: Robustness, Uncertainty, and Approximation," doctoral dissertation, tech. report CMU-RI-TR-04-67, Robotics Institute, Carnegie Mellon University, August, 2004

BibTeX Reference
@phdthesis{Bagnell_2004_4905,
   author = "J. Andrew (Drew) Bagnell",
   title = "Learning Decisions: Robustness, Uncertainty, and Approximation",
   booktitle = "",
   school = "Robotics Institute, Carnegie Mellon University",
   month = "August",
   year = "2004",
   number= "CMU-RI-TR-04-67",
   address= "Pittsburgh, PA",
}