The Robotics Institute

Carnegie Mellon Robotics Institute

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

The principle of maximum entropy provides a powerful framework for estimating joint, conditional, and marginal probability distributions. However, there are many important distributions with elements of interaction and feedback where its applicability has not been established. This work presents the principle of maximum causal entropy—an approach based on directed information theory for estimating an unknown process based on its interactions with a known process. We demonstrate the breadth of the approach using two applications: a predictive solution for inverse optimal control in decision processes and computing equilibrium strategies in sequential games.

Keywords

Maximum entropy, statistical estimation, causal entropy, directed information, inverse optimal control, inverse reinforcement learning, correlated equilibrium

Notes

Number of pages: 15

Text Reference

Brian D. Ziebart, J. Andrew (Drew) Bagnell, and Anind Dey, "The Principle of Maximum Causal Entropy for Estimating Interacting Processes," IEEE Transactions on Information Theory, , February, 2013

BibTeX Reference

@article{Ziebart_2013_7401,
   author = "Brian D. Ziebart and J. Andrew (Drew) Bagnell and Anind Dey",
   title = "The Principle of Maximum Causal Entropy for Estimating Interacting Processes",
   journal = "IEEE Transactions on Information Theory",
   month = "February",
   year = "2013",
}

The Robotics Institute

Menu