RI | Publications | Reasoning About Joint Beliefs for Execution-Time Communication Decisions

Text only version of this site

Reasoning About Joint Beliefs for Execution-Time Communication Decisions
M. Roth, R. Simmons, and M. Veloso
The Fourth International Joint Conference on Autonomous Agents and Multi Agent Systems (AAMAS), 2005.

Jump to: Abstract | Notes | Text Reference | BibTeX Reference

Abstract

Just as POMDPs have been used to reason explicitly about uncertainty in single-agent systems, there has been recent interest in using multi-agent POMDPs to coordinate teams of agents in the presence of uncertainty. Although multi-agent POMDPs are known to be highly intractable, communication at every time step transforms a multi-agent POMDP into a more tractable single-agent POMDP. In this paper, we present an approach that generates "centralized" policies for multi-agent POMDPs at plan-time by assuming the presence of free communication, and at run-time, handles the problem of limited communication resources by reasoning about the use of communication as needed for effective execution. This approach trades off the need to do some computation at execution-time for the ability to generate policies more tractably at plan-time. In our algorithm, each agent, at run-time models the distribution of possible joint beliefs. Joint actions are selected over this distribution, ensuring that agents remain synchronized. Communication is used to integrate local observations into the team belief only when those observations would improve team performance. We show, both through a detailed example and with experimental results, that our approach allows for effective decentralized execution while avoiding unnecessary instances of communication.

Notes

Associated labs/groups: Reliable Autonomous Systems Lab and MultiRobot Lab

Text Reference

M. Roth, R. Simmons, and M. Veloso, "Reasoning About Joint Beliefs for Execution-Time Communication Decisions," The Fourth International Joint Conference on Autonomous Agents and Multi Agent Systems (AAMAS), 2005.

BibTeX Reference

@inproceedings{Roth_2005_5525,
   author = "Maayan Roth and Reid Simmons and Manuela Veloso",
   title = "Reasoning About Joint Beliefs for Execution-Time Communication Decisions",
   booktitle = "The Fourth International Joint Conference on Autonomous Agents and Multi Agent Systems (AAMAS)",
   year = "2005"
}