Learning-enhanced Market-based Task Allocation for Disaster Response

Edward Jones, M Bernardine Dias, and Anthony (Tony) Stentz
tech. report CMU-RI-TR-06-48, Robotics Institute, Carnegie Mellon University, October, 2006


Download
  • Adobe portable document format (pdf) (242KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
In this work we propose a market-based task allocation system for disaster response domains. We model the disaster response domain as a team of robots cooperating to extinguish a series of fires that arise due to a disaster. Each fire is associated with a time-decreasing reward for successful mitigation, with the value of the initial reward corresponding to task importance, and the speed of decay of the reward determining the urgency of the task. Deadlines are also associated with each fire, and penalties are assessed if fires are not extinguished by their deadlines. The team of robots aims to maximize summed reward over all emergency tasks, resulting in the lowest overall damage from the series of fires. We first implement a baseline market-based approach to task allocation for disaster response. In the baseline approach the allocation respects task importance and urgency, but agents do a poor job of anticipating future emergencies and are assessed a high number of penalties. We then propose a learning-enhanced market-based approach. Our regression-based technique modifies agents' bids resulting in an allocation that avoids many of the penalties assessed when using the baseline approach; by avoiding penalties and better respecting task importance and urgency the robot team achieves substantially higher overall reward. We illustrate the effectiveness of our approach in a simulated disaster response scenario.

Keywords
market-based systems, multirobot planning, multirobot learning

Notes
Sponsor: U.S. Army Research Laboratory
Grant ID: DAAD19-01-2-0012
Associated Center(s) / Consortia: Vision and Autonomous Systems Center and Field Robotics Center
Associated Project(s): CTA Robotics

Text Reference
Edward Jones, M Bernardine Dias, and Anthony (Tony) Stentz, "Learning-enhanced Market-based Task Allocation for Disaster Response," tech. report CMU-RI-TR-06-48, Robotics Institute, Carnegie Mellon University, October, 2006

BibTeX Reference
@techreport{Jones_2006_5574,
   author = "Edward Jones and M Bernardine Dias and Anthony (Tony) Stentz",
   title = "Learning-enhanced Market-based Task Allocation for Disaster Response",
   booktitle = "",
   institution = "Robotics Institute",
   month = "October",
   year = "2006",
   number= "CMU-RI-TR-06-48",
   address= "Pittsburgh, PA",
}