Imitation Learning for Task Allocation.

Felix Duvallet and Anthony (Tony) Stentz
2010 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2010), October, 2010.

  • Adobe portable document format (pdf) (159KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

At the heart of multi-robot task allocation lies the ability to compare multiple options in order to select the best. In some domains this utility evaluation is not straightforward, for example due to complex and unmodeled underlying dynamics or an adversary in the environment. Explicitly modeling these extrinsic influences well enough so that they can be accounted for in utility computation (and thus task allocation) may be intractable, but a human expert may be able to quickly gain some intuition about the form of the desired solution. We propose to harness the expert’s intuition by applying imitation learning to the multi-robot task allocation domain. Using a market-based method, we steer the allocation process by biasing prices in the market according to a policy which we learn using a set of demonstrated allocations (the expert’s solutions to a number of domain instances). We present results in two distinct domains: a disaster response scenario where a team of agents must put out fires that are spreading between buildings, and an adversarial game in which teams must make complex strategic decisions to score more points than their opponents.

multi-robot cooperation, imitation learning, learning

Associated Center(s) / Consortia: Field Robotics Center
Associated Lab(s) / Group(s): rCommerce

Text Reference
Felix Duvallet and Anthony (Tony) Stentz, "Imitation Learning for Task Allocation.," 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2010), October, 2010.

BibTeX Reference
   author = "Felix Duvallet and Anthony (Tony) Stentz",
   title = "Imitation Learning for Task Allocation.",
   booktitle = "2010 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2010)",
   month = "October",
   year = "2010",