Crucial Factors in Cooperative Multirobot Learning

Poj Tangamchit, John M. Dolan, and Pradeep Khosla
Journal of Intelligent Automation and Soft Computing, Vol. 10, 2004, pp. 323-336.


Download
  • Adobe portable document format (pdf) (255KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
Cooperative decentralized multirobot learning refers to the use of multiple learning entities to learn optimal solutions for an overall multirobot system. We demonstrate that traditional single-robot learning theory can be successfully used with multirobot systems, but only under certain conditions. The success and the effectiveness of single-robot learning algorithms in multirobot systems are potentially affected by various factors that we classify into two groups: the nature of the robots and the nature of the learning. Incorrect set-up of these factors may lead to undesirable results. In this paper, we systematically test the effect of varying five common factors (model of the value function, reward scope, delay of global information, diversity of robots? capabilities, and number of robots) in decentralized multirobot learning experiments, first in simulation and then on real robots. The results show that three of these factors (model of the value function, reward scope, and delay of global information), if set up incorrectly, can prevent robots from learning optimal, cooperative solutions.

Keywords
multirobot learning, distributed reinforcement learning, cooperative robots

Notes
Number of pages: 14

Text Reference
Poj Tangamchit, John M. Dolan, and Pradeep Khosla, "Crucial Factors in Cooperative Multirobot Learning," Journal of Intelligent Automation and Soft Computing, Vol. 10, 2004, pp. 323-336.

BibTeX Reference
@article{Tangamchit_2004_5076,
   author = "Poj Tangamchit and John M Dolan and Pradeep Khosla",
   title = "Crucial Factors in Cooperative Multirobot Learning",
   journal = "Journal of Intelligent Automation and Soft Computing",
   pages = "323-336",
   year = "2004",
   volume = "10",
}