Crucial Factors Affecting Decentralized Multirobot Learning in an Object Manipulation Task

Poj Tangamchit, John M. Dolan, and Pradeep Khosla
ACM/SIGART Workshop on Agent Swarm Programming 2003 (WASP'03), October, 2003.


Download
  • Adobe portable document format (pdf) (245KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
Decentralized multirobot learning refers to the use of multiple learning entities to achieve the optimal solution for the overall robot system. We demonstrate that single-robot learning theory can be successfully used with multirobot systems, but with certain conditions. The success and the effectiveness of this method are potentially affected by various factors that we classify into two groups: the nature of the robots and the nature of the learning entities. Incorrect setup of these factors may lead to undesirable results. In this paper, we methodically test the effect of varying four common factors (reward scope, learning algorithms, diversity of robots, and number of robots) in a decentralized multirobot system, first in simulation and then on real robots. The results show that two of these factors, reward scope and learning algorithm, if set up incorrectly, can prevent optimal, cooperative solutions.

Keywords
Multirobot, Learning, Object Manipulation, Decentralized

Notes
Number of pages: 10

Text Reference
Poj Tangamchit, John M. Dolan, and Pradeep Khosla, "Crucial Factors Affecting Decentralized Multirobot Learning in an Object Manipulation Task," ACM/SIGART Workshop on Agent Swarm Programming 2003 (WASP'03), October, 2003.

BibTeX Reference
@inproceedings{Tangamchit_2003_4475,
   author = "Poj Tangamchit and John M Dolan and Pradeep Khosla",
   editor = "Marc Kirschenbaum",
   title = "Crucial Factors Affecting Decentralized Multirobot Learning in an Object Manipulation Task",
   booktitle = "ACM/SIGART Workshop on Agent Swarm Programming 2003 (WASP'03)",
   month = "October",
   year = "2003",
}