Competition and Coordination in Stochastic Games
2007
Conference Paper
ei
Agent competition and coordination are two classical and most important tasks in multiagent systems. In recent years, there was a number of learning algorithms proposed to resolve such type of problems. Among them, there is an important class of algorithms, called adaptive learning algorithms, that were shown to be able to converge in self-play to a solution in a wide variety of the repeated matrix games. Although certain algorithms of this class, such as Infinitesimal Gradient Ascent (IGA), Policy Hill-Climbing (PHC) and Adaptive Play Q-learning (APQ), have been catholically studied in the recent literature, a question of how these algorithms perform versus each other in general form stochastic games is remaining little-studied. In this work we are trying to answer this question. To do that, we analyse these algorithms in detail and give a comparative analysis of their behavior on a set of competition and coordination stochastic games. Also, we introduce a new multiagent learning algorithm, called ModIGA. This is an extension of the IGA algorithm, which is able to estimate the strategy of its opponents in the cases when they do not explicitly play mixed strategies (e.g., APQ) and which can be applied to the games with more than two actions.
Author(s): | Burkov, A. and Boularias, A. and Chaib-Draa, B. |
Book Title: | Canadian AI 2007 |
Journal: | Advances in Artificial Intelligence: 20th Conference of the Canadian Society for Computational Studies of Intelligence |
Pages: | 26-37 |
Year: | 2007 |
Month: | May |
Day: | 0 |
Editors: | Kobti, Z. , D. Wu |
Publisher: | Springer |
Department(s): | Empirical Inference |
Bibtex Type: | Conference Paper (inproceedings) |
DOI: | 10.1007/978-3-540-72665-4_3 |
Event Name: | 20th Conference of the Canadian Society for Computational Studies of Intelligence |
Event Place: | Montreal, Canada |
Address: | Berlin, Germany |
Digital: | 0 |
Language: | en |
Organization: | Max-Planck-Gesellschaft |
School: | Biologische Kybernetik |
Links: |
PDF
Web |
BibTex @inproceedings{6832, title = {Competition and Coordination in Stochastic Games}, author = {Burkov, A. and Boularias, A. and Chaib-Draa, B.}, journal = {Advances in Artificial Intelligence: 20th Conference of the Canadian Society for Computational Studies of Intelligence}, booktitle = {Canadian AI 2007}, pages = {26-37}, editors = {Kobti, Z. , D. Wu}, publisher = {Springer}, organization = {Max-Planck-Gesellschaft}, school = {Biologische Kybernetik}, address = {Berlin, Germany}, month = may, year = {2007}, doi = {10.1007/978-3-540-72665-4_3}, month_numeric = {5} } |