Exact Dynamic Programming for Decentralized POMDPs with Lossless Policy Compression
2008
Conference Paper
ei
High dimensionality of belief space in DEC-POMDPs is one of the major causes that makes the optimal joint policy computation intractable. The belief state for a given agent is a probability distribution over the system states and the policies of other agents. Belief compression is an efficient POMDP approach that speeds up planning algorithms by projecting the belief state space to a low-dimensional one. In this paper, we introduce a new method for solving DEC-POMDP problems, based on the compression of the policy belief space. The reduced policy space contains sequences of actions and observations that are linearly independent. We tested our approach on two benchmark problems, and the preliminary results confirm that Dynamic Programming algorithm scales up better when the policy belief is compressed.
Author(s): | Boularias, A. and Chaib-Draa, B. |
Book Title: | ICAPS 2008 |
Journal: | Proceedings of the the Eighteenth International Conference on Automated Planning and Scheduling (ICAPS 2008) |
Pages: | 20-27 |
Year: | 2008 |
Month: | September |
Day: | 0 |
Editors: | Rintanen, J. , B. Nebel, J. C. Beck, E. A. Hansen |
Publisher: | AAAI Press |
Department(s): | Empirical Inference |
Bibtex Type: | Conference Paper (inproceedings) |
Event Name: | Eighteenth International Conference on Automated Planning and Scheduling |
Event Place: | Sydney, Australia |
Address: | Menlo Park, CA, USA |
Digital: | 0 |
Language: | en |
Organization: | Max-Planck-Gesellschaft |
School: | Biologische Kybernetik |
Links: |
PDF
Web |
BibTex @inproceedings{6828, title = {Exact Dynamic Programming for Decentralized POMDPs with Lossless Policy Compression}, author = {Boularias, A. and Chaib-Draa, B.}, journal = {Proceedings of the the Eighteenth International Conference on Automated Planning and Scheduling (ICAPS 2008)}, booktitle = {ICAPS 2008}, pages = {20-27}, editors = {Rintanen, J. , B. Nebel, J. C. Beck, E. A. Hansen}, publisher = {AAAI Press}, organization = {Max-Planck-Gesellschaft}, school = {Biologische Kybernetik}, address = {Menlo Park, CA, USA}, month = sep, year = {2008}, doi = {}, month_numeric = {9} } |