Distributed POMDPs
Distributed Partially Observable Markov Decision Problems
Maintained by
Mohit Goenka
and
Jun-young Kwak
Distributed POMDPs are used to model the problem of deriving joint policies that maximize a reward function for a group of agents in a partially observable environment.
If you wish to share your code and the data sets for Distributed POMDP type formalisms on this page, please contact Jun-young Kwak (junyounk at usc dot edu).
The 6th MSDM workshop is held in conjunction with AAMAS-2011 (the 10th International Joint Conference on Autonomous Agents and Multiagent Systems), in Taipei, Taiwan. More information can be obtained at:
http://teamcore.usc.edu/junyounk/msdm2011/.
|
Formalism
|
References
|
Code and Datasets
|
|
Communication with Locality of Interaction
|
§ Makoto Tasaki, Yuichi Yabu, Yuki Iwanari, Makoto Yokoo, Janusz Marecki, Pradeep Varakantham, Milind Tambe. Introducing Communication in Dis-POMDPs with Locality of Interaction. In Web Intelligence and Agent Systems: An International Journal, 2010.
|
|
|
Team’s REshaping of MOdels for Rapid execution (TREMOR)
|
§ Pradeep Varakantham, Jun-young Kwak, Matthew Taylor, Janusz Marecki, Paul Scerri, Milind Tambe. Exploiting Coordination Locales in Distributed POMDPs via Social Model Shaping . In ICAPS, 2009.
|
Code and Datasets
|
|
FSM Based Agent Network Search
|
§ J. Marecki, T. Gupta, P. Varakantham, M. Tambe, M. Yokoo. Not All Agents Are Equal: Scaling up Distributed POMDPs for Agent Networks . In AAMAS, 2008.
|
Code
|
|
Network Distributed POMDP (ND-POMDP)
|
§ P. Varakantham, J. Marecki, Y. Yabu, M. Tambe, M. Yokoo. Letting loose a SPIDER on a network of POMDPs: Generating quality guaranteed policies . In AAMAS, 2007.
|
|
|
Network Distributed POMDP (ND-POMDP)
|
§ P. Varakantham, J. Marecki, M. Tambe, M. Yokoo. SPIDER attack on a network of POMDPs: Towards quality bounded solutions . In AAAI Spring Symposium, 2007.
|
|
|
Security through Policy Randomization in Distributed
POMDPs
|
§
P. Paruchuri, M. Tambe, F. Ordonez, S. Kraus. Security
in Multiagent Systems by Policy Randomization
. In AAMAS, 2006.
|
|
|
Continuous Space Distributed POMDPs (CS-JESP)
|
§
P. Varakantham, R.
Nair, M. Tambe, M. Yokoo.
Winning
back the CUP for distributed POMDPs: Planning over continuous belief spaces . In AAMAS, 2006.
|
|
|
Network Distributed POMDP (ND-POMDP)
|
§ Y. Kim, R. Nair, P. Varakantham, M. Tambe, M. Yokoo. Exploiting Locality of Interaction in Networked Distributed POMDPs . In AAAI Spring Symposium, 2006.
|
|
|
Network Distributed POMDP (ND-POMDP)
|
§
R. Nair, P.
Varakantham, M. Tambe, M. Yokoo. Networked Distributed POMDPs: A Synthesis of Distributed Constraint
Optimization and POMDPs. In
AAAI, 2005.
|
Code, Datasets
|
|
Resource Constraints in Team Settings
|
§
P.Paruchuri, M. Tambe, F.Ordonez, S.Kraus. Towards a formalization of teamwork with
resource constraints. In AAMAS, 2004.
|
|
|
Locally Optimal Algorithms for Distributed POMDPs
|
§
R. Nair, M. Roth, M. Yokoo,
M. Tambe. Communication for Improving Policy Computation in Distributed POMDPs. In AAMAS, 2004.
§
R. Nair, D. Pynadath,
M. Yokoo, M. Tambe, S. Marsella. Taming
Decentralized POMDPs: Towards Efficient Policy
Computation for Multiagent Settings. In
IJCAI, 2003.
|
Code
|
|
Role-based Multiagent Team
Decision Problem
|
§
R. Nair, M. Tambe,
S. Marsella. Role allocation
and reallocation in multiagent systems: Towards a
practical analysis. In AAMAS, 2003.
|
|
|
Communicative MultiAgent Team
Decision Problem (COM-MTDP)
|
§
Pynadath, D. and
Tambe, M. Multiagent
teamwork: Analyzing key teamwork theories and models. First Autonomous
Agents and Multiagent Systems Conference (AAMAS),
2002
§
Pynadath, D. and
Tambe, M. The
communicative multiagent team decision problem:
Analyzing teamwork theories and models. In Journal of AI Research
(JAIR), 2002
|
Code and
Datasets
|
Relevant Presentations
1. Presentation on TREMOR at ICAPS, 2009, ppt.
2. Presentation on ND-POMDPs at AAAI Spring Symposium, 2007, pdf
3.
Presentation
on ND-POMDPs at AAAI, 2005.
4.
Presentation
on Distributed POMDPs at Microsoft Research, 2004, ppt
5.
Presentation
on COM-MTDPs at AAMAS, 2002.
|
