Reading Group: Robust Optimization Under Uncertainty


Maintained by Jun-young Kwak. If you need any more information or have any suggestions, please contact Jun-young Kwak (junyounk at usc dot edu).


Key Information

  • Location: PHE 223

  • Time: Every Tue 12:30pm - 2:00pm

  • Topics: Multi-objective Optimization, Sequential Decision Making under Uncertainty, Robust Optimization, Stochastic Programming, Multiagent Planning & Learning, Human-agent Interaction/Negotiation, Social Psychology Study, etc.


2013 Spring/Summer Schedule

No. Date Presenter Paper
1 04/09/2013 - 1. Stochastic Mixed-Integer Programming Algorithms: Beyond Benders' Decomposition
(Sen, Suvrajeet). Wiley Encyclopedia of Operations Research and Management Science (2010).
2. The Million-variable "March" for Stochastic Combinatorial Optimization
(Ntaimo, Lewis, and Suvrajeet Sen). Journal of Global Optimization 32.3 (2005): 385-400.
3. Statistical approximations for stochastic linear programming problems
(Higle, Julia L., and Suvrajeet Sen). Annals of Operations Research 85 (1999): 173-193.
2 04/18/2013 - 1. Stochastic Programming
(Sen, Suvrajeet). Encyclopedia of Operations Research and Management Science (2012).
2. Lightning Does Not Strike Twice: Robust MDPs with Coupled Uncertainty
(Shie Mannor, Ofir Mebel, and Huan Xu). ICML (2012).
3 04/23/2013 Albert & Chao 1. Robust discrete optimization and network flows
(Dimitris Bertsimas, and Melvyn Sim). Mathematical Programming 98, no. 1-3 (2003): 49-71.
2. A Simple Tutorial ON Boyen-Koller Projection on DBNS
(Brenda Ng). Based on Tractable Inference for Complex Stochastic Processes (UAI'98) by Xavier Boyen & Daphne Koller.
4 05/02/2013 Francesco Solving Transition Independent Decentralized Markov Decision Processes
(Raphen Becker, Shlomo Zilberstein, Victor Lesser, and Claudia V. Goldman). JAIR, 2004.
5 05/07/2013
No reading group (AAMAS'13)
6 05/14/2013
No reading group (AAMAS'13)
7 05/21/2013 Matt Integrating Sample-based Planning and Model-based Reinforcement Learning
(Thomas J. Walsh and Sergiu Goschin and Michael L. Littman). In AAAI, 2010.
8 05/28/2013 Jun Algorithmic Game Theory: Chapter 15. Cost Sharing
(Jain and Mahdian). Cambridge University Press, 2007.
9 06/04/2013 - An Analytic Solution to Discrete Bayesian Reinforcement Learning
(Pascal Poupart, Nikos Vlassis, Jesse Hoey and Kevin Regan). In ICML, 2006.
10 06/11/2013 - Anytime Point-Based Approximations for Large POMDPs
(Joelle Pineau, Geoffrey Gordon and Sebastian Thrun). JAIR, 2006.
11 06/18/2013 - TBD
12 06/25/2013 - TBD


2012 Spring Schedule

No. Date Speaker Paper
1 01/18/2012 - A survey of recent developments in multiobjective optimization
(Altannar Chinchuluun and Panos M. Pardalos). ANNALS OF OPERATIONS RESEARCH, 2007


2011 Fall Schedule

No. Date Speaker Paper
1 08/18/2011 - 1. Markov Decision Processes with Multiple Objectives
(Krishnendu Chatterjee, Rupak Majumdar, and Thomas A. Henzinger). In STACS, 2006
2. On finding compromise solutions in multiobjective Markov decision processes
(Patrice Perny, Paul Weng). In European Conference on Artificial Intelligence Multidisciplinary Workshop on Advances in Preference Handling, 2010
2 08/24/2011 No reading group
3 08/31/2011 - Survey of multi-objective optimization methods for engineering
(R.T. Marler and J.S. Arora). Structural and Multidisciplinary Optimization, 2004
4 09/07/2011 - Theoretical Considerations of Potential-Based Reward Shaping for Multi-Agent Systems
(Sam Devlin, and Daniel Kudenko). In AAMAS, 2011
5 09/14/2011 No reading group
6 10/26/2011 - Strategy Learning for Autonomous Agents in Smart Grid Markets
(Prashant P. Reddy, and Manuela M. Veloso). In IJCAI, 2011
7 11/02/2011 - Regret-based Reward Elicitation for Markov Decision Processes
(Kevin Regan and Craig Boutilie). In UAI, 2009

2011 Spring Schedule

No. Date Speaker Paper
1 03/01/2011 - Functional Value Iteration for Decision-Theoretic Planning with General Utility Functions
(Y. Liu and S. Koenig). In AAAI, 2006
2 03/08/2011 - 1. If multi-agent learning is the answer, what is the question?
(Yoav Shoham, Rob Powers, and Trond Grenager). AIJ, 2007
2. Multiagent learning is not the answer. It is the question.
(Peter Stone). AIJ, 2007
3 03/15/2011 No reading group (Spring Break)
4 03/22/2011 - 1. Symmetric Primal-Dual Approximate Linear Programming for Factored MDPs
(Dmitri Dolgov and Edmund Durfee). International Symposiums on Artificial Intelligence and Mathematics (ISAIM), 2006
2. Symmetric Approximate Linear Programming for Factored MDPs with Application to Constrained Problems
(Dmitri Dolgov and Edmund Durfee). Annals of Mathematics and Artificial Intelligence (AMAI), 2006
5 03/29/2011 No reading group
6 04/05/2011 - Formal Models and Algorithms for Decentralized Decision Making under Uncertainty
(S. Seuken and S. Zilberstein). JAAMAS, 2008
7 04/12/2011 - 1. Point-based value iteration: An anytime algorithm for POMDPs
(Joelle Pineau, Geoff Gordon and Sebastian Thrun). In IJCAI, 2003
2. Heuristic Search Value Iteration for POMDPs
(Trey Smith and Reid G. Simmons). In UAI, 2004
8 04/19/2011 - 1. Where Do Rewards Come From?
(Satinder Singh, Richard L. Lewis and Andrew G. Barto). In CogSci, 2009
2. Variance-Based Rewards for Approximate Bayesian Reinforcement Learning
(Jonathan Sorg, Satinder Singh, and Richard Lewis). In UAI, 2010
9 04/26/2011 No reading group (AAMAS'11)
10 05/03/2011 No reading group (AAMAS'11)
11 06/14/2011 - Towards a Unifying Characterization for Quantifying Weak Coupling in Dec-POMDPs
(Stefan J. Witwicki and Edmund H. Durfee). In AAMAS, 2011
12 06/29/2011 - 1. Computationally-Efficient Combinatorial Auctions for Resource Allocation in Weakly-Coupled MDPs
(Dmitri A. Dolgov, and Edmund H. Durfee). In AAMAS, 2005
2. Mechanism Design for Multi-Agent Meeting Scheduling
(Elisabeth Crawford and Manuela Veloso). Web Intelligence and Agent Systems, 2006



1. Multi-objective Optimization




3. Multiagent Learning


4. (Sequential) Mechanism Design


5. Applications




2013 The Teamcore Research Group, University of Southern California ♦ Contact Jun-young Kwak