학술논문

Policy Space Response Oracles: A Survey
Document Type
Working Paper
Source
The 33rd International Joint Conference on Artificial Intelligence, 2024
Subject
Computer Science - Computer Science and Game Theory
Computer Science - Artificial Intelligence
Computer Science - Multiagent Systems
Language
Abstract
Game theory provides a mathematical way to study the interaction between multiple decision makers. However, classical game-theoretic analysis is limited in scalability due to the large number of strategies, precluding direct application to more complex scenarios. This survey provides a comprehensive overview of a framework for large games, known as Policy Space Response Oracles (PSRO), which holds promise to improve scalability by focusing attention on sufficient subsets of strategies. We first motivate PSRO and provide historical context. We then focus on the strategy exploration problem for PSRO: the challenge of assembling effective subsets of strategies that still represent the original game well with minimum computational cost. We survey current research directions for enhancing the efficiency of PSRO, and explore the applications of PSRO across various domains. We conclude by discussing open questions and future research.
Comment: Ariyan Bighashdel and Yongzhao Wang contributed equally