학술논문

Mastering Strategy Card Game (Hearthstone) with Improved Techniques
Document Type
Conference
Source
2023 IEEE Conference on Games (CoG) Games (CoG), 2023 IEEE Conference on. :1-8 Aug, 2023
Subject
Computing and Processing
Robotics and Control Systems
Codes
Decision making
Buildings
Games
Artificial intelligence
Language
ISSN
2325-4289
Abstract
Strategy card game is a well-known genre that is demanding on the intelligent game-play and can be an ideal test-bench for AI. Previous work combines an end-to-end policy function and an optimistic smooth fictitious play, which shows promising performances on the strategy card game Legend of Code and Magic. In this work, we apply such algorithms to Hearthstone, a famous commercial game that is more complicated in game rules and mechanisms. We further propose several improved techniques and consequently achieve significant progress. For a machine-vs-human test we invite a Hearthstone streamer whose best rank was top 10 of the official league in China region that is estimated to be of millions of players. Our models defeat the human player in all Best-of-5 tournaments of full games (including both deck building and battle), showing a strong capability of decision making.