학술논문

Game-Theoretic Lane-Changing Decision Making and Payoff Learning for Autonomous Vehicles
Document Type
Periodical
Source
IEEE Transactions on Vehicular Technology IEEE Trans. Veh. Technol. Vehicular Technology, IEEE Transactions on. 71(4):3609-3620 Apr, 2022
Subject
Transportation
Aerospace
Games
Autonomous vehicles
Roads
Neural networks
Q-learning
Vehicle dynamics
Space vehicles
Autonomous driving
game theory
Nash equili- brium
neural networks
Language
ISSN
0018-9545
1939-9359
Abstract
In this paper, the problem of decision making for autonomous vehicles changing lanes is addressed by formulating multiple games in normal form for pairs of agents. This formulation generates the optimal action for the Ego vehicle at a given state and does not consider global optimality for all agents. The payoff matrices of the games are designed based on a user-defined set of rules. The constant parameters of these payoffs are then adjusted using neural learning to generate optimal behavior among the vehicles. An algorithm integrating deep reinforcement learning and game theory, regarded as Nash Q-learning, is included in the decision-making scheme. The applicability of the proposed method in a lane-changing scenario is tested via simulation.