학술논문

DRL-Based Dynamic Resource Allocation for Multi-Beam Satellite Systems
Document Type
Conference
Source
2023 IEEE 34th Annual International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC) Personal, Indoor and Mobile Radio Communications (PIMRC), 2023 IEEE 34th Annual International Symposium on. :1-6 Sep, 2023
Subject
Communication, Networking and Broadcast Technologies
Computing and Processing
Robotics and Control Systems
Signal Processing and Analysis
Heuristic algorithms
Simulation
Satellite broadcasting
Nonlinear distortion
Markov processes
Dynamic scheduling
Nonlinear dynamical systems
Language
ISSN
2166-9589
Abstract
Multi-beam satellite communication systems have received considerable attentions in recent years. By generating multiple beams at the transmitting satellites, the coverage areas can be enlarged and the transmission capacity can be improved. In this paper, we study dynamic radio resource allocation problem for multi-beam satellite systems. Considering the dynamic arriving of data packets and signal distortion due to nonlinear amplifying, we formulate the joint beam scheduling, subchannel and power allocation problem of the satellite system as a long-term average utility function maximization problem. To solve the formulated problem, we first propose a cell grouping and beam scheduling scheme. Then, we model the dynamic resource allocation problem of individual cells as a Markov decision process and propose a double deep Q-network (DDQN)-based subchannel and power allocation algorithm. Simulation results demonstrate the effectiveness and superiority of the proposed algorithm.