학술논문

A Routing Optimization Policy Using Graph Convolution Deep Reinforcement Learning
Document Type
Conference
Source
2023 IEEE/CIC International Conference on Communications in China (ICCC) Communications in China (ICCC), 2023 IEEE/CIC International Conference on. :1-6 Aug, 2023
Subject
Aerospace
Communication, Networking and Broadcast Technologies
Components, Circuits, Devices and Systems
Computing and Processing
Fields, Waves and Electromagnetics
Power, Energy and Industry Applications
Signal Processing and Analysis
Transportation
Network topology
Heuristic algorithms
Software algorithms
Optimization methods
Quality of service
Reinforcement learning
Routing
QoS requirements
routing optimization
graph convolution network (GCN)
deep deterministic policy gradient (DDPG)
Language
Abstract
The diversification of network traffic has brought about more serious quality of service (QoS) issues. Existing QoS optimization methods based on reinforcement learning and neural networks are unable to characterize the structural features of network topology, resulting in suboptimal optimization performance. In this paper, a routing optimization method combining Graph Convolutional Neural Network (GCN) and Deep Deterministic Policy Gradient (DDPG) is proposed to address QoS issues in Software Defined Network (SDN). The GCN module analyzes dynamic network status and extracts network topology structure information, which is used by the DDPG module to make routing decisions. The proposed strategy outperforms OSPF algorithm, DRL-TE strategy, and DDPG routing algorithm in terms of optimizing average end-to-end delay and packet loss rate.