학술논문

Hierarchical DRL-empowered Network Slicing in Space-Air-Ground Networks
Document Type
Conference
Source
GLOBECOM 2023 - 2023 IEEE Global Communications Conference Global Communications Conference, GLOBECOM 2023 - 2023 IEEE. :4680-4685 Dec, 2023
Subject
Communication, Networking and Broadcast Technologies
Components, Circuits, Devices and Systems
Engineering Profession
General Topics for Engineers
Power, Energy and Industry Applications
Signal Processing and Analysis
Network slicing
Simulation
Stochastic processes
Quality of service
Space-air-ground integrated networks
Resource management
Optimization
SAGIN
6G
DRL
Resource allocation
QoS
Language
ISSN
2576-6813
Abstract
The space-air-ground integrated network (SAGIN) is an emerging architecture that has the potential to provide seamless, high data rates, and reliable transmission with a vastly increased coverage for intelligent edge devices (iEDs). However, the SAGIN infrastructure is quite complex consisting of multiple network segments; it is thus critical to efficiently manage the network segments' resources to ensure QoS satisfaction (e.g., delay and rate) for the various services provided to the iEDs. In this regard, network slicing (NS) and overall network softwarization technologies can play an essential role in addressing iEDs QoS and utility needs. In this work, we propose an optimal intelligent end-to-end resource allocation with network slicing in multi-tier SAGIN to maximize the network performance. We model the network depending on its service requirements. As the above optimization problem turns out to be NP-hard, we transform it into a stochastic game model and efficiently solve it through hierarchical multi-agent deep reinforcement learning (HMADRL). In particular, we decompose it into two parts, i.e., optimizing the mapping combined with slice adjustment and the resource allocation with association problem. Both problems are then solved using multi-agent DRL. The simulation results demonstrate that our proposed HMADRL algorithm outperforms the baseline algorithms in terms of maximizing the utility and QoS satisfaction of iEDs.