학술논문

MADDPG-Based Joint Service Placement and Task Offloading in MEC Empowered Air–Ground Integrated Networks
Document Type
Periodical
Source
IEEE Internet of Things Journal IEEE Internet Things J. Internet of Things Journal, IEEE. 11(6):10600-10615 Mar, 2024
Subject
Computing and Processing
Communication, Networking and Broadcast Technologies
Task analysis
Autonomous aerial vehicles
Optimization
Resource management
Internet of Things
Servers
Decision making
Air–ground integrated networks (AGINs)
computation offloading
deep reinforcement learning (DRL)
resource allocation
service deployment
Language
ISSN
2327-4662
2372-2541
Abstract
Multiaccess edge computing (MEC) empowered air–ground integrated networks (AGINs) hold great promise in delivering accessible computing services for users and Internet of Things (IoT) applications, such as forest fire monitoring, emergency rescue operations, etc. In this article, we present a comprehensive air–ground integrated MEC framework, where edge servers carried by unmanned aerial vehicles (UAVs) will provide efficient computation services to IoT devices and user equipment (UE) (which are collectively referred to as UEs). We aim to minimize the long-term average weighted sum of task completion delay and economic expenditure for all the UEs. This objective is achieved through various strategies, including preinstalling new service instances into UAVs, removing idle service instances from UAVs, task offloading decision making, access control, selecting appropriate service instances for each offloaded service request, and resource allocation optimization. Considering the complexity of the problem and the dynamics of the system, we reformulate the problem as a Markov decision process (MDP) and present a multiagent deep deterministic policy gradient (MADDPG)-based algorithm to enable low-complexity and real-time adaptive decision-making. Since our problem contains integer, binary and continuous variables, it is not straightforward to apply the MADDPG algorithm. Specifically, we first normalize the continuous variables, and then convert the continuous output generated by MADDPG into discrete variables, while ensuring the coupling constraints between different variables are preserved. The simulation results demonstrate the fast convergence of our proposed algorithm and its superior performance in minimizing costs compared with the baseline algorithms.