학술논문

Coding-Aware Routing for Maximum Throughput and Coding Opportunities by Deep Reinforcement Learning in FANET
Document Type
Conference
Source
2022 IEEE 24th Int Conf on High Performance Computing & Communications; 8th Int Conf on Data Science & Systems; 20th Int Conf on Smart City; 8th Int Conf on Dependability in Sensor, Cloud & Big Data Systems & Application (HPCC/DSS/SmartCity/DependSys) HPCC-DSS-SMARTCITY-DEPENDSYS High Performance Computing & Communications; 8th Int Conf on Data Science & Systems; 20th Int Conf on Smart City; 8th Int Conf on Dependability in Sensor, Cloud & Big Data Systems & Application (HPCC/DSS/SmartCity/DependSys), 2022 IEEE 24th. :530-537 Dec, 2022
Subject
Communication, Networking and Broadcast Technologies
Components, Circuits, Devices and Systems
Computing and Processing
Deep learning
Network topology
Smart cities
Reinforcement learning
Routing
Throughput
Autonomous aerial vehicles
FANET
Network coding
Coding-aware routing
Deep reinforcement learning
Deep deterministic policy gradient
Language
Abstract
Coding-Aware routing algorithm improves the performance of Network Coding (NC) by selecting the paths with more coding opportunities, thus increasing the throughput of network transmission. However, the Unmanned Aerial Vehicle (UAV) flight in Flying Ad-hoc Network (FANET) causes network topology changes and calculating coding opportunities is NP-hard complex problem, so the performance of traditional coding-aware routing is limited. We try to solve this problem using reinforcement learning and propose a deep reinforcement learning-based coding-aware routing (RLCAR) that maximizes throughput and coding opportunities. In RLCAR, we define new concepts of coding benefits, throughput and energy distribution, and we put these parameters into the routing metric (Reward function). We evaluate the performance of RLCAR and compare the throughput, packet delivery ratio (PDR), coding/decoding rate with other coding-aware routings. The results show that RLCAR acquires more coding opportunities and improves the throughput of FANET. And, RLCAR can cope with the dynamic changes of UAV topology.