학술논문

Real-Time Traffic Based Air-Ground Cooperation for Vehicular Data Collection Using DRL Approach
Document Type
Conference
Source
GLOBECOM 2023 - 2023 IEEE Global Communications Conference Global Communications Conference, GLOBECOM 2023 - 2023 IEEE. :6910-6915 Dec, 2023
Subject
Communication, Networking and Broadcast Technologies
Components, Circuits, Devices and Systems
Engineering Profession
General Topics for Engineers
Power, Energy and Industry Applications
Signal Processing and Analysis
Simulation
Data collection
Benchmark testing
Real-time systems
Trajectory
Resource management
Data communication
air-ground cooperation
vehicular data collection
TD3
trajectory design
access decision
resource allocation
Language
ISSN
2576-6813
Abstract
As more and more applications in smart transportation emerge, the timely and efficient collection of data in the Internet of Vehicles (IoV) has become an important issue. Dy-namically changing traffic streams make it difficult for roadside units (RSUs) to collect vehicle data. Unmanned aerial vehicles (UAVs) with high mobility can be easily deployed anywhere to compensate for the limited communication coverage of ground-based infrastructure. Based on the above considerations, we propose an air-ground cooperation framework for vehicular data collection in real-time traffic scenarios. Specifically, we maximize the data transmission success rate (DTSR) within a given time duration by simultaneously optimizing the UAV's flight trajectory, access decision, and resource allocation. This problem is non-convex and time-continuous, and cannot be solved by conventional optimization methods. Therefore, we develop a deep reinforcement learning (DRL) approach based on the twin delayed deep deterministic policy gradient (TD3) algorithm. A real road-based traffic scenario is constructed by Simulation of Urban Mobility (SUMO) in our work. Simulation results show that the proposed method outperforms the benchmarks in terms of DTSR.