학술논문

Efficient and Private Scheduling of Wireless Electric Vehicles Charging Using Reinforcement Learning
Document Type
Periodical
Source
IEEE Transactions on Intelligent Transportation Systems IEEE Trans. Intell. Transport. Syst. Intelligent Transportation Systems, IEEE Transactions on. 24(4):4089-4102 Apr, 2023
Subject
Transportation
Aerospace
Communication, Networking and Broadcast Technologies
Computing and Processing
Robotics and Control Systems
Signal Processing and Analysis
Privacy
Wireless communication
Convergence
Inductive charging
Genetic algorithms
Energy consumption
Vehicle-to-grid
Electric vehicles (EVs)
privacy-cost optimization
reinforcement learning (RL)
vehicle to grid (V2G) network
Language
ISSN
1524-9050
1558-0016
Abstract
Future vehicle-to-grid (V2G) systems require more flexible scheduling to adjust and flatten the peak energy demand. For efficient scheduling and energy trading, the utility provider (UP) needs to keep track of the state of charge (SoC) of vehicle batteries (VBs). However, sharing of SoC of VBs from electric vehicles (EVs) to UP may compromise owner privacy by analyzing the electricity usage in EVs. Therefore, we propose Reinforcement learning (RL)-based demand-side energy management using a rechargeable battery (RB) for enhanced cost-friendly privacy of EVs, efficient scheduling, and accurate billing. With existing Q-Learning-based RL (using $\epsilon $ -greedy exploration and exploitation), we find that the reward maximization of efficient and private scheduling is often sluggish and incurs convergence issues. Therefore, we develop a genetic algorithm (GA)-based exploration and exploitation, which solves the convergence problems. We develop theoretical analysis and implement numerical results to demonstrate that the proposed GA-based RL framework accelerates convergence and enhances cost-friendly privacy considerably.