학술논문

Predictive Control of Voltage Source Inverter: An Online Reinforcement Learning Solution
Document Type
Periodical
Source
IEEE Transactions on Industrial Electronics IEEE Trans. Ind. Electron. Industrial Electronics, IEEE Transactions on. 71(7):6591-6600 Jul, 2024
Subject
Power, Energy and Industry Applications
Signal Processing and Analysis
Communication, Networking and Broadcast Technologies
Nonlinear dynamical systems
Uncertainty
Predictive models
Artificial neural networks
Predictive control
Robustness
Lyapunov methods
Finite control-set model predictive control (FCS-MPC)
neural network (NN)
power converters
reinforcement learning (RL)
Language
ISSN
0278-0046
1557-9948
Abstract
The focus of this article is to introduce the concept of an online reinforcement learning (RL) solution and to propose a novel finite control-set model predictive control framework subject to system uncertainties, which possesses the excellent applicative potential for power converter systems with unknown perturbations. In this framework, the control task is performed by incorporating an adaptive neural network approximation-based RL and neural predictor-based predictive current control solution. To be more precise, a critic neural network is responsible for learning a strategic utility function online, and an actor network is developed to derive control behaviors by approximating the unknown model dynamics and optimizing the learned utility function obtained from the critic network. Compared to previous works, it not only attenuates the inherent issues of system uncertainties and unknown disturbances, but also provides a flexible framework and allows the enhancement of control property. Furthermore, by deploying the Lyapunov approach, it shows that all signals in the closed-loop system are uniformly ultimately bounded. Finally, numerical simulation and experiments validate our theoretical findings.