학술논문

Reinforcement-Learning-Based Composite Optimal Control for Looper Hydraulic Servo Systems in Hot Strip Rolling
Document Type
Periodical
Source
IEEE/ASME Transactions on Mechatronics IEEE/ASME Trans. Mechatron. Mechatronics, IEEE/ASME Transactions on. 28(5):2495-2504 Oct, 2023
Subject
Power, Energy and Industry Applications
Components, Circuits, Devices and Systems
Strips
Servomotors
Valves
Optimal control
Hydraulic systems
Pistons
Production
Composite control
looper hydraulic servo systems (HSSs)
nonlinear disturbance observer (NDO)
reinforcement learning (RL)
Language
ISSN
1083-4435
1941-014X
Abstract
The control scheme of the looper angle plays an essential role in hot rolling, which is directly related to the tension maintenance of the strip. The conventional scheme uses a proportion–integration–differentiation (PID) controller to control the servo valve to drive the hydraulic actuator. For different steel types and production temperature changes, the PID control mainly relies on empirical parameter adjustment, which may bring inaccuracy or inefficiency. The objective of this article is to propose a reinforcement-learning-based looper hydraulic servo optimization control scheme to automatically tune the control gain to optimum. First, the modeling error caused by variable parameters and the influence of external disturbance are considered, and the corresponding control model of the looper system is given. Subsequently, a feedforward controller with a radial basis neural-network-based disturbance observer is used to deal with modeling errors and disturbances. A feedback controller with off-policy reinforcement learning is applied in the meantime. The proposed control scheme can realize uniformly ultimately bounded of the system with Lyapunov theory. Simulation results verify the effectiveness of the proposed method.