학술논문

Adaptive PID Trajectory Tracking Algorithm Using Q-Learning for Mobile Robots
Document Type
Conference
Source
2022 12th International Conference on CYBER Technology in Automation, Control, and Intelligent Systems (CYBER) Automation, Control, and Intelligent Systems (CYBER), 2022 12th International Conference on CYBER Technology in. :1112-1117 Jul, 2022
Subject
Computing and Processing
Robotics and Control Systems
Signal Processing and Analysis
Learning systems
Adaptation models
Q-learning
Automation
Trajectory tracking
Control systems
Real-time systems
mobile robot
trajectory tracking
incremental learning
Language
ISSN
2642-6633
Abstract
Classical PID controllers usually rely on some prior knowledge to manually adjust the gains of the controller and determine them. However, when the mobile robot works in a complex and changeable environment, the fixed PID gains may be difficult to meet the needs of the robot trajectory tracking accuracy. Therefore, this paper proposes a Q-learning-based adaptive PID trajectory tracking algorithm. Firstly, we construct a trajectory tracking Q-PID controller based on the error model of mobile robot. Then, the Q-learning algorithm is used to adaptively adjust the gains of the PID controller online. Meanwhile, the incremental active learning exploration method is used to improve learning efficiency and adaptability of agent. Finally, we use simulation experiments to verify the high performance of our algorithm.