학술논문

Robot visual perception and autonomous obstacle avoidance based on deep learning
Document Type
Conference
Source
2024 4th International Conference on Neural Networks, Information and Communication (NNICE) Neural Networks, Information and Communication (NNICE), 2024 4th International Conference on. :1681-1685 Jan, 2024
Subject
Communication, Networking and Broadcast Technologies
Components, Circuits, Devices and Systems
Computing and Processing
Robotics and Control Systems
Signal Processing and Analysis
Visualization
Simultaneous localization and mapping
Image color analysis
Navigation
Robot vision systems
Object detection
Mobile robots
Visual perception
RGB-D SLAM
Autonomous obstacle avoidance
Language
Abstract
Dynamic obstacle avoidance is crucial for a robot to achieve autonomous and safe navigation, especially in complex and ever-changing indoor environments. The robot needs to detect obstacles in a timely manner and dynamically plan a safe path. To accomplish this, an environment perception system is established using an RGB-D depth camera and an IMU unit, providing the robot with multimodal information such as 3D vision and orientation angles. Firstly, an improved target detection model based on YOLOv7-tiny is constructed. This model utilizes the YOLOv7-tiny algorithm to recognize obstacles in color images. The color and depth images are aligned to obtain obstacle size information and spatial distance between the robot and obstacles. The synchronized color and depth information are then inputted into the RTAB-D SLAM algorithm to construct a map. After mapping, the DWA local path planning algorithm is used to plan a path, and obstacle avoidance decisions are sent to the chassis control module to achieve autonomous obstacle avoidance. This enables the robot to navigate autonomously in real-world scenarios. Experimental analysis shows that the improved YOLOv7-tiny target detection algorithm achieves slightly higher accuracy compared to the original algorithm, with a 25% increase in FPS during detection. The proposed method successfully enables the robot to achieve autonomous obstacle avoidance. This research provides a basis and reference for robots to rely solely on visual and inertial sensors for obstacle recognition and autonomous navigation.