학술논문

Compact Multi-Object Placement Using Adjacency-Aware Reinforcement Learning
Document Type
Conference
Source
2024 IEEE-RAS 23rd International Conference on Humanoid Robots (Humanoids) Humanoid Robots (Humanoids), 2024 IEEE-RAS 23rd International Conference on. :698-705 Nov, 2024
Subject
Robotics and Control Systems
Learning systems
Layout
Fingers
Humanoid robots
Reinforcement learning
Robot sensing systems
End effectors
Grippers
Collision avoidance
Assembly
Language
ISSN
2164-0580
Abstract
Close and precise placement of irregularly shaped objects requires a skilled robotic system. The manipulation of objects that have sensitive top surfaces and a fixed set of neighbors is particularly challenging. To avoid damaging the surface, the robot has to grasp them from the side, and during placement, it has to maintain the spatial relations with adjacent objects, while considering the physical gripper extent. In this work, we propose a framework to learn an agent based on reinforcement learning that generates end-effector motions for placing objects as closely as possible to one another. During the placement, our agent considers the spatial constraints with neighbors defined in a given layout of the objects while avoiding collisions. Our approach learns to place compact object assemblies without the need for predefined spacing between objects, as required by traditional methods. We thoroughly evaluated our approach using a two-finger gripper mounted on a robotic arm with six degrees of freedom. The results demonstrate that our agent significantly outperforms two baseline approaches in object assembly compactness, thereby reducing the space required to position the objects while adhering to specified spatial constraints.