학술논문

Bin-Picking of Novel Objects Through Category-Agnostic-Segmentation: RGB Matters
Document Type
Conference
Source
2023 Seventh IEEE International Conference on Robotic Computing (IRC) IRC Robotic Computing (IRC), 2023 Seventh IEEE International Conference on. :231-238 Dec, 2023
Subject
Computing and Processing
Instance segmentation
Training
Focusing
Grasping
Benchmark testing
Sensors
Reliability
Bin-Picking
Deep-Learning
Manipulation
Class-agnostic instance segmentation
Language
Abstract
This paper addresses category-agnostic instance segmentation for robotic manipulation, focusing on segmenting objects independent of their class to enable versatile applications like bin-picking in dynamic environments. Existing methods often lack generalizability and object-specific information, leading to grasp failures. We present a novel approach leveraging objectcentric instance segmentation and simulation-based training for effective transfer to real-world scenarios. Notably, our strategy overcomes challenges posed by noisy depth sensors, enhancing the reliability of learning. Our solution accommodates transparent and semi-transparent objects which are historically difficult for depth-based grasping methods. Contributions include domain randomization for successful transfer, our collected dataset for warehouse applications, and an integrated framework for efficient bin-picking. Our trained instance segmentation model achieves state-of-the-art performance over WISDOM public benchmark [1] and also over the custom-created dataset. In a real-world challenging bin-picking setup our bin-picking framework method achieves 98% accuracy for opaque objects and 97% accuracy for non-opaque objects, outperforming the state-of-theart baselines with a greater margin.