Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces DA-Fusion, a deformable attention-based RGB-D fusion Transformer that enhances unseen object instance segmentation in cluttered environments, addressing the limitations of traditional RGB and depth-based methods. By effectively combining RGB and depth data, DA-Fusion improves segmentation accuracy in complex scenarios such as bin-picking and shelf-picking, where occlusions and varying object shapes pose significant challenges. The authors also present the Object Clutter Bin Dataset (OCBD) to benchmark performance, with extensive evaluations showing that DA-Fusion surpasses existing state-of-the-art techniques in diverse environments.
DA-Fusion achieves superior segmentation accuracy in cluttered environments by seamlessly integrating RGB and depth data, outperforming traditional methods that struggle with unseen objects.
In logistics automation, precise segmentation of unseen objects is crucial for efficient robotic manipulation in cluttered environments. Tasks such as bin-picking and shelf-picking require robust perception to handle occlusions, varying object shapes, and complex spatial arrangements. Traditional RGB-based methods tend to over-segment objects due to their reliance on texture, while depth-based methods often under-segment by focusing primarily on geometric features. To address these limitations, we propose DA-Fusion, a deformable attention-based RGB-D fusion Transformer designed for unseen object instance segmentation. DA-Fusion effectively combines the strengths of both RGB and depth data, enhancing segmentation accuracy in cluttered and multi-layered object environments. We also introduce the Object Clutter Bin Dataset (OCBD), a benchmark dataset specifically tailored for evaluating bin-picking scenarios in top-down views. Extensive evaluations demonstrate that DA-Fusion outperforms state-of-the-art methods across diverse environments, making it particularly suited for real-world logistics tasks.