Search papers, labs, and topics across Lattice.
This paper introduces Pickalo, a low-cost bin-picking system that leverages a wrist-mounted RGB-D camera and a pipeline combining depth refinement, Mask-RCNN segmentation, and SAM-6D pose estimation. A pose buffer fuses multi-view observations to improve pose accuracy and handle object symmetries. The system achieves up to 600 mean picks per hour with 96-99% grasp success on densely filled euroboxes, demonstrating robust performance in realistic industrial conditions.
Industrial bin picking can achieve near-human speeds and 99% grasp success using only commodity hardware and synthetic training data.
Bin picking in real industrial environments remains challenging due to severe clutter, occlusions, and the high cost of traditional 3D sensing setups. We present Pickalo, a modular 6D pose-based bin-picking pipeline built entirely on low-cost hardware. A wrist-mounted RGB-D camera actively explores the scene from multiple viewpoints, while raw stereo streams are processed with BridgeDepth to obtain refined depth maps suitable for accurate collision reasoning. Object instances are segmented with a Mask-RCNN model trained purely on photorealistic synthetic data and localized using the zero-shot SAM-6D pose estimator. A pose buffer module fuses multi-view observations over time, handling object symmetries and significantly reducing pose noise. Offline, we generate and curate large sets of antipodal grasp candidates per object; online, a utility-based ranking and fast collision checking are queried for the grasp planning. Deployed on a UR5e with a parallel-jaw gripper and an Intel RealSense D435i, Pickalo achieves up to 600 mean picks per hour with 96-99% grasp success and robust performance over 30-minute runs on densely filled euroboxes. Ablation studies demonstrate the benefits of enhanced depth estimation and of the pose buffer for long-term stability and throughput in realistic industrial conditions. Videos are available at https://mesh-iit.github.io/project-jl2-camozzi/
