Search papers, labs, and topics across Lattice.
This paper introduces an edge-aware instance segmentation framework designed for real-time robotic collision avoidance with transparent laboratory glassware, addressing the challenges posed by refraction and lack of stable interior texture. By augmenting a one-stage segmentation backbone with an edge-detection branch and edge-guided attention, the authors construct the LabGlass-IS dataset and achieve a Boundary F-score of 97.80, significantly surpassing existing methods. The system demonstrates practical effectiveness with a 93.3% success rate in collision avoidance during real-robot trials, showcasing its potential for safe robotic interactions in delicate environments.
Achieving a 93.3% collision avoidance success rate, this framework redefines how robots can safely navigate among fragile transparent objects in real-time.
This paper presents an edge-aware instance segmentation framework that enables real-time robotic collision avoidance with transparent laboratory glassware using purely visual perception. Transparent vessels defy conventional segmentation due to refraction, specular reflection, and the absence of stable interior texture, yet their boundary contours remain comparatively reliable visual cues. Exploiting this observation, we augment a one-stage real-time instance segmentation backbone with a lightweight edge-detection branch, edge-guided attention fusion, and a parameter-free SimAM module, and further construct LabGlass-IS, a 3485-image, 21-category instance segmentation dataset of real laboratory glassware. The enhanced model achieves the highest Boundary F-score of 97.80 among compared methods, outperforming the YOLO-prompted FastSAM framework by 18.93 BF points. Furthermore, it maintains an inference speed of 7.1ms per frame and requires only 2.85% of the parameters of the closest accuracy competitor. Multi-view triangulation of mask centroids further provides 3D positions for conservative bounding-volume collision constraints. Real-robot trials achieve a 93.3% collision avoidance success rate, indicating the feasibility of the proposed perception-to-action pipeline for robot collision avoidance among fragile transparent objects. Our code is available at https://github.com/havishamy/TransYOLO_3D. Our video is available at https://havishamy.github.io/paper-videos/.
