Search papers, labs, and topics across Lattice.
This paper addresses the challenge of open-vocabulary 3D scene perception in industrial environments, where existing methods relying on segmentation models pre-trained on non-industrial datasets perform poorly. They propose a training-free pipeline that generates masks by merging pre-computed superpoints based on semantic features, avoiding the need for pre-trained instance proposal models. The method is evaluated using the domain-adapted VLFM "IndustrialCLIP" on a 3D industrial workshop scene, demonstrating successful segmentation of industrial objects.
Pre-trained open-vocabulary segmentation models stumble in industrial settings, but a training-free superpoint merging pipeline with a domain-adapted VLFM can effectively segment industrial objects.
Autonomous vision applications in production, intralogistics, or manufacturing environments require perception capabilities beyond a small, fixed set of classes. Recent open-vocabulary methods, leveraging 2D Vision-Language Foundation Models (VLFMs), target this task but often rely on class-agnostic segmentation models pre-trained on non-industrial datasets (e.g., household scenes). In this work, we first demonstrate that such models fail to generalize, performing poorly on common industrial objects. Therefore, we propose a training-free, open-vocabulary 3D perception pipeline that overcomes this limitation. Instead of using a pre-trained model to generate instance proposals, our method simply generates masks by merging pre-computed superpoints based on their semantic features. Following, we evaluate the domain-adapted VLFM "IndustrialCLIP" on a representative 3D industrial workshop scene for open-vocabulary querying. Our qualitative results demonstrate successful segmentation of industrial objects.
