Search papers, labs, and topics across Lattice.
The Voxel-Grounded Online Instance Manager (VOIM) introduces a training-free method for creating open-vocabulary 3D instance maps from RGB-D and monocular RGB inputs, addressing a gap in existing systems. By deferring label and instance decisions until sufficient evidence is gathered, VOIM outperforms the leading online RGB-D system, OVO-SLAM, achieving a mean Intersection over Union (mIoU) improvement of 4.8 to 11.7 across various configurations. This approach highlights the importance of the mapping stage over the specific perception models used, achieving a peak mIoU of 44.07 on ScanNet++ while maintaining performance with monocular inputs.
VOIM achieves a remarkable 44.07 mIoU in 3D instance mapping without any training, outperforming traditional systems by deferring labeling decisions until sufficient evidence is gathered.
We present Voxel-Grounded Online Instance Manager (VOIM), a training-free voxel-grounded instance manager that builds open-vocabulary 3D instance maps from RGB-D or from monocular RGB alone, a regime no prior training-free system addresses. Online systems typically segment object instances and label them at first detection, committing when evidence is weakest. VOIM instead defers label and instance decisions until soft evidence from unmodified, off-the-shelf perception has accumulated per voxel across views. We show that the mapping stage, rather than the particular perception models, carries the result: across four perception configurations on ScanNet++, varying the region descriptor, the detector label prior and the mask source, the map exceeds the strongest online RGB-D system, OVO-SLAM, by between 4.8 and 11.7 mIoU. Perception is not neutral, and substituting that baseline's own descriptor family costs 4.1 of the margin, yet the baseline carries the marginally better 2D descriptor (33.7 vs. 31.5 mIoU over three scenes) and still realizes the weaker map. Under a like-for-like protocol VOIM reaches 44.07 mIoU on ScanNet++ against 32.37, winning all ten scenes and both aggregations (pooled 33.31 vs. 25.97), and the same system runs unchanged to fully monocular RGB, matching that baseline pooled on Replica (27.80 vs. 27.50). The advantage is regime-specific: under Replica's all-classes scoring, matched inputs give a split result, 28.60 vs. 27.50 pooled against 24.59 vs. 30.11 on the per-scene mean. Room scale is label-limited and building scale drift-limited. Labeling does not run in real time, dominated by per-class detection over the full vocabulary. The maps export occupancy grids and resolve free-form queries to object instances.
