Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
DinoComplete distills DINO visual features into voxel-aligned semantic priors to improve 3D shape completion, especially for unseen categories and noisy data. A student network learns to predict dense semantic features from incomplete shapes, capturing global structure and part-aware context. By integrating these features into a completion network with a multi-scale voxel Mamba module, DinoComplete achieves state-of-the-art completion quality with fewer parameters, lower memory usage, and faster inference compared to previous methods.
Semantic priors distilled from DINO unlock robust 3D shape completion from partial scans, outperforming prior art while slashing compute costs.
3D shape completion from partial scans remains challenging for unseen categories and noisy real-world observations, where geometry alone is often insufficient for inferring missing structure. We present DinoComplete, a deterministic and efficient shape completion framework that augments geometric reconstruction with voxel-aligned semantic priors distilled from DINO features. First, we construct multi-view DINO feature volumes aligned with ShapeNet data and train a student network to predict dense semantic features directly from incomplete shapes. These predicted features capture global structure and part-aware semantic context while remaining aligned with the underlying geometry. We then integrate these distilled features into a completion network, where geometric and semantic voxel representations are fused through voxel state-space modeling. To enable efficient long-range reasoning without sacrificing resolution, we introduce a multi-scale voxel Mamba module that refines the fused features by combining full-grid and chunk-wise sequence modeling. Experiments on unseen ShapeNet categories and ScanNet objects show that DinoComplete achieves stronger completion quality than prior deterministic and generative based completion methods while using fewer parameters, requiring lower memory, and achieving faster inference. Our results demonstrate that distilling semantic priors from visual foundation models improves generalization and robustness in 3D shape completion.