Search papers, labs, and topics across Lattice.
SegviGen repurposes pre-trained 3D generative models for 3D part segmentation by predicting part-indicative colors on active voxels of a geometry-aligned reconstruction. This approach leverages structured priors encoded in the generative model to induce segmentation without extensive 3D training data or distillation from 2D priors. Experiments demonstrate a 40% improvement on interactive part segmentation and 15% on full segmentation compared to prior state-of-the-art methods, while using only 0.32% of the labeled training data.
Unlock high-quality 3D part segmentation with minimal labeled data by repurposing existing 3D generative models.
We introduce SegviGen, a framework that repurposes native 3D generative models for 3D part segmentation. Existing pipelines either lift strong 2D priors into 3D via distillation or multi-view mask aggregation, often suffering from cross-view inconsistency and blurred boundaries, or explore native 3D discriminative segmentation, which typically requires large-scale annotated 3D data and substantial training resources. In contrast, SegviGen leverages the structured priors encoded in pretrained 3D generative model to induce segmentation through distinctive part colorization, establishing a novel and efficient framework for part segmentation. Specifically, SegviGen encodes a 3D asset and predicts part-indicative colors on active voxels of a geometry-aligned reconstruction. It supports interactive part segmentation, full segmentation, and full segmentation with 2D guidance in a unified framework. Extensive experiments show that SegviGen improves over the prior state of the art by 40% on interactive part segmentation and by 15% on full segmentation, while using only 0.32% of the labeled training data. It demonstrates that pretrained 3D generative priors transfer effectively to 3D part segmentation, enabling strong performance with limited supervision. See our project page at https://fenghora.github.io/SegviGen-Page/.
