Search papers, labs, and topics across Lattice.
3D-ReGen is introduced as a 3D geometry regenerator conditioned on an initial 3D shape, enabling tasks like enhancement, reconstruction, and editing. A novel conditioning mechanism based on VecSet is used to update the input geometry with consistent fine-grained details. Trained via self-supervised learning on off-the-shelf 3D datasets, 3D-ReGen achieves state-of-the-art performance in controllable 3D generation.
Controllable 3D generation takes a leap forward with 3D-ReGen, a framework that leverages an initial 3D shape for tasks like enhancement and editing, outperforming existing methods.
We consider the problem of regenerating 3D objects from 2D images and initial 3D shapes. Most 3D generators operate in a one-shot fashion, converting text or images to a 3D object with limited controllability. We introduce instead 3D-ReGen, a 3D regenerator that is conditioned on an initial 3D shape. This conceptually simple formulation allows us to support numerous useful tasks, including 3D enhancement, reconstruction, and editing. 3D-ReGen uses a new conditioning mechanism based on VecSet, which allows the regenerator to update or improve the input geometry with consistent fine-grained details. 3D-ReGen learns a widely applicable regeneration prior from off-the-shelf 3D datasets via self-supervised pretext tasks and augmentations, without additional annotations. We evaluate both the geometric consistency and fine-grained quality of 3D-ReGen, achieving state-of-the-art performance in controllable 3D generation across several tasks.
Meta AI