Search papers, labs, and topics across Lattice.
This paper introduces SCULPT, a novel framework for part-aware 3D generation that utilizes subtractive composition to create coherent digital assets while allowing for structural part editing. Unlike traditional methods that either segment pre-existing shapes or synthesize parts from fixed layouts, SCULPT generates parts and the remaining object simultaneously through a joint split predictor that conditions on both image input and the current 3D state. Extensive experiments reveal that SCULPT achieves state-of-the-art geometry on the PartObjaverse dataset while maintaining high-quality complete-object reconstruction, demonstrating fine-grained textured part decomposition capabilities.
SCULPT enables simultaneous part extraction and object reconstruction, overcoming the limitations of traditional segmentation and additive methods in 3D generation.
Part-aware 3D generation aims to create digital assets that are coherent as complete objects while exposing structural parts for editing, material assignment, animation, and reuse. Existing methods impose this structure outside the native generation loop: segmentation-based methods partition an already generated shape, while additive methods synthesize parts from predefined layouts, boxes, or tokens and then reconcile them into a whole. The former preserves the generated geometry but fixes the object before part boundaries are determined; the latter exposes part cardinality but often leaves shared boundaries vulnerable to gaps, interpenetrations, and material discontinuities. In this paper, we propose SCULPT, a framework that addresses these challenges through subtractive composition. Given a complete object represented in a structured 3D latent space, SCULPT iteratively applies a joint split predictor to generate one extracted part together with the remaining object. The predictor performs a coupled denoising process conditioned on both the image and the current 3D state, so the extracted part and updated remainder are generated together rather than reconciled after generation. The joint split predictor processes both outputs on the union of their native sparse 3D supports, allowing neighboring supports to overlap rather than imposing a disjoint voxel partition. The rollout ends when the remainder support becomes empty or reaches a fixed safety cap, allowing the number of generated parts to adapt to each object within that bound. Extensive experiments demonstrate state-of-the-art geometry on PartObjaverse while preserving strong complete-object reconstruction after part assembly. Results on four dataset images, one text-to-image-generated input, and one real-world photograph further show fine-grained textured part decomposition beyond the benchmark.
