Search papers, labs, and topics across Lattice.
Vinedresser3D is introduced as an agentic framework for text-guided 3D editing, addressing limitations in complex prompt understanding, edit localization, and content preservation of existing methods. It leverages a multimodal LLM to decompose prompts into structural and appearance-level guidance, coupled with an image editing model for visual guidance from informative views. The framework then employs an inversion-based rectified-flow inpainting pipeline with interleaved sampling in the 3D latent space, achieving state-of-the-art results on diverse 3D editing tasks.
Achieve precise, coherent, and mask-free 3D editing from text prompts by having a multimodal LLM decompose the prompt into structural and appearance-level guidance for a rectified-flow inpainting pipeline.
Text-guided 3D editing aims to modify existing 3D assets using natural-language instructions. Current methods struggle to jointly understand complex prompts, automatically localize edits in 3D, and preserve unedited content. We introduce Vinedresser3D, an agentic framework for high-quality text-guided 3D editing that operates directly in the latent space of a native 3D generative model. Given a 3D asset and an editing prompt, Vinedresser3D uses a multimodal large language model to infer rich descriptions of the original asset, identify the edit region and edit type (addition, modification, deletion), and generate decomposed structural and appearance-level text guidance. The agent then selects an informative view and applies an image editing model to obtain visual guidance. Finally, an inversion-based rectified-flow inpainting pipeline with an interleaved sampling module performs editing in the 3D latent space, enforcing prompt alignment while maintaining 3D coherence and unedited regions. Experiments on diverse 3D edits demonstrate that Vinedresser3D outperforms prior baselines in both automatic metrics and human preference studies, while enabling precise, coherent, and mask-free 3D editing.
