Search papers, labs, and topics across Lattice.
This paper introduces JointEdit3D, a novel framework for 3D scene editing that operates within a unified RGB-geometry latent space, enabling efficient feed-forward editing. By utilizing a SceneAnchor Branch for structural guidance and employing edit/background-aware losses, the method enhances the quality of edited regions while preserving unedited content. Experimental results demonstrate that JointEdit3D significantly outperforms existing techniques in terms of both edited-region fidelity and 3D structural integrity, while also introducing a new dataset and benchmark for standardized evaluation.
JointEdit3D achieves superior 3D scene editing quality by intelligently coupling appearance and geometry in a single feed-forward process, outperforming traditional methods.
Existing 3D scene editing methods typically rely on per-scene optimization over explicit 3D representations or cascaded edit-and-reconstruct pipelines, resulting in high test-time cost, limited 3D awareness, and structural inconsistencies. To couple appearance synthesis and geometry prediction during editing, we build on a unified RGB-geometry reconstruction-generation latent space and adapt it to feed-forward 3D scene editing. The resulting framework, \textbf{JointEdit3D}, performs asymmetric latent inpainting by observing only a single edited RGB reference latent and generating the remaining RGB views and edited geometry latent under source-scene anchoring. JointEdit3D introduces a dedicated SceneAnchor Branch to inject source-scene structure without forcing direct copying, and adopts edit/background-aware losses to balance edited-region fidelity with unedited-content preservation. To address the lack of paired resources for standardized 3D scene editing evaluation, we introduce SceneEdit3D-15K, a dataset with 15K paired editing samples and renderer-provided 3D annotations, together with SceneEdit3D-Bench, a curated 100-sample benchmark. Experiments show that JointEdit3D improves edited-region quality and 3D structural completeness over prior baselines while maintaining competitive background preservation.
