Search papers, labs, and topics across Lattice.
This paper introduces GeoEdit, a novel pipeline for geometry-aware object editing in photographs that addresses the limitations of existing diffusion-based editors. By decoupling scene and object representations in 3D and employing a Dual-Branch Denoising approach, GeoEdit maintains object identity while adhering to 3D physical constraints, resulting in improved geometric accuracy and background quality. Experimental results demonstrate significant enhancements over traditional methods in terms of fidelity and realism, establishing GeoEdit as a promising tool for precise object manipulation in images.
GeoEdit achieves unprecedented geometric accuracy and identity fidelity in object editing, overcoming the limitations of existing diffusion-based methods.
Precisely manipulating objects in a single photograph (translation, rotation, scaling) while obeying 3D physical constraints remains unsolved for diffusion-based editors. Current 2D methods lack spatial awareness and produce perspective violations. Forcing structural proxies into the latent space also disrupts variance homogeneity, and the resulting self-attention leakage leads to ghosting and background blur. The core difficulty is asymmetric: the relocated object must follow a rigid geometry, yet the uncovered background needs freedom to synthesize plausible content. We present GeoEdit, a training-free Lift-Manipulate-Render-Denoise pipeline that satisfies both constraints. We decouple scene and object in 3D, align them through point correspondence, and render a geometry-aligned proxy with a structural depth map. A Dual-Branch Denoising stage then refines this proxy: a video diffusion backbone preserves object identity, while 3D constraints are injected into the foreground within a narrow denoising window at matching noise variance (variance-homogeneous injection). The background denoises freely. Because the injected signal matches the native latent statistics, self-attention stays undisturbed. We also introduce GeoEditBench, a pose-aware benchmark covering object translation, object rotation, and camera movement with pose-aware evaluation metrics. Experiments confirm consistent gains in geometric accuracy, identity fidelity, and background quality. Our codes are available at https://github.com/Heey731/GeoEdit.
Tsinghua AI