Search papers, labs, and topics across Lattice.
This paper introduces RoPEMover, a novel method for depth-aware object relocation in images that leverages rotary positional embeddings (RoPE) to ensure geometry-consistent spatial rearrangement. By extending RoPE to encode 3D spatial structures, the model effectively manages occlusions and updates scene-dependent effects such as shadows and reflections, even with minimal real-world supervision. Experimental results show that RoPEMover achieves state-of-the-art performance on standard benchmarks, significantly improving object identity preservation and content generation in newly revealed areas.
Geometry-aware object motion can now be achieved with minimal supervision, preserving identity and realism even under significant spatial displacements.
Moving an object in a single image requires geometry-consistent spatial rearrangement, including handling occlusions, revealing previously unseen regions, and maintaining coherent shadows and reflections. Existing approaches are not well suited to this setting and often fail to preserve such scene-level consistency. We address this problem by introducing a geometry-aware object motion method that operates directly on the positional representations of diffusion transformers. Our key insight is that rotary positional embeddings (RoPE) define a structured spatial field that can be explicitly manipulated to induce controlled motion. We extend 2D RoPE into a depth-aware formulation that encodes 3D spatial structure, enabling consistent object displacement and scene-aware updates. Our model is trained using synthetic data combined with a small set of real images via parameter-efficient fine-tuning. Despite minimal real supervision, it preserves object identity under large spatial displacements, generates plausible content in newly revealed regions, and consistently updates scene-dependent effects such as shadows and illumination. Experimental results on standard object motion benchmarks demonstrate state-of-the-art performance across all evaluation metrics.
