Search papers, labs, and topics across Lattice.
Search2Motion is a training-free framework for object-level motion editing in image-to-video generation that uses target-frame-based control, relying on first-last-frame motion priors to relocate objects while stabilizing the scene. The framework constructs reliable target frames via semantic-guided object insertion and background inpainting. By leveraging early-step self-attention maps to predict object and camera dynamics, Search2Motion introduces ACE-Seed, an attention-consensus search strategy that enhances motion fidelity without requiring look-ahead sampling or external evaluators.
Achieve object-level motion control in image-to-video generation without any training by cleverly exploiting attention maps and first-last-frame priors.
We present Search2Motion, a training-free framework for object-level motion editing in image-to-video generation. Unlike prior methods requiring trajectories, bounding boxes, masks, or motion fields, Search2Motion adopts target-frame-based control, leveraging first-last-frame motion priors to realize object relocation while preserving scene stability without fine-tuning. Reliable target-frame construction is achieved through semantic-guided object insertion and robust background inpainting. We further show that early-step self-attention maps predict object and camera dynamics, offering interpretable user feedback and motivating ACE-Seed (Attention Consensus for Early-step Seed selection), a lightweight search strategy that improves motion fidelity without look-ahead sampling or external evaluators. Noting that existing benchmarks conflate object and camera motion, we introduce S2M-DAVIS and S2M-OMB for stable-camera, object-only evaluation, alongside FLF2V-obj metrics that isolate object artifacts without requiring ground-truth trajectories. Search2Motion consistently outperforms baselines on FLF2V-obj and VBench.
