Search papers, labs, and topics across Lattice.
This paper adapts a pre-trained image editing model (Qwen-Image-Edit) for video frame interpolation (VFI) using LoRA fine-tuning with only 64-256 samples. It demonstrates that the spatial reasoning capabilities of image editing models can be repurposed for temporal synthesis without explicit temporal modeling or video-specific architectures. The adapted model successfully unlocks interpolation capabilities, showing that foundation image editing models possess latent temporal reasoning potential.
Image editing models already know how objects *move*—unlocking surprisingly good video interpolation with just a handful of examples.
Pre-trained image editing models exhibit strong spatial reasoning and object-aware transformation capabilities acquired from billions of image-text pairs, yet they possess no explicit temporal modeling. This paper demonstrates that these spatial priors can be repurposed to unlock temporal synthesis capabilities through minimal adaptation - without introducing any video-specific architecture or motion estimation modules. We show that a large image editing model (Qwen-Image-Edit), originally designed solely for static instruction-based edits, can be adapted for Video Frame Interpolation (VFI) using only 64-256 training samples via Low-Rank Adaptation (LoRA). Our core contribution is revealing that the model's inherent understanding of "how objects transform" in static scenes contains latent temporal reasoning that can be activated through few-shot fine-tuning. While the baseline model completely fails at producing coherent intermediate frames, our parameter-efficient adaptation successfully unlocks its interpolation capability. Rather than competing with task-specific VFI methods trained from scratch on massive datasets, our work establishes that foundation image editing models possess untapped potential for temporal tasks, offering a data-efficient pathway for video synthesis in resource-constrained scenarios. This bridges the gap between image manipulation and video understanding, suggesting that spatial and temporal reasoning may be more intertwined in foundation models than previously recognized