Search papers, labs, and topics across Lattice.
This paper introduces ScaleVid, a novel framework for geometry-aware video object scaling that operates without the need for mesh-based 3D reconstruction. By employing a progressive two-stage training approach, it effectively separates foreground transformation from background preservation, utilizing geometrically perturbed pseudo-sources to enhance the quality of video synthesis. The results show that ScaleVid achieves superior geometric consistency and faster inference times compared to existing methods, making it a significant advancement in video object manipulation techniques.
Achieving high-quality video object scaling without the overhead of 3D reconstruction, ScaleVid redefines the boundaries of real-time video synthesis.
Geometry-aware video object scaling aims to anisotropically resize the object along object-centric axes while preserving geometric plausibility, temporal coherence, and background consistency. Existing text-guided methods mainly operate in the 2D image plane, while depth-guided approaches provide coarse control and mesh-based methods require costly 3D reconstruction. We present a progressive two-stage training framework that decouples geometry-aware foreground transformation from background preservation and realistic video composition, without mesh-pixel alignment and explicit 3D reconstruction at inference. In both stages, geometrically perturbed pseudo-sources are constructed from real videos, while the original complete videos are retained as reconstruction targets. The first stage uses planar transformations to learn robust foreground-background composition, whereas the second introduces object-centric 3D deformation guidance for geometry-aware scaling. This pseudo-source reconstruction formulation enables real-video synthesis without paired real-world scaling targets. We construct complementary paired-geometry and real-background benchmarks and further evaluate on in-the-wild videos. Extensive experiments demonstrate superior geometric consistency, foreground fidelity, and background preservation, together with faster and more practical inference than methods requiring explicit 3D reconstruction.