Search papers, labs, and topics across Lattice.
This paper introduces GIVE, a geometry-instructed video editing framework that enables precise object-level geometric edits by utilizing a unified object-state formulation. The method employs two video-aligned geometry streams鈥攁 depth-box for 3D placement and an orientation-box for orientation cues鈥攖o effectively specify object-state transitions while maintaining temporal coherence and consistent secondary effects. Experimental results indicate that GIVE achieves reliable geometric edits in both controlled and real-world video scenarios, significantly enhancing the reliability of generative video editing workflows.
GIVE achieves reliable geometric edits in video editing by unifying object-state specifications, overcoming traditional challenges in generative workflows.
Object-level geometric edits, including translating, rotating, scaling, duplicating, or removing an object, are routine operations in digital content creation (DCC) workflows, yet they remain unreliable in generative video editing. The key challenge lies in specifying the target object's 3D state change unambiguously across viewpoint and time, while consistently updating geometry-dependent secondary effects such as shadows and reflections. We introduce GIVE, a geometry-instructed video editing framework that represents edits through a unified object-state formulation. Two video-aligned geometry streams describe the target object before and after editing: a depth-box encoding coarse 3D placement and extent, and an orientation-box providing an appearance-agnostic orientation cue. Together, these streams provide a compact pre/post geometric specification for object-state transitions. To provide paired supervision for learning these edits, we build a scalable graphics-engine pipeline that executes object-level edit programs and renders controlled before/after pairs, isolating the intended geometric edit while keeping secondary effects consistent with the transformation. Experimental results demonstrate that GIVE produces faithful geometric edits with temporal coherence and consistent secondary effects across operators in a unified framework, and shows promising transfer to in-the-wild videos. Project page: https://geometry-instructed-video-editing.github.io/give/
