Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
Hybrid Cinematography addresses hallucination risk in generative video reshooting by integrating real-time previsualization with physical capture. This workflow uses an editable 3D shot plan and a proxy of the take to evaluate and manage the likelihood of unrecorded content generation. Filmmakers can then iteratively adjust plans, perform guided pickups, or consciously accept hallucination, as demonstrated by an AR application and offline pipeline.
Filmmakers can now proactively mitigate generative video hallucination by previewing its risk in real-time during on-set planning.
On a film set, the camera move is committed during a take. Generative video reshooting lets filmmakers change it afterward, but may require hallucinating unrecorded content, a gap sometimes discovered only after leaving the set. We present Hybrid Cinematography, a workflow that bridges physical capture and generative reshooting to manage hallucination risk while filmmakers can still act on it. Using an editable 3D shot plan and a proxy of the take, our previsualization evaluates hallucination risk in real time. Seeing where the take lacks support, filmmakers can iteratively adjust the plan, explore moves that balance capture and generation, shoot guided pickups, or knowingly accept hallucination. We demonstrate the workflow through a mobile augmented reality application for on-set planning, capture, and review, and an offline pipeline for existing video. A study with experienced filmmakers reveals how previsualizing risk informs camera decisions and exposes tensions between creative intent and generative hallucination.