Search papers, labs, and topics across Lattice.
This paper introduces GeoT2V-Bench, a novel benchmark designed to evaluate the 3D consistency of camera-prompted text-to-video models through rigorous 3D reconstruction techniques. By employing a pipeline that estimates camera intrinsics and poses, fits DeformableGS, and assesses static rendering errors, the authors provide a comprehensive diagnostic tool that reveals discrepancies in visual motion and static scene representations. The findings indicate that traditional metrics may overlook critical failure modes, highlighting the need for more nuanced evaluation methods in text-to-video synthesis.
Camera-prompted T2V models often fail to align visual motion with static scene coherence, revealing hidden inconsistencies in their outputs.
Camera-prompted text-to-video (T2V) models are increasingly used to synthesize virtual camera captures, such as orbiting objects or moving through static scenes. For these outputs, visual plausibility is insufficient: the generated frames should also provide coherent multi-view evidence for a single static 3D scene. We introduce GeoT2V-Bench, a reconstruction-based diagnostic benchmark for evaluating whether camera-prompted T2V clips can support explicit rigid 3D reconstruction. Our pipeline estimates per-frame camera intrinsics and poses with VGGT-style geometry estimation, fits DeformableGS, derives a static MedianGS proxy by temporal-median aggregation, and renders this proxy along the estimated camera path. Instead of producing a pass/fail label or a single scalar score, GeoT2V-Bench reports a continuous reconstruction profile covering apparent image motion, estimated trajectory behavior, MedianGS static rendering error, static-render flow agreement, and the gap between flexible and static fits. On a fair-format four-seed evaluation with 3,840 completed reconstructions from 12 open-weight model configurations and 80 GeCo-Eval static-scene prompts, we find that visible motion, static rendering error, flow agreement, and flexible-vs-static behavior often disagree. GeoT2V-Bench therefore captures complementary failure modes that emerge when generated videos are tested as global static-scene acquisitions.
