Search papers, labs, and topics across Lattice.
OrbitForge introduces a novel method for generating 3D scenes from text prompts by leveraging frozen video priors and Gaussian Splatting reconstruction optimization. This approach addresses the limitations of existing text-to-video models, which struggle with camera motion control and temporal inconsistencies, by anchoring 3D reconstruction to a generated video. The results demonstrate a significant improvement in 3D consistency and coverage, achieving a median span of 359.0 degrees and doubling the ImageReward score relative to previous methods without requiring task-specific fine-tuning.
Achieving a 359-degree median span in 3D scene reconstruction from text prompts could redefine the standards for text-to-3D generation.
Generic text-to-video models can be used as rich open-world scene priors. Despite the high quality of today's generated videos, they do not directly yield reliable 3D assets: camera motion is difficult to control, view coverage is partial, and frames often contain inconsistencies across time. We introduce OrbitForge, an adapter built from frozen video priors and per-prompt Gaussian Splatting reconstruction optimization that converts a single text-generated video into a canonical closed-orbit 3D Gaussian Splatting scene. We use 3D reconstruction as an anchor to improve the 3D consistency of the generated video. We obtain a preliminary 3D reconstruction from a first generated video via Deformable Gaussian Splatting with a robust MedianGS proxy. We render views from a prescribed orbit to detect missing viewpoints. OrbitForge uses the text-to-video model to complete only the missing views, and reconstructs the completed orbit into a final Gaussian Splatting scene. This design requires no task-specific video or multiview fine-tuning, avoids per-prompt score-distillation optimization, and does not progressively generate views one step at a time. We further argue that this setting demands coverage-aware evaluation: local smoothness alone rewards methods that never attempt a full orbit. On a frozen 300-prompt T3Bench-derived audit, OrbitForge reconstruction attains a 359.0-degree measured median span, raises originally unsupported-bin Q10 ImageReward from 8.07 to 16.36 relative to MedianGS-only reconstruction, while remaining competitive with VideoMV on the coverage-quality.
