Search papers, labs, and topics across Lattice.
This paper introduces NeoMap, a training-free framework for novel view video synthesis that leverages pre-trained video models to generate high-fidelity, view-consistent outputs from single images or monocular videos. By addressing the limitations of existing methods that rely on camera conditioning and fine-tuning, NeoMap utilizes convergent manifold alternating projection iterations to optimize initial noise and locate optimal novel view solutions encoded within the data manifold. Extensive evaluations on standard benchmarks, including Tanks-and-Temples, LLFF, and DAVIS, show that NeoMap achieves state-of-the-art performance in generation fidelity and view consistency, surpassing all existing approaches.
Existing methods struggle with artifacts and consistency, but NeoMap achieves superior novel view synthesis without any training.
We study the challenging problem of novel view video synthesis from single images or monocular videos. Existing methods, which operate under the assumption that pre-trained video models lack native novel view synthesis capability and enforce view alignment via camera conditioning, task-specific fine-tuning, or stepwise hard denoising guidance, often suffer from artifacts and compromised global scene consistency. In this paper, we introduce NeoMap, a novel training-free framework designed to locate high-fidelity, view-consistent novel view solutions from general pre-trained video models. The key to our approach is the core insight that promising novel view solutions are inherently encoded within the natural video data manifold learned by pre-trained models, and the core challenge is simply to locate this optimal solution. We solve this via our core mechanism: convergent manifold alternating projection iterations that optimize the initial noise. Extensive experiments demonstrate that NeoMap significantly outperforms all existing methods across 3 standard novel view synthesis benchmarks, including the challenging Tanks-and-Temples, LLFF and DAVIS datasets, achieving state-of-the-art generation fidelity and top-tier view consistency.
