Search papers, labs, and topics across Lattice.
This paper introduces PRISM, a novel feed-forward framework for single-image 3D reconstruction that utilizes geometric warp-residual modeling to improve efficiency and performance. By decomposing the multi-view latent prediction into a geometric prior and a learned residual correction, PRISM eliminates the need for iterative diffusion sampling during inference, significantly reducing processing time. Experimental results across three benchmarks show that PRISM achieves competitive reconstruction quality with a dramatic decrease in inference time to just 36 seconds per scene, highlighting its practical applicability in real-world scenarios.
PRISM achieves competitive 3D scene reconstruction quality while slashing inference time to just 36 seconds by leveraging geometric warp-residual modeling.
Reconstructing 3D scenes from a single image is a fundamental challenge in computer vision, with broad applications in virtual reality, robotics, and content creation. Recent methods achieve outstanding performance by leveraging camera-controlled video diffusion models, but rely on iterative diffusion sampling, which greatly limits their practical deployment. We observe that geometric forward warping alone can cover the majority of a target view directly from the input image, with only a compact residual left for the encoder to correct. Motivated by this observation, we propose PRISM, a feed-forward framework that decomposes multi-view latent prediction into a parameter-free geometric prior and a learned residual correction, with no diffusion sampling required at inference. To enable generalization from purely synthetic training data, we devise a two-stage training strategy combining latents supervised distillation for geometric generalization and perceptual fine-tuning for appearance quality optimization. Extensive experiments on three benchmarks demonstrate that PRISM achieves competitive reconstruction quality compared with diffusion-based methods, while reducing inference time dramatically to only 36 seconds per scene.
