Search papers, labs, and topics across Lattice.
WorldRecon addresses the challenge of generating complete, high-quality 3D meshes from unposed multi-view images by employing a generative framework that leverages imperfect global geometric priors. The system uses TRELLIS.2, conditioned on local point cloud crops and image observations, to generate detailed geometry and PBR materials within spatially partitioned blocks. Scene-level coherence is maintained through neighbor-aware latent inpainting and a causal generation procedure, achieving state-of-the-art results on both synthetic and real-world indoor scenes.
Generative 3D reconstruction now scales to entire indoor scenes, producing coherent, unified meshes with state-of-the-art fidelity from unposed images.
Reconstructing complete, high-quality meshes of large-scale scenes from unposed multi-view images requires faithful geometric grounding while plausibly completing surfaces that are unobserved or only sparsely captured. We present WorldRecon, a generative multi-view reconstruction framework for recovering complete, large-scale 3D scene meshes from unposed RGB images. WorldRecon uses a coarse, noisy global point cloud and camera poses estimated from the input images by a reconstruction model as a global scaffold for whole-scene generation and partitions it into overlapping spatial blocks. To robustly leverage these imperfect geometric priors, we equip the native 3D generative model TRELLIS.2 with a dedicated reconstruction-based conditioning architecture that generates each block from its local point-cloud crop and block-relevant image observations, producing sparse structure, detailed geometry, and PBR materials. To maintain scene-level coherence, we introduce neighbour-aware latent inpainting and a causal world-generation procedure that propagates structural, geometric, and material context across overlapping blocks. Together, these designs scale multi-view generative reconstruction to large-scale scenes, yielding coherent, unified meshes. Extensive experiments demonstrate that WorldRecon achieves state-of-the-art reconstruction performance, reducing Chamfer distance by 14.9% and 43.1% while improving F-score by 17.3% and 12.0% over the strongest baselines on synthetic and real-world indoor scenes, respectively, thereby demonstrating faithful and complete generative reconstruction as well as strong sim-to-real generalization. Project page: https://kszpxxzmc.github.io/WorldRecon-website/.