Search papers, labs, and topics across Lattice.
ABot-3DWorld 0 is a universal multimodal 3D world model that transforms text, image, and video inputs into high-fidelity, explorable 3D environments using a unified Spatial Generative Primitive (SGP). This framework allows for both geometry-rigorous recovery of rich inputs and generative completion from minimal data, enabling a seamless transition from various input types to photorealistic 3D worlds. Experimental results indicate that ABot-3DWorld 0 outperforms existing open-source methods, particularly in scene fidelity when processing rich multimodal inputs.
ABot-3DWorld 0 achieves state-of-the-art scene fidelity in 3D content creation, even outperforming established models like Marble with rich multimodal inputs.
We present ABot-3DWorld 0, a universal multimodal 3D world model that turns text, image, and video inputs into high-fidelity, explorable 3D worlds. At the heart of our framework is a unified Spatial Generative Primitive (SGP), a compact tuple of a high-quality panorama and a spatial point cloud that delivers an efficient description of any 3D space. Multimodal inputs are first lifted into this primitive; a 3D-consistent panoramic video generator then explores the primitive along a planned trajectory; finally, our panoramic video reconstruction engine converts the generated video into a clean, photorealistic 3D Gaussian Splatting (3DGS) world. This pipeline covers two regimes: rich inputs (multi-view sets, casual video) are lifted into the SGP through a geometry-rigorous recovery that mirrors the observed scene, while a single image or sentence is completed generatively into a creative world. The result is one low-barrier engine for general 3D content creation that further anchors generated worlds to geographic points of interest, enabling map-native spatial exploration at consumer scale. Experiments show that ABot-3DWorld 0 sets the state of the art among open-source methods and demonstrates stronger scene fidelity than Marble under rich multimodal inputs.
Tsinghua AI