Search papers, labs, and topics across Lattice.
SynCity 3000 introduces a novel framework for generating globally coherent 3D scenes with precise layout control, addressing the limitations of existing image-to-3D generators. By fine-tuning a convolutional generator on synthetic scene data, the framework enables the creation of complex 3D environments from a single dimetric image derived from user prompts. The results demonstrate that SynCity 3000 can produce large, detailed scenes that maintain coherence across diverse prompts, significantly improving upon previous methods in 3D scene generation.
SynCity 3000 can generate intricate 3D scenes from a single image, overcoming the limitations of traditional methods in scene coherence and detail.
We present SynCity 3000, a framework for generating 3D scenes that are globally coherent while enabling fine-grained layout control. Building on the ability of current image-to-3D generators to produce complex 3D assets from a single image, we extend this capability to the scale of entire scenes by adapting the generator to be applicable as a convolutional operator. We achieve this by fine-tuning the model on scene-like data generated by a new synthetic data engine, which we propose to address the scarcity of 3D scene data for training. The convolutional generator is then applied to a dimetric image of the entire scene, generated from the user prompt, resulting in 3D scenes of arbitrary size and complexity. Across diverse prompts and layouts, SynCity 3000 produces large, coherent, and detailed scenes, addressing the shortcomings of prior approaches to 3D scene generation.
