Search papers, labs, and topics across Lattice.
Addressing the latency and physical invalidity bottlenecks in text- and image-to-3D pipelines, SceneMosaic combines learned parametric image-based layout priors with localized vision-language model (VLM) agent evolution. By decomposing scenes into independent spatial units for parallel refinement and combinatorial Cartesian product assembly, the method unlocks scalable multi-scene diversity without compounding iteration costs. On SceneEval-100, the approach matches top-tier agentic baselines in semantic quality with a 24x speedup while substantially reducing physical intersections.
Agentic 3D scene generation can match state-of-the-art layout fidelity with a 24x speedup by replacing global iterative placement with localized VLM evolution over parametric image priors.
Diverse and simulation-ready indoor scenes are essential for interactive entertainment and embodied AI, yet their scalable generation remains challenging. Recent agentic text-to-3D scene pipelines that rely on vision-language models (VLMs) can generate scenes of high fidelity but require costly iterative object placement and refinement. Another mainstream paradigm, parametric image-to-3D scene models, produces scenes efficiently from strong priors learned from 2D images but often leads to imprecise and physically invalid scenes. More importantly, both paradigms struggle to output diverse scenes for a single input, making it hard for them to reflect the dynamically changing nature of real scenes. In this paper we propose SceneMosaic, a framework that combines the merits of both paradigms. It obtains the initial candidate from the learned image-based prior, and subsequently evolves the result through VLM agents, ensuring both efficiency and physical validity. Within the evolution process, SceneMosaic exploits the locality of natural scenes and decomposes a scene into independent local units, allowing separate evolution within each unit before composing the global scene via Cartesian product. On SceneEval-100, SceneMosaic matches the strongest agentic baseline in semantic layout quality with a 24x speedup, substantially reduces physical violations, and receives the highest human ratings. Our code is publicly available at https://github.com/rxjfighting/SceneMosaic.
