Search papers, labs, and topics across Lattice.
This paper introduces HomeWorld, a hierarchical framework for generating controllable and interactive whole-home scenes by decomposing the indoor scene synthesis process into manageable stages. The authors curate a dataset of 300K real residential floorplans to train a language model for floorplan generation, followed by utilizing image generation models for furniture layout and object placement, all refined through a VLM-based correction process. Experimental results indicate that HomeWorld significantly enhances layout diversity and 3D design appeal compared to existing methods, making it a valuable tool for robot simulation and interior design applications.
Whole-home scenes generated by HomeWorld exhibit unprecedented layout diversity and 3D design appeal, outperforming traditional methods in both quantitative and qualitative assessments.
Indoor scene generation is crucial for robot simulation and modern interior design. However, complex layouts together with scarce 3D scene data make learning-based generation challenging. Existing methods often rely on hand-crafted rules or focus on isolated sub-tasks (e.g., floorplan synthesis or single-room furnishing), producing whole-home scenes that lack global coherence, realism, and simulation readiness. To mitigate these limitations, we propose a unified hierarchical framework that decomposes indoor scene synthesis into controllable stages. First, we curate a large-scale dataset of 300K real residential floorplans to train a large language model for whole-home floorplan generation. With detailed descriptions and a K-D tree-based representation, our method enables fine-grained, controllable whole-home floorplan generation. Building upon the generated whole-home floorplan, we leverage image generation models to draft furniture layouts from multi-level roaming viewpoints, and then generate the layouts of small manipulable objects on different supporting surfaces (e.g., cabinets, desks, and dining tables) for embodied AI simulation. During furniture and object layout generation, a VLM-based refiner iteratively corrects furniture and object placement, and a 3D generative model enables flexible replacement of individual assets. We further attach basic physical attributes and simple surface texture and lighting setups to complete the pipeline for embodied AI use. Experiments and user studies demonstrate that our pipeline produces indoor spaces with greater layout diversity and stronger 3D design appeal, outperforming prior methods on both quantitative and qualitative metrics. Finally, alongside our generation pipeline, we will release the floorplan dataset and 5K fully furnished scenes to the community. Project Page: https://kairos-homeworld.github.io/
