Track genomics, neuroscience and molecular biology.
Search papers, labs, and topics across Lattice.
This paper introduces Scene-Designer, an agentic framework that learns design intelligence for 3D indoor scene generation by combining complementary design and critique experiences. By leveraging two novel datasets, Scene-OTA-35K and Scene-OTC-15K, the framework trains a Critic-guided GRPO (Scene-GRPO) to improve design decisions and reduce error correction. Scene-Designer demonstrates superior performance in physical validity, functional correctness, and layout coherence, with the learned Scene-Critic outperforming general models in critique and offering test-time guidance.
Agents can now learn to design and critique 3D scenes like human designers, achieving state-of-the-art quality through complementary learning.
Generating complete, coherent, and usable 3D indoor scenes from natural language requires strong design intelligence: the ability to design high-quality scenes and critique their quality. However, existing approaches either rely on general-purpose models lacking domain-specific design experience or learn from static scenes. In this work, we introduce Scene-Designer, an agentic framework that learns design intelligence through complementary design and critique experiences. We construct two datasets: Scene-OTA-35K, which provides Observation--Thought--Action supervision for learning scene design and efficient error correction, and Scene-OTC-15K, which provides Observation--Thought--Critic supervision for learning scene quality critique across physical validity, functional correctness, and layout coherence. Based on these experiences, we propose Scene-GRPO, a Critic-guided GRPO framework that improves design decisions and reduces unnecessary trial-and-error corrections. Extensive experiments demonstrate that Scene-Designer achieves superior performance in physical validity, functional correctness, and layout coherence, while the learned Scene-Critic significantly outperforms general-purpose models in scene critique. Moreover, test-time Critic guidance further improves scene generation, showing that the Critic can provide useful guidance beyond training. Additional analysis suggests a trend of mutual enhancement between scene design and critique abilities.