Search papers, labs, and topics across Lattice.
This paper introduces RoomWright, a novel framework for generating 3D indoor scenes that emphasizes functional usage over mere visual construction. By employing usage-driven object reasoning and a code-based approach, RoomWright allows for the creation of interactive environments that support multi-part interactions and capture causal dependencies among objects. Experimental results show that RoomWright produces scenes that are not only executable and editable but also ready for simulation-based policy learning, significantly enhancing the utility of synthetic environments for embodied AI applications.
RoomWright transforms indoor scene synthesis by prioritizing functional usage, enabling interactive environments that are ready for real-world robotic applications.
Indoor scene synthesis provides essential environments for embodied AI, robotic manipulation, and simulation-based policy learning. Recent code-based scene generation methods produce editable and extensible environments, yet they remain focused on visual construction and object-level articulation, leaving the functional usage of scenes largely unmodeled. To address this problem, we present RoomWright, an agentic usage-driven framework for generating 3D scenes represented entirely as code for embodied interaction. RoomWright performs usage-driven object reasoning, which treats each anchor as a task centre and admits task-required objects and their affordances. A code agent further enables multi-part interaction by compiling each interaction into a trigger, condition, effect rule that updates structured object states, capturing causal dependencies across objects. Moreover, since manipuland orientation is ambiguous and hard to recover from pixels, RoomWright alleviates this via annotation-informed usage-guided orientation. Extensive experiments demonstrate the effectiveness of our method. The resulting scenes are executable, editable, and simulation-ready, providing interactive environments for embodied AI and policy learning.
