Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
Tetris3D addresses the challenge of generating physically and geometrically coherent 3D scenes from single images by explicitly conditioning object generation on the geometry and physical relationships of surrounding objects. This approach overcomes limitations of prior methods that generate objects independently or implicitly coupled, leading to improved fine-grained spatial compatibility. Experiments demonstrate Tetris3D's ability to recover coherent object shapes and poses, even with occluded interacting regions, achieving state-of-the-art performance in both generation quality and physical stability.
Generating 3D scenes where objects not only look plausible but also physically fit together, even when interactions are hidden.
We propose Tetris3D, a generative framework for single-image 3D scene reconstruction that recovers objects which are physically and geometrically coherent as a scene. Existing methods often generate objects independently or couple them implicitly, providing limited guidance for ensuring fine-grained spatial compatibility between neighboring objects that interact with one another. To address this, we explicitly condition the generation of each object on the geometry of surrounding objects and their physical relationships, guiding its shape and pose to remain geometrically and physically plausible within the scene. Moreover, we introduce ComOb, a physics simulation-based dataset of 1.2M scenes featuring physical interactions across diverse object categories, with per-object meshes and pairwise physical relation annotations. Comprehensive experiments on synthetic and realworld scenes show that Tetris3D recovers coherent object shapes and poses even when interacting regions are occluded, and achieves state-of-the-art performance in both generation quality and physical stability.