Search papers, labs, and topics across Lattice.
This paper introduces SpatialGuard, a structured framework that enhances 3D spatial text-to-image generation by converting natural language prompts into stable visual geometries through a multi-step process. By utilizing a Spatial Layout Architect, Visual Realizer, and Visual Alignment Critic, SpatialGuard ensures that object relations and spatial constraints are maintained throughout the generation process. Experimental results demonstrate that SpatialGuard outperforms existing methods in terms of spatial faithfulness and controllability in complex 3D layouts.
SpatialGuard transforms 3D spatial text-to-image generation from a mere prompt-following exercise into a verifiable planning and validation process, significantly enhancing spatial accuracy.
Complex 3D spatial text to image generation requires models to convert natural language into stable visual geometry, not merely semantic appearance. Existing prompt-driven or layout-conditioned methods improve controllability, but often lack an optimizable and verifiable spatial intermediary before visual sampling. As a result, object relations, occlusion, visibility, and camera constraints can decay during multi-round generation. This paper presents SpatialGuard, a structured layout-guided framework for complex 3D spatial text-to-image generation. SpatialGuard parses prompts into image synthesis-oriented 3D layouts through a Spatial Layout Architect, realizes them as visual conditions and candidate images through a Visual Realizer, and uses a Visual Alignment Critic to validate consistency among prompt, layout, and image. To keep constraints stable across iterations, SpatialGuard introduces a Layout Harness that organizes rule constraints, tool invocation, shared knowledge, and feedback loops around the editable layout state. This design turns complex spatial generation from implicit prompt following into a verifiable process of planning, realization, validation, and repair. Comprehensive experiments show that SpatialGuard achieves state-of-the-art performance in complex 3D spatial layout generation and improves spatial faithfulness over existing text-to-image and layout control baselines.
