Search papers, labs, and topics across Lattice.
This paper introduces Mise-en-Sc\`ene, a novel two-stage framework that enables implicit layout emergence within a pretrained image-editing diffusion transformer for graphic design synthesis. By integrating layout generation and visual synthesis, the method overcomes the limitations of traditional approaches that rely on explicit bounding-box coordinates, resulting in more coherent and scalable compositions. Experimental results on the PrismLayersPlus benchmark demonstrate that Mise-en-Sc\`ene significantly outperforms existing methods in perceived quality, achieving the closest designs to ground truth while maintaining asset fidelity through a deterministic match-and-place step.
Implicitly emerging layouts in diffusion transformers yield graphic designs that are not only visually superior but also editable, revolutionizing human-AI co-creation in design.
Automating graphic design synthesis from user-provided elements requires both a coherent overall composition and the exact preservation of each asset. Existing methods predict a layout as explicit bounding-box coordinates with a language model and then paste the assets into it, which separates spatial planning from visual synthesis and tends to produce rigid, mis-scaled compositions. We instead ask whether the layout can emerge implicitly inside a pretrained image-editing diffusion transformer. We present Mise-en-Sc\`ene, a two-stage framework. In the first stage, a diffusion transformer adapted with a small, knockout-selected LoRA drafts a complete design in which the arrangement of the elements emerges jointly with the rendered canvas. In the second stage, a deterministic match-and-place step moves the original high-resolution assets to the drafted positions, which guarantees exact asset fidelity and yields an editable, layered design that a designer can keep refining rather than a flat image. Notably, a minimal adaptation of the pretrained transformer already suffices, without the specialized conditioning machinery commonly introduced for multi-element generation. On the large-scale PrismLayersPlus benchmark, the designs produced by Mise-en-Sc\`ene are the closest to the ground truth in perceived quality among all compared methods, by a wide margin over both an LLM layout planner and a specialized layout transformer, while our match-and-place stage bridges the remaining fidelity gap to the ground-truth composites.
