Search papers, labs, and topics across Lattice.
This work introduces a coding-agent framework that reconciles the aesthetic expressiveness of diffusion models with the compositional control of code-based visual generation. By casting a VLM as an orchestrator that plans layouts and prompts image models strictly for isolated visual assets, the system synthesizes designs into native, layered HTML/CSS through an iterative visual feedback loop. Across posters and infographics, the approach successfully replaces flat, uneditable bitmaps with fully decoupled, production-grade graphical assets supporting direct DOM manipulation and design trajectory replay.
Visual design no longer requires choosing between diffusion fidelity and code editability: orchestrating modular asset diffusion through a VLM-driven HTML/CSS coding loop delivers fully interactive, layer-decoupled graphic layouts.
While diffusion base models such as GPT-Image-2 and Nano-Banana exhibit remarkable visual expressiveness, their end-to-end generation inherently yields flattened bitmaps with error-prone text, precluding layer-wise post-editing. Conversely, code-based visual generation via Coding Agents provides precise layout control and decoupled layers, yet remains constrained by a lack of global aesthetic intuition and the difficulty of coding complex visual assets. To address this, we propose Editable Visual Design, a new paradigm driven by a Coding Agent. We designate the VLM as the ``creative brain''for requirement comprehension, task planning, and aesthetic judgment, while utilizing the image generation model as an on-demand ``visual world simulator''to synthesize standalone visual assets. Operating under an ``imagine first, then act''closed-loop workflow, the agent generates isolated assets, writes native HTML/CSS, and iteratively refines the design against visual rendering feedback. Furthermore, Agent Design Replay faithfully reproduces the creative and reasoning trajectory akin to that of professional human designers. Ultimately, the system delivers editable artifacts with decoupled layers and real text, enabling users to perform intuitive mouse dragging and layout adjustments on a graphical user interface. Validations on posters, infographics, and other scenarios show that this paradigm successfully achieves both refined aesthetics and production-grade editability.
Tsinghua AI