Search papers, labs, and topics across Lattice.
UniWorld-Design introduces a novel framework that transitions image generation from pixel-based synthesis to structured visual composition using semantic RGBA layers. This approach allows for a more intuitive manipulation of visual content, akin to human design practices, enhancing the capabilities of multimodal generative models. Key results include a 37% reduction in per-layer RGB L1 error and a 34% relative improvement in Alpha Soft IoU on the Crello benchmark, alongside T2RGBA achieving the highest CLIP Score compared to existing methods.
Layer-native design transforms how generative models create and edit images, leading to significant performance gains in visual tasks.
We introduce UniWorld-Design, a framework that redefines image generation from flat pixel synthesis to structured visual composition, with semantic RGBA layers as the atomic units of generation, understanding, and editing. Our key insight is that pixels define how an image is rendered, whereas layers define how an image is created, understood, and edited. Just as human designers create and manipulate visual content through layers rather than raw pixels, UniWorld-Design equips multimodal generative models with a layer-native design space. UniWorld-Design comprises two models. The Text-to-RGBA (T2RGBA) model generates standalone RGBA assets directly from text. The Image-to-Layer (I2L) model conditions on a finished image, a global instruction and per-layer prompts, and jointly produces ordered, complete semantic RGBA layers. Its instruction interface supports top-level decomposition, recursive decomposition and targeted extraction, making layering an instruction-addressable operation for agentic editing. Because I2L learns complete semantic objects rather than visible-pixel partitions, its layers stay usable when moved or removed. On the Crello benchmark, I2L reduces per-layer RGB L1 error by 37% and achieves a 34% relative improvement in Alpha Soft IoU over Qwen-Image-Layered. Separately, T2RGBA achieves the highest CLIP Score, outperforming LayerDiffuse and OmniAlpha.
