Search papers, labs, and topics across Lattice.
LLaDA-Image pairs a 6B Diffusion Transformer trained from scratch with a frozen diffusion language model backbone (LLaDA2.0-Mini) for visual text-to-image generation and fine-grained editing. The training pipeline circumvents early reliance on noisy image-text pairs by first establishing strong generative visual priors via image-only pre-training across 220M samples using the Muon optimizer and parameter-free RMSNorm. The model sets a new open-source state-of-the-art on Qwen-Image-Bench (53.53 English / 53.38 Chinese) and distills down to 2–4 sampling steps with fully open training code and weights.
High-fidelity image synthesis does not require paired text from day one: pre-training visual priors on uncaptioned images before multimodal alignment beats conventional joint training pipelines to establish a new open-source DiT benchmark.
We introduce LLaDA-Image, a unified framework that pairs a 6B Diffusion Transformer (DiT) trained from scratch with a frozen vision-language understanding module built on the LLaDA2.0-Mini diffusion language model backbone. Instead of relying heavily on paired image-text data from the beginning, we first build a strong visual generative prior through image-only pre-training and mid-training. The generation pipeline comprises 220M samples, 98 of which are real images. For efficient and scalable optimization, we use parameter-free RMSNorm throughout the DiT together with the Muon optimizer. The resulting unified model produces highly photorealistic images while accurately following fine-grained editing instructions. We further distill LLaDA-Image into LLaDA-Image-Turbo, enabling fast inference in 2-4 sampling steps. On Qwen-Image-Bench, LLaDA-Image achieves overall scores of 53.53 and 53.38 on the English and Chinese tracks, respectively, setting a new state-of-the-art among open-source models on both tracks. To support further research on capable and efficient generative models, we release our model weights, training code, and detailed recipes.
