Search papers, labs, and topics across Lattice.
This study investigates the scaling laws for text-to-image diffusion models using a family of flow-matching transformers, revealing that these models require significantly more training data than language models to achieve compute optimality. Specifically, the research finds that optimal performance occurs at around 200 image tokens per parameter, in stark contrast to the 20 tokens per parameter recommended for language models. The findings indicate that diffusion models are resilient to overtraining, suggesting a paradigm shift for practitioners to prioritize data quantity over model size for improved generative quality.
Diffusion models require ten times more data than language models to achieve optimal performance, challenging existing paradigms in visual generation.
Compute-optimal scaling laws guide the training of frontier language models yet remain largely unexplored for visual generation. We present a systematic scaling law study for text-to-image diffusion models using Abra, a controlled family of flow-matching transformers trained across three orders of magnitude worth of compute ($10^{19}$ to $10^{22}$ FLOPs), reaching significantly larger compute budgets than previous works. We demonstrate that diffusion models scale just as predictably as language models but require far more data to train optimally: compute optimality occurs at approximately $200$ image tokens per parameter, ten times the Chinchilla compute-optimal prescription for LLMs. We show that unlike language models, diffusion models are robust to overtraining and that practitioners should err on the side of more data rather than a larger model. Finally, we show that this predictability extends beyond training loss to generative quality metrics, optimal CFG settings, representation quality, and even the shape of the training curves, which collapse onto a universal form.
