Search papers, labs, and topics across Lattice.
This survey investigates the efficiency of diffusion large language models (dLLMs) by introducing a unified latency decomposition framework that disentangles the complex trade-offs affecting inference speed. It categorizes various acceleration techniques into algorithmic, architectural, and system-level optimizations, providing a comprehensive analysis of their impact on practical deployment. The findings emphasize the necessity of specialized inference mechanisms, such as diffusion-aware caching, to achieve meaningful speedups in real-world applications.
Acceleration techniques for diffusion LLMs can unlock significant inference speedups, but only if we understand the intricate trade-offs at play.
Diffusion large language models (dLLMs) offer a theoretical advantage in parallel generation over standard autoregressive models. However, parallel generation alone does not guarantee practical speedups. Realizing this efficiency requires specialized inference mechanisms, such as diffusion-aware caching and reuse. Consequently, as inference efficiency becomes a prerequisite for practical deployment, recent research has actively explored acceleration techniques across algorithms, architectures, and systems. However, rigorous comparisons remain difficult, as end-to-end latency stems from intricate trade-offs between algorithmic, architectural, and system-level factors that are often conflated in existing benchmarks. In this survey, we introduce a unified latency decomposition framework for dLLMs to disentangle these factors and analyze their impact on inference speed in real deployments. Guided by this framework, we categorize acceleration techniques along three axes covering algorithmic innovations, architectural and system optimizations, and inference-time scaling. Finally, we provide guidelines for reproducible benchmarking and highlight open challenges for realizing the full potential of parallel generation.
