Search papers, labs, and topics across Lattice.
This paper introduces ChebBooster, a training-free extrapolation framework leveraging Chebyshev polynomial theory to enhance the efficiency of Diffusion Transformers (DiTs) during inference. By employing a Barycentric formulation for Chebyshev approximants, the method achieves high numerical stability and significantly reduces computational overhead through a two-phase approach that separates weight precomputation from online application. Experimental results across multiple DiT models show that ChebBooster can improve visual quality and inference efficiency, achieving up to 3.68x latency speedup and 5.12x reduction in FLOPs compared to existing methods.
Achieving up to 3.68x faster inference and 5.12x fewer FLOPs, ChebBooster redefines efficiency in Diffusion Transformers without the need for additional training.
Diffusion Transformers (DiTs) have shown strong performance in high-fidelity image generation, but their sampling process remains computationally intensive due to full model execution at every timestep. While cache-based acceleration has been explored to mitigate inference cost, naive reuse schemes suffer from low accuracy over long intervals, and Taylor-series-based extrapolation methods often face instability caused by Runge oscillations. In this paper, we propose ChebBooster, a training-free extrapolation framework based on Chebyshev polynomial theory that achieves stable and efficient acceleration for DiTs. Specifically, we adopt the Barycentric formulation to evaluate Chebyshev approximants with high numerical stability and minimal overhead, and further decouple the extrapolation into an offline weight precomputation phase and a lightweight online application stage. Extensive experiments across three representative DiT-based models, including DiT-XL/2, PixArt-$危$, and FLUX.1-dev, demonstrate that ChebBooster achieves consistent improvements in visual quality and inference efficiency, reaching up to $3.68\times$ latency speedup and $5.12\times$ FLOPs reduction, outperforming existing training-free baselines under diverse generation tasks and resolutions.
