Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces SpectralDiT, a novel enhancement to flow-matching Diffusion Transformers that incorporates timestep-conditioned spectral correction into the MLP residual branch. By decomposing residual updates into low- and high-frequency components, the model effectively reduces the FID score from 20.78 to 19.71 on CIFAR-10 while also improving latent flow-matching on ImageNet-100 with minimal additional computational cost. The findings highlight the potential for targeted spectral corrections to enhance generative model performance without significant resource overhead.
SpectralDiT achieves an impressive 8.7% relative reduction in FID on ImageNet-100 while only adding 0.6% in theoretical FLOPs and 1.36% in parameters.
We propose SpectralDiT, a lightweight modification to flow-matching Diffusion Transformers that adds timestep-conditioned spectral correction to the MLP residual branch. The module decomposes each residual update into low- and high-frequency components on the patch-token grid, then learns a zero-initialized additive gate so the model initially matches the baseline DiT. On CIFAR-10 pixel-space generation, SpectralDiT improves FID from 20.78 to 19.71 at patch size 1 and reduces the radial Fourier spectrum gap. Furthermore, we scale our method to latent diffusion on ImageNet-100. With 0.6% additional theoretical FLOPs and 1.36% additional parameters, SpectralDiT improves latent flow-matching, achieving an 8.7% relative FID reduction under classifier-free guidance (CFG 2.0). All reported results are averaged over five seeds. Ablations and gate visualizations on CIFAR-10 reveal stable block-specific spectral correction patterns.