Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper identifies a critical inefficiency in pixel-space flow models caused by the spectral imbalance in training objectives, where low frequencies dominate the optimization process. To address this, the authors propose the Focal Log-Frequency Loss (f-loss), which balances the learning signal across frequencies and emphasizes high-frequency components. Their method accelerates convergence by up to 40% and enhances both FID and perceptual fidelity across various model scales, all without requiring architectural changes.
A novel loss function that boosts convergence speed by up to 40% while improving image quality by addressing the spectral imbalance in pixel-space training.
Natural images follow a $1/f^2$ spectral distribution: most signal energy lies in the low spatial frequencies, while the perceptually important structures such as textures and edges occupy sparse high-frequency bands. Pixel-space reconstruction objectives, however, treat all spatial errors uniformly, causing low frequencies to dominate the optimization signal and delaying the learning of fine-scale details. In this work, we identify this objective-level spectral imbalance as a key inefficiency in training pixel-space flow models. To address it, we propose a Focal Log-Frequency Loss (f-loss), a spectrally balanced objective that equalizes the learning signal across frequencies, emphasizing high-frequency components that are otherwise underrepresented in pixel-space objectives. Building on this, we introduce a simple training strategy that combines frequency and pixel supervision: we first emphasize frequency-domain learning early to capture all frequencies, and then transition to standard pixel-space v-loss for spatial refinement. This balancing mitigates the low-frequency bias of pixel losses and aligns the training signal with the evolving needs of the model. Our approach is conceptually simple, requires no architectural changes, and acts as a drop-in replacement for flow matching losses. Across multiple model scales, it accelerates convergence by up to 40% while consistently improving FID and perceptual fidelity. We will release code and models.