Track the frontier, from condensed matter to cosmology.
Search papers, labs, and topics across Lattice.
The authors investigate adversarial post-training for pretrained pixel diffusion and flow-matching models to address their chronic tendency to underproduce fine-scale, high-frequency natural image statistics. Adding an adversarial loss directly to denoised pixel outputs at intermediate-to-low noise timesteps restores missing spectral power-law scaling while jointly improving distribution fidelity, recall, and prompt alignment. Crucially, this benefit does not transfer to latent diffusion models, establishing that direct pixel-space gradient access is essential for adversarial objectives to correct high-frequency generative deficits.
Pixel diffusion’s chronic high-frequency blur is not an architectural bottleneck: a lightweight adversarial post-training phase restores natural spectral power laws without causing mode collapse or requiring changes to the sampling pipeline.
Pixel diffusion models generate RGB images directly, avoiding the bottleneck of an autoencoder, yet their outputs still systematically underrepresent fine-scale natural-image statistics. We show that adversarial learning provides an effective post-training correction for this deficiency. Starting from a pretrained model, we retain its original diffusion or flow-matching objective and add an adversarial loss to the predicted output at non-high-noise timesteps, leaving the model architecture and sampling procedure unchanged. To our knowledge, this is the first systematic study of adversarial post-training for pixel diffusion. Across two pixel backbones, the method jointly improves distribution fidelity, coverage, prompt alignment, and perceptual quality. We further investigate why it works. Frequency-band and power-law analyses show that the original models systematically underproduce natural-image high-frequency content, while adversarial post-training restores this missing spectral power. In contrast, perceptual loss also increases high-frequency content but sacrifices distribution fidelity and prompt alignment. Nearest-neighbor, recall, and matched no-GAN SFT controls further rule out memorization, mode dropping, and additional optimization as simple explanations. Finally, we examine the boundary of this effect. Under the tested latent diffusion configurations, the same procedure does not produce comparable joint gains and adds almost no decoded high-frequency power. These results identify direct output access to the image statistics being corrected as a key factor governing when adversarial post-training succeeds.