Search papers, labs, and topics across Lattice.
This paper introduces Adversarial Fr茅chet Distance (AdvFD), a novel approach that enhances visual generation by integrating a learnable representation into the traditional Fr茅chet distance loss framework. The authors identify that existing Fr茅chet losses suffer from "Fr茅chet hacking," where improvements in target metrics do not translate to better visual quality, due to reliance on static feature spaces. Through extensive experiments, AdvFD demonstrates significant improvements in generator post-training across various model architectures, effectively addressing the limitations of static representations.
AdvFD not only boosts visual quality in generative models but also tackles the pitfalls of static feature spaces that lead to stagnation in performance.
Fr\'echet distance has recently emerged as an effective distribution-level objective for generator post-training, complementing the conventional sample-level diffusion and flow-matching losses. However, directly optimizing Fr\'echet objectives can cause Fr\'echet hacking. The target metrics keep improving, but visual quality and Fr\'echet alignment in other feature spaces may stagnate or deteriorate. We attribute this failure to the static pretrained feature spaces used by existing Fr\'echet losses. These feature spaces provide incomplete and fixed views of the differences between real and generated distributions. To address this limitation, we propose Adversarial Fr\'echet Distance (AdvFD), which complements the static representation targets in FD-Loss with a calibrated adversarially learned representation. AdvFD augments the original static Fr\'echet objective with a learnable representation that adversarially maximizes the Fr\'echet discrepancy between real and generated samples, while the generator minimizes the same discrepancy in the resulting adaptive feature space. To prevent the adversarial representation from trivially increasing the objective through feature amplification, we further introduce real-feature whitening, which normalizes its scale and covariance geometry and stabilizes the min--max optimization. Extensive experiments show that AdvFD consistently improves one-step generator post-training across both JiT and pMF backbones and across different model scales.
Tsinghua AI