Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper introduces Fréchet Distance loss (FD-loss), a method for training generative models by decoupling the population size for Fréchet Distance (FD) estimation from the batch size for gradient computation. Optimizing FD-loss in representation spaces consistently improves visual quality, achieving a 0.72 FID on ImageNet 256x256 with a one-step generator using the Inception feature space. The authors also demonstrate that FD-loss can repurpose multi-step generators into strong one-step generators and introduce FDr$^k$, a multi-representation metric to address the misranking of visual quality by FID.
Fréchet Distance, previously deemed impractical for training, unlocks surprisingly high-fidelity image generation when optimized in representation space with decoupled batch sizes.
We show that Fr\'echet Distance (FD), long considered impractical as a training objective, can in fact be effectively optimized in the representation space. Our idea is simple: decouple the population size for FD estimation (e.g., 50k) from the batch size for gradient computation (e.g., 1024). We term this approach FD-loss. Optimizing FD-loss reveals several surprising findings. First, post-training a base generator with FD-loss in different representation spaces consistently improves visual quality. Under the Inception feature space, a one-step generator achieves0.72 FID on ImageNet 256x256. Second, the same FD-loss repurposes multi-step generators into strong one-step generators without teacher distillation, adversarial training or per-sample targets. Third, FID can misrank visual quality: modern representations can yield better samples despite worse Inception FID. This motivates FDr$^k$, a multi-representation metric. We hope this work will encourage further exploration of distributional distances in diverse representation spaces as both training objectives and evaluation metrics for generative models.