Search papers, labs, and topics across Lattice.
This paper investigates a high-dimensional model of GAN training where a linear generator learns from data characterized by structured latent covariance, moving beyond previous analyses that assumed diagonal latent structures. By extending the framework to include class-dependent, correlated, and non-zero-mean latent variables, the authors derive deterministic ordinary differential equations that govern the training dynamics in the high-dimensional limit. Their findings reveal that low-rank correlations can enhance learnability by lifting weak directions, while excessively strong correlations can destabilize the recovery process, supported by numerical simulations and experiments on standard datasets.
Low-rank correlations can significantly boost the learnability of GANs, but too much correlation may lead to instability in recovery.
We study a solvable high-dimensional model of generative adversarial network (GAN) training in which a linear generator learns a low-dimensional subspace from data with structured latent covariance. Prior solvable GAN analyses assume unconditional signals with diagonal latent covariance; we extend the multi-feature discriminator setting to class-dependent, correlated, and non-zero-mean latent structure. For the quadratic energy discriminator, all such heterogeneity enters the dynamics through a probability-weighted effective second moment. We prove that the stochastic microscopic training process converges, in the high-dimensional limit, to deterministic ordinary differential equations governed by this effective covariance. In the matched-covariance specialization, the stability analysis yields a mode-wise solvable interval determined by the learning rates and noise level: learning begins when the leading effective eigenvalue crosses the lower threshold, while full recovery requires all relevant effective modes to remain within the interval. This reveals a signal-boosting mechanism: low-rank correlations can lift weak directions above the learnability threshold, whereas overly strong correlations destabilize recovery. Numerical simulations validate the ODE, phase boundary, and boosting mechanism. Experiments on MNIST, FashionMNIST, and CIFAR-10 further show that informed generator covariance improves alignment with the data-driven reference subspace.
