Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper analyzes diffusion models using Gaussian distributions to understand their advantage over classical score-based samplers. It derives sharp 2-Wasserstein convergence bounds showing diffusion processes achieve $O(\sqrt{d\lambda_{\max}}\log N/N)$ sampling error, outperforming Langevin dynamics by avoiding a $\sqrt\kappa$ factor dependent on the target covariance's condition number. The analysis attributes this improvement to time-dependent score trajectories, suggesting the benefits arise during sampling, not the learning phase.
Diffusion models bypass Langevin's condition-number bottleneck by leveraging time-dependent score trajectories, achieving sampling error independent of target covariance ill-conditioning.
Despite their empirical success, why diffusion models overcome the bottlenecks of classical score-based samplers remains unclear. In this work, we leverage Gaussian distributions to isolate this phenomenon. We establish 2-Wasserstein convergence bounds for optimized hyperparameters, showing that diffusion processes achieve a sampling error of $O(\sqrt{d\lambda_{\max}}\log N/N)$, where $d$ is the dimension, $N$ the number of sampling steps, and $\lambda_{\max}$ the largest eigenvalue of the target covariance matrix. Unadjusted and underdamped Langevin dynamics suffer from an additional $\sqrt\kappa$ factor, where $\kappa$ is the condition number. These rates follow from spectral bounds which are sharp: we confirm them via matching first-order asymptotics as $N\rightarrow\infty$. Our analysis provides a rigorous characterization, in the Gaussian setting, of how time-dependent score trajectories remove condition-number dependence during sampling. By contrast, in the learning phase, we show that estimating the unnoised score by gradient descent leads to essentially the same estimator as estimating a noisy score, which suggests that the benefits of noising do not come from the learning phase.