Search papers, labs, and topics across Lattice.
This paper analyzes Generative Modeling via Drifting (GMD) through the lens of Wasserstein Gradient Flows (WGF), showing that GMD algorithms can be interpreted as targeting fixed points of specific WGFs. It demonstrates that one GMD algorithm approximates the fixed point of a WGF on KL divergence with Parzen smoothing, while the implemented algorithm resembles a WGF on Sinkhorn divergence but lacks its properties. The authors further extend the GMD idea to other WGFs like MMD, sliced Wasserstein distance, and GAN critic functions.
GMD algorithms, previously seen as a novel generative framework, can be understood as directly targeting fixed points of Wasserstein Gradient Flows, offering a new perspective on their optimization process.
Recently, Deng et al. (2026) proposed Generative Modeling via Drifting (GMD), a novel framework for generative tasks. This note presents an analysis of GMD through the lens of Wasserstein Gradient Flows (WGF), i.e., the path of steepest descent for a functional in the space of probability measures, equipped with the geometry of optimal transport. Unlike previous WGF-based contributions, GMD can be thought of as directly targeting a fixed point of a specific WGF flow. We demonstrate three main results: first, that one algorithm proposed by Deng et al. (2026) corresponds to finding the limiting point of a WGF on the KL divergence, with Parzen smoothing on the densities. Second, that the algorithm actually implemented by Deng et al. (2026) corresponds to a different procedure, which bears some resemblance to the fixed point of a WGF on the Sinkhorn divergence, but lacks certain desirable properties of the latter. Third, the same same idea can be extended to the limiting point of other WGFs, including the Maximum Mean Discrepancy (MMD), the sliced Wasserstein distance, and GAN critic functions.
