Search papers, labs, and topics across Lattice.
The paper introduces Manifold-Aligned Generative Transport (MAGT), a flow-like generative model that learns a one-shot transport from a low-dimensional base distribution to the data manifold. MAGT addresses the trade-off between support fidelity and sampling efficiency by training at a fixed Gaussian smoothing level, ensuring a well-defined and stable score. By approximating the fixed-level score using latent anchor points and self-normalized importance sampling, MAGT achieves single-pass sampling, high support fidelity, and principled likelihood evaluation.
Ditch slow diffusion models: MAGT offers faster, single-pass generative sampling with better support fidelity by learning a manifold-aligned transport.
High-dimensional generative modeling is fundamentally a manifold-learning problem: real data concentrate near a low-dimensional structure embedded in the ambient space. Effective generators must therefore balance support fidelity -- placing probability mass near the data manifold -- with sampling efficiency. Diffusion models often capture near-manifold structure but require many iterative denoising steps and can leak off-support; normalizing flows sample in one pass but are limited by invertibility and dimension preservation. We propose MAGT (Manifold-Aligned Generative Transport), a flow-like generator that learns a one-shot, manifold-aligned transport from a low-dimensional base distribution to the data space. Training is performed at a fixed Gaussian smoothing level, where the score is well-defined and numerically stable. We approximate this fixed-level score using a finite set of latent anchor points with self-normalized importance sampling, yielding a tractable objective. MAGT samples in a single forward pass, concentrates probability near the learned support, and induces an intrinsic density with respect to the manifold volume measure, enabling principled likelihood evaluation for generated samples. We establish finite-sample Wasserstein bounds linking smoothing level and score-approximation accuracy to generative fidelity, and empirically improve fidelity and manifold concentration across synthetic and benchmark datasets while sampling substantially faster than diffusion models.
