Search papers, labs, and topics across Lattice.
The paper investigates the use of transport-based generative models in a lower-dimensional latent space for fast sampling of stochastic closure models, addressing the slow sampling issue of diffusion models. It compares implicit regularization with metric-preserving (MP) and geometry-aware (GA) constraints to control latent space distortion and ensure physical fidelity. Results demonstrate that flow matching in a regularized latent space achieves up to two orders of magnitude faster single-step sampling compared to iterative diffusion models, while preserving key topological information and reducing training data requirements.
Ditch slow diffusion models: flow matching in a learned latent space slashes stochastic closure model sampling time by 100x while preserving physical fidelity.
Diffusion models recently developed for generative AI tasks can produce high-quality samples while still maintaining diversity among samples to promote mode coverage, providing a promising path for learning stochastic closure models. Compared to other types of generative AI models, such as GANs and VAEs, the sampling speed is known as a key disadvantage of diffusion models. By systematically comparing transport-based generative models on a numerical example of 2D Kolmogorov flows, we show that flow matching in a lower-dimensional latent space is suited for fast sampling of stochastic closure models, enabling single-step sampling that is up to two orders of magnitude faster than iterative diffusion-based approaches. To control the latent space distortion and thus ensure the physical fidelity of the sampled closure term, we compare the implicit regularization offered by a joint training scheme against two explicit regularizers: metric-preserving (MP) and geometry-aware (GA) constraints. Besides offering a faster sampling speed, both explicitly and implicitly regularized latent spaces inherit the key topological information from the lower-dimensional manifold of the original complex dynamical system, which enables the learning of stochastic closure models without demanding a huge amount of training data.
