Search papers, labs, and topics across Lattice.
The Intrinsic Hybrid Latent Diffusion Model (ILDM) integrates probabilistic dimensionality reduction with geometry-aware diffusion to effectively model generative processes on unknown manifolds. By interpreting the latent space as a chart of an unknown Riemannian manifold, ILDM captures intrinsic geometric structures that traditional latent diffusion models overlook, particularly in data-sparse scenarios. Experimental results on COIL-100, MNIST, and cardiac MRI datasets show that ILDM achieves superior generation quality, evidenced by lower FID and LPIPS scores compared to existing diffusion models.
ILDM outperforms traditional diffusion models by leveraging Riemannian geometry, achieving unprecedented generative quality in data-sparse environments.
We introduce the Intrinsic Hybrid Latent Diffusion Model (ILDM), a generative framework that integrates probabilistic dimensionality reduction with geometry-aware diffusion on unknown manifolds. While diffusion models (DMs) have achieved state-of-the-art results in high-dimensional data synthesis, they rely on large training datasets and ignore intrinsic geometric structure. Latent diffusion models (LDMs) address the high dimensionality by learning a latent space, but they typically impose a Euclidean structure, failing to capture the underlying manifold geometry, especially problematic in data-sparse regimes. ILDM addresses these limitations by interpreting the latent space as a chart of an unknown Riemannian manifold, with geometry and uncertainty quantified through a probabilistic decoder. The forward process is a hybrid diffusion that switches between Riemannian and Euclidean dynamics based on local uncertainty, where the Riemannian component is governed by a probabilistic metric tensor derived from the decoder. To learn the generative dynamics, we introduce an approximate denoising score matching method tailored to the hybrid diffusion setting, enabling a backward process defined by hybrid Langevin dynamics. Experiments on COIL-100, MNIST, and cardiac MRI datasets demonstrate that ILDM significantly improves generation quality, achieving lower FID and LPIPS scores compared to standard diffusion and latent diffusion models.
