Search papers, labs, and topics across Lattice.
This paper investigates the use of Diffusion Maps (DMAP) for dimensionality reduction, comparing it to Isomap and UMAP on a Swiss roll dataset with known isometric coordinates. The authors fit an oracle affine readout to the ground-truth chart for each representation and measure reconstruction error. Results show that Isomap most efficiently recovers the low-dimensional chart, while DMAP requires combining multiple diffusion modes to achieve comparable accuracy, highlighting that DMAP provides a spectral representation rather than a direct charting method.
Diffusion Maps alone fail to directly recover low-dimensional charts, requiring combination of multiple modes, challenging their common perception as a drop-in dimensionality reduction technique.
Diffusion maps (DMAP) are often used as a dimensionality-reduction tool, but more precisely they provide a spectral representation of the intrinsic geometry rather than a complete charting method. To illustrate this distinction, we study a Swiss roll with known isometric coordinates and compare DMAP, Isomap, and UMAP across latent dimensions. For each representation, we fit an oracle affine readout to the ground-truth chart and measure reconstruction error. Isomap most efficiently recovers the low-dimensional chart, UMAP provides an intermediate tradeoff, and DMAP becomes accurate only after combining multiple diffusion modes. Thus the correct chart lies in the span of diffusion coordinates, but standard DMAP do not by themselves identify the appropriate combination.