Search papers, labs, and topics across Lattice.
This paper explores the underutilized k-nearest-neighbor (kNN) graph generated by UMAP, revealing its potential for enhanced data sensemaking beyond the typical lower-dimensional embedding. By applying standard graph algorithms such as PageRank, k-core decomposition, and clustering coefficient analysis, the authors demonstrate how these methods can effectively identify representative points, delineate dense regions, and uncover tightly-knit neighborhoods in high-dimensional datasets. The findings, validated through experiments on MNIST and Fashion MNIST, show that these graph-based approaches can compete with or complement existing clustering methods, highlighting the value of the kNN graph in data analysis workflows.
The internal kNN graph of UMAP can reveal critical insights about high-dimensional data that traditional embedding approaches overlook.
While UMAP is widely used for exploring high-dimensional data, typical workflows focus on its lower-dimensional embedding, largely overlooking the rich k-nearest-neighbor (kNN) graph that UMAP constructs internally. This graph encodes the data manifold in its original high-dimensional space, before the distortion that UMAP's 2D projection introduces. We demonstrate the untapped potential of this internal representation, showing how standard graph algorithms applied to this graph enhance data sensemaking: (1) PageRank identifies representative data points, (2) k-core decomposition reveals dense core regions versus sparse periphery, and (3) clustering coefficient detects tight-knit neighborhoods with highly-similar data points. Through quantitative and qualitative evaluation on MNIST and Fashion MNIST, we show that these graph-based analyses are not only practical but also competitive with or complementary to purpose-built methods (e.g., k-medoids for exemplar selection, HDBSCAN for density-based clustering).
Apple ML