Search papers, labs, and topics across Lattice.
This study re-evaluates unsupervised term discovery by contrasting traditional centre-based clustering methods, such as K-means, with graph-based clustering techniques using the Leiden algorithm. The authors demonstrate that graph clustering significantly enhances the recovery of Zipfian distributions in lexicon discovery for both word and syllable units across three languages, outperforming K-means and other centre-based approaches. These findings challenge the prevailing reliance on centre-based methods and advocate for graph clustering as a superior alternative in this domain.
Graph-based clustering can recover Zipfian distributions in unsupervised term discovery, outperforming traditional K-means methods.
Unsupervised term discovery involves segmenting unlabelled speech into word- or syllable-like units and clustering these into a lexicon of candidate types. True lexicons follow a Zipfian distribution, yet the dominant centre-based clustering approach -- K-means -- produces a more uniform distribution due to an inductive bias toward spherical clusters. In this paper we revisit graph-based clustering as a bottom-up alternative, where segment embeddings are connected by pairwise similarity and partitioned using the Leiden algorithm. We show that graph clustering substantially outperforms centre-based approaches (K-means, GMM, BIRCH) in both word- and syllable-level lexicon discovery across three languages, producing more Zipf-like distributions. Another bottom-up approach, agglomerative clustering with average linkage, also performs well, although it is computationally less efficient and allows for less control over the resulting distribution. Our work calls into question the dominance of centre-based clustering for term discovery, and promotes graph clustering as an attractive alternative.
