Search papers, labs, and topics across Lattice.
This paper introduces normalized scores for cluster homogeneity and parsimony that quantify the trade-off between informative clustering and fragmentation, addressing a critical gap in existing scalar metrics. By extending the information bottleneck principle and deriving set-matching and pair-based counterparts, the authors provide a unified framework that varies monotonically under cluster refinement. The utility of this framework is demonstrated through feature selection and algorithm comparison, revealing Pareto-optimal solutions that clarify clustering performance.
The new homogeneity-parsimony scores not only unify existing evaluation criteria but also reveal Pareto-optimal clustering solutions that traditional metrics miss.
Scalar metrics are often used to evaluate clusterings against known classes, but they can obscure a fundamental trade-off: clusterings should be informative about class labels while avoiding unnecessary fragmentation. Here we describe normalized scores of cluster homogeneity and parsimony that quantify this trade-off. These scores build on the information bottleneck principle, modified to not reward lossy compression. We show by example and mathematical proof that our definitions of these scores have the intuitive property of varying monotonically under cluster refinement in contrast to related proposals. Extending the information-theoretic framework beyond Shannon entropies, we furthermore derive set-matching and pair-based counterparts of the homogeneity and parsimony scores. These unify commonly used evaluation criteria and show that, in the pair-based setting, the homogeneity-parsimony trade-off recovers the receiver operating characteristic of binary classifiers. We demonstrate the framework's utility for feature selection and algorithm comparison, illustrating how considering scores jointly can clarify clustering operating points and identify Pareto-optimal solutions.
