Search papers, labs, and topics across Lattice.
This paper introduces 3CPO, a novel clustering algorithm specifically designed for count data, leveraging Poisson and negative binomial distributions to enhance clustering accuracy and interpretability. By maximizing posterior probability through a simple iterative approach, 3CPO not only generates reliable cluster labels but also identifies relevant features, addressing the shortcomings of generic clustering methods. Extensive experiments across diverse domains, including gene expression and economic data, validate its effectiveness in producing high-quality clusters within meaningful subspaces.
Clustering count data just got a major upgrade with 3CPO, which not only delivers reliable clusters but also highlights the most relevant features for enhanced interpretability.
Count data represented as a matrix of non-negative integer values, such as contingency tables, are prevalent across diverse domains. When clustering such data sets, specific methods are required, as generic algorithms often fail to consider their unique distributional properties, leading to unreliable outputs. An effective strategy is to use well-established statistical models such as the Poisson and negative binomial distributions. We present 3CPO, a clustering algorithm based on statistically solid modeling of count data. In addition to the cluster labels, it identifies a subset of relevant columns, enhancing the interpretability of the results. We propose a simple iterative algorithm that maximizes the posterior probability to find good clustering solutions and discuss its properties. Extensive experiments demonstrate its ability to define high-quality clusters within associated subspaces for various data domains, ranging from gene expressions and texts to economics. Our findings suggest that 3CPO is a robust solution for clustering count data in a statistically sound and interpretable manner. Our code is available at https://github.com/collinleiber/3CPO.
