Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper introduces FOSC-X, a novel framework designed to extract the top-M globally optimal flat clusterings from hierarchical clustering trees while allowing for constraints on the number of clusters. This approach leverages dynamic programming to efficiently combine locally optimal solutions from subtrees, ensuring that the resulting clusterings are both diverse and relevant to specific application needs. Experimental results demonstrate that FOSC-X outperforms traditional single-solution methods by revealing multiple high-quality clustering alternatives that capture different aspects of the data's hierarchical structure.
FOSC-X reveals multiple optimal clusterings from hierarchical data, transforming how we extract insights from complex clustering hierarchies.
Extracting a flat clustering solution from a hierarchy is a common task in practical cluster analysis and can be formulated as an optimisation problem. Existing approaches focus on finding a single optimal solution. We introduce FOSC-X, a framework for extracting the top-M globally optimal flat clusterings from local, non-horizontal cuts of a hierarchical cluster tree, while optionally enforcing constraints on the number of clusters. This enables automatic identification of multiple high-quality alternative clusterings that capture different aspects of the hierarchical structure. Without constraints, the top-M problem can be solved in polynomial time using dynamic programming, exploiting the property that locally optimal partial candidates within subtrees can be combined to form globally optimal solutions while automatically determining the number of clusters. However, this can lead to solutions with numbers of clusters that are ultimately undesirable -- e.g., too large to be meaningful or practically analysed within a particular application domain. Imposing cluster-count constraints breaks the optimality property underlying the unconstrained dynamic programming approach, since locally optimal partial candidates may no longer combine into feasible globally optimal solutions. FOSC-X addresses this challenge through a dynamic programming strategy that maintains compact sets of feasible candidates using lower and upper feasibility bounds while pruning infeasible or dominated combinations. The resulting method guarantees optimal rankings of the top-M solutions with linear-time complexity in the number of cluster nodes and dataset size, both with and without cluster-count constraints. Experiments show that FOSC-X efficiently reveals alternative clustering structures overlooked by single-solution extraction methods.