Search papers, labs, and topics across Lattice.
This paper explores an unsupervised approach to algorithm selection in black-box optimization using multi-kernel clustering, which circumvents the limitations of supervised models that require performance labels. By leveraging a multi-kernel k-means formulation, the authors group problem instances based on heterogeneous landscape representations and subsequently map these clusters to solver recommendations. The results indicate that this method achieves superior performance in selector tasks for Differential Evolution and remains competitive for Particle Swarm Optimization, highlighting the potential for task-specific insights into landscape representation efficacy.
Unsupervised multi-kernel clustering outperforms traditional supervised models in algorithm selection, revealing which landscape representations truly matter for optimization tasks.
Automated algorithm selection in black-box optimization typically relies on supervised models that map landscape features to algorithm performance labels. Such models are costly to train, benchmark-dependent, and often fail to generalize to unseen problem classes. We study an unsupervised alternative: multi-kernel clustering over heterogeneous landscape representations, in which problem instances are grouped without using performance labels in the clustering stage, and the resulting clusters are mapped post hoc to solver recommendations through a strictly separated three-stage evaluation protocol. Drawing on two decades of advances in multiple kernel learning, we adopt a multi-kernel k-means formulation that jointly learns cluster assignments and kernel weights over four heterogeneous landscape views: ELA, DeepELA, DoE2Vec, and TransOptAS. On affine BBOB-derived selector tasks for Differential Evolution (DE) and Particle Swarm Optimization (PSO) at a fixed evaluation budget, we report mean plus or minus standard deviation selector profiles over 50 independent random seeds for stochastic configurations. Multi-kernel clustering obtains the strongest mean profile on the DE portfolio and remains competitive with, and nominally ahead of, the leading baselines on the more compressed PSO portfolio, where differences among the best methods are small relative to stochastic variation. In representative median-seed runs used for visualization, the learned kernel weights retain ELA and TransOptAS while assigning zero weight to DeepELA and DoE2Vec, providing a task-specific interpretation of which representations are retained by the multi-kernel model for selector-oriented grouping.
