Search papers, labs, and topics across Lattice.
This study evaluates the generalization capabilities of Algorithm Selection (AS) models across synthetic and real-world optimization tasks, specifically using two academic benchmark suites and two practical problem sets. By conducting a systematic cross-benchmark analysis, the researchers identify the conditions under which AS models successfully transfer between domains and where they fail to generalize. The findings reveal critical insights into the robustness of existing AS approaches, highlighting the challenges faced in applying these models to realistic, domain-specific scenarios.
AS models struggle to generalize across domains, revealing significant gaps in their reliability for real-world applications.
Algorithm Selection (AS) aims to automatically identify the most suitable optimization algorithm for a given problem instance by leveraging measurable problem characteristics and historical performance data. In this study, we investigate the generalization ability of AS models across both synthetic and real-world optimization landscapes. We consider two widely used academic benchmark suites (BBOB and CEC) and two real-world problem sets (robotics trajectory optimization tasks and unmanned aerial vehicle path-planning problems). Through a systematic cross-benchmark evaluation, we analyze how AS models transfer between domains, identify where generalization succeeds or breaks down, and highlight the challenges that arise when applying AS in realistic, domain-specific contexts. Our findings provide insights into the robustness of current AS approaches and inform the development of more reliable, broadly applicable AS systems for real-world optimization.
