Search papers, labs, and topics across Lattice.
This paper introduces MuEvo, a novel framework that leverages large language models to evolve ensembles of heuristics for combinatorial optimization problems, addressing the limitations of single-heuristic optimization methods. By integrating Dynamic Component Management and LLM-Driven Co-Evolution, MuEvo allows for adaptive prioritization and coordination of multiple interacting components, enhancing the search process. Experimental results across various optimization domains reveal that MuEvo not only surpasses traditional human-designed frameworks but also outperforms existing multi-component LLM-AHD methods, showcasing its robust effectiveness in heuristic design.
MuEvo not only evolves heuristic ensembles but also dynamically adapts component priorities, leading to superior performance in complex optimization tasks.
Large language model-based automated heuristic design (LLM-AHD) has shown strong potential in discovering effective heuristics for combinatorial optimization problems. However, existing methods primarily optimize a single heuristic, whereas practical optimization frameworks often rely on multiple interacting components. Directly extending single-heuristic methods is challenging because early component selection can overlook components with late potential, while independent evolution ignores inter-component dependencies. We propose MuEvo, an LLM-driven framework for evolving heuristic ensembles under ensemble-level feedback. MuEvo combines Dynamic Component Management, which uses short-budget probing and a reversible lifecycle to revise component priorities throughout the search, with LLM-Driven Co-Evolution, which coordinates component populations through Multi-Ensemble Evaluation, Cross-Component Information Sharing, Relation-Guided Pair Evolution, and Adaptive Budget Allocation. We evaluate MuEvo on selection hyper-heuristics and componentized ant colony optimization across four combinatorial optimization domains. Results show that MuEvo consistently improves human-designed frameworks and outperforms representative multi-component extensions of state-of-the-art LLM-AHD methods, demonstrating its effectiveness across both controller-mediated heuristic pools and functionally differentiated algorithmic components.
