Search papers, labs, and topics across Lattice.
This paper introduces FormuEvo, an LLM-guided evolutionary framework that enhances the discovery of solver-efficient mixed-integer programming (MIP) formulations by framing formulation design as an evolutionary optimization problem. By leveraging LLM-driven operations such as crossover, mutation, and repair, along with a solver-informed diagnosis mechanism, FormuEvo effectively refines MIP formulations based on fine-grained solver statistics. Experimental results show that FormuEvo significantly outperforms both expert-designed formulations and existing LLM-based methods, achieving up to a 5.5脳 acceleration in solver performance across various problem types.
FormuEvo can accelerate solver performance by up to 5.5脳 by intelligently evolving MIP formulations through LLM-guided optimization.
Mixed-integer programming (MIP) lies at the core of operations research and industrial optimization. While large language models (LLMs) have recently shown promise in automated MIP modeling from natural language, they prioritize semantic correctness but overlook formulation strength, severely bottlenecking the efficiency of downstream solvers. We propose FormuEvo, an LLM-guided evolutionary framework for automated discovery of solver-efficient MIP formulations. FormuEvo frames MIP formulation design as evolutionary optimization over the symbolic space of MIP formulations, represented as executable modeling programs, by iteratively generating, evaluating, and selecting stronger candidates via LLM-driven crossover, mutation, and repair operations. To move beyond blind exploration, FormuEvo introduces a solver-informed diagnosis mechanism that exploits fine-grained solver statistics as verbal gradients for targeted refinement. Additionally, a structured memory abstracts prior experience into reusable modeling strategies, avoiding redundant exploration while enabling zero-shot transfer to unseen problems and bootstrapping smaller LLMs. Experiments across diverse linear and non-linear problems demonstrate that FormuEvo discovers formulations that significantly outperform both expert-designed formulations and existing LLM-based approaches, accelerating solvers by up to 5.5$\times$, with distilled knowledge transferring effectively across problems and model scales.
Tsinghua AI