Search papers, labs, and topics across Lattice.
This paper presents GRIMIP, a hybrid framework that combines Large Language Models (LLMs) with Bayesian Optimization (BO) to optimize the hyperparameters of Mixed-Integer Programming (MIP) solvers in an instance-specific manner. By allowing LLMs to act as probabilistic surrogates within the BO loop, GRIMIP significantly enhances the efficiency of hyperparameter tuning, addressing the limitations of traditional methods that struggle with cold starts and expert dependency. The results show that GRIMIP achieves over a 40% reduction in Primal-Dual Integral on challenging benchmarks, outperforming existing LLM-assisted BO techniques like SMAC.
GRIMIP reduces MIP solver tuning costs by over 40% on hard instances, leveraging LLMs for expert-level reasoning in hyperparameter optimization.
Configuring the hyperparameters of Mixed-integer programming (MIP) solvers is a high-dimensional, instance-dependent optimization problem where suboptimal settings can degrade solving time by orders of magnitude. Default configurations are often suboptimal, while traditional tuning methods either suffer from the ``cold-start'' problem and inefficient search or heavily rely on expert experience. This paper introduces \textbf{GRIMIP} (\textbf{\underline{G}}eneral \textbf{\underline{R}}easoning for \textbf{\underline{I}}nstance-specific \textbf{\underline{MIP}} configuration), a novel hybrid intelligence framework that synergistically integrates the semantic reasoning capabilities of Large Language Models (LLMs) with the sample-efficient search of Bayesian Optimization (BO). GRIMIP enables the LLM to function as a complete probabilistic surrogate within the BO loop, significantly improving performance and reducing sampling and evaluation costs. On seven benchmarks including MIPLIB, GRIMIP achieves over 40\% reduction in Primal-Dual Integral on hard instances, outperforming SMAC and other LLM-assisted BO methods. By granting LLMs sufficient autonomy, GRIMIP combines the expert-level reasoning of LLMs with the efficient search of BO, achieving state-of-the-art performance.
