Search papers, labs, and topics across Lattice.
EvoDuet addresses LLM evolutionary search stagnation by co-evolving task solutions and web search queries using a bilevel optimization framework with fixed model parameters. A retrieval gate dynamically decides whether to fetch new documents, reuse existing ones, or proceed without external knowledge, guided by an inner loop that refines queries and predicts document utility. This approach significantly boosts discovery gain on scientific tasks, outperforming baseline methods and achieving new state-of-the-art results on several benchmarks.
LLMs can overcome knowledge gaps in evolutionary search by dynamically co-evolving solutions and targeted web queries, leading to substantial gains in scientific discovery.
Evolutionary search with large language models (LLMs) can stall when progress requires external knowledge the model lacks. Supplying relevant documents helps, but simply adding web search tool can keep returning the same pages as solutions change. We introduce EvoDuet, a bi-level optimization method that co-evolves solutions and search queries with fixed model parameters. At each iteration, a retrieval gate lets the LLM assess its knowledge gap and choose to retrieve new documents, reuse stored ones, or proceed without them. An inner loop refines queries and ranks documents by the solution scores they are predicted to yield; an outer loop generates candidates in parallel from these documents and records the evaluated outcomes for later searches. Across 21 optimization tasks with one candidate per iteration, EvoDuet raises OpenEvolve's normalized discovery gain from 74.1% to 78.0% with GPT-5.6-Luna and from 61.3% to 82.3% with Gemini-3.8-Flash, whereas Qwen3.5-9B does not benefit. Our best runs surpass the previously reported best scores on eight tasks, including Swap Reduction on Q20 and Rosetta, and match them on three more. EvoDuet also improves with other scaffolds (e.g., Top-K, EvoX) on Sums/Diffs and Denoising, demonstrating its applicability across evolutionary search scaffolds.