Search papers, labs, and topics across Lattice.
CausalEvolve is introduced to improve the efficiency of LLM-based evolve agents in open-ended scientific discovery by incorporating a causal scratchpad. This scratchpad uses LLMs to identify outcome-level factors and surprise patterns during evolution to guide the search process. Experiments across four challenging tasks demonstrate that CausalEvolve enhances evolutionary efficiency and discovers superior solutions compared to existing evolve-based agents.
LLMs can be guided to discover better solutions in open-ended scientific tasks by identifying and reasoning about causal factors that influence the evolutionary process.
Evolve-based agent such as AlphaEvolve is one of the notable successes in using Large Language Models (LLMs) to build AI Scientists. These agents tackle open-ended scientific problems by iteratively improving and evolving programs, leveraging the prior knowledge and reasoning capabilities of LLMs. Despite the success, existing evolve-based agents lack targeted guidance for evolution and effective mechanisms for organizing and utilizing knowledge acquired from past evolutionary experience. Consequently, they suffer from decreasing evolution efficiency and exhibit oscillatory behavior when approaching known performance boundaries. To mitigate the gap, we develop CausalEvolve, equipped with a causal scratchpad that leverages LLMs to identify and reason about guiding factors for evolution. At the beginning, CausalEvolve first identifies outcome-level factors that offer complementary inspirations in improving the target objective. During the evolution, CausalEvolve also inspects surprise patterns during the evolution and abductive reasoning to hypothesize new factors, which in turn offer novel directions. Through comprehensive experiments, we show that CausalEvolve effectively improves the evolutionary efficiency and discovers better solutions in 4 challenging open-ended scientific tasks.
