Search papers, labs, and topics across Lattice.
This paper introduces CurateEvo, a dynamic evolution framework for data curation in agentic post-training of large language model agents, addressing the limitations of traditional fixed preprocessing methods. By treating the curation strategy as executable code, CurateEvo iteratively refines data based on failed trajectories, enhancing both the effectiveness and efficiency of the training process. Experimental results on multiple benchmarks reveal that CurateEvo outperforms existing methods, achieving average score improvements of 3.2 and 2.7 points, while also reducing curation overhead.
CurateEvo transforms data curation from a static process into a dynamic, failure-driven evolution, significantly boosting performance and efficiency in LLM training.
Large language model (LLM) agents require post-training methods that can improve long-horizon decision making from environment feedback. However, existing agentic post-training pipelines often treat data curation as a fixed preprocessing step, focusing mainly on data augmentation while neglecting filtering, refinement, and adaptation to downstream failures. We propose CurateEvo, a failure-driven dynamic evolution framework for agentic post-training data curation. CurateEvo represents the curation strategy as executable code and iteratively rewrites it using failed trajectories from a held-out development set. At each epoch, the evolved strategy transforms a fixed raw corpus into supervised fine-tuning data, reinforcement learning data, and an inference-time memory bank. The evolution process first improves effectiveness by diagnosing recurring failure modes and augmenting, filtering, or refining data accordingly, and then improves efficiency by pruning redundant or low-utility training turns under a cost-aware objective. Experiments on ACEBench-Agent, BFCL-V4, and {\tau}^2-Bench under both labeled and wild-data settings show that CurateEvo consistently outperforms prior curation methods, improving average scores by 3.2 and 2.7 points, respectively. Further analyses demonstrate that CurateEvo is compatible with different post-training recipes and substantially reduces curation overhead.
