Search papers, labs, and topics across Lattice.
This paper introduces Unified Context Evolution (UCE), a novel framework that enhances LLM-based agents' ability to learn and adapt by externalizing their experiences into a dynamic library of Evolvable Context Units (ECUs). By categorizing experiences into four distinct types鈥擬emory, Strategy, Workflow, and Skill鈥攁nd employing a scheduling module to optimize learning, UCE significantly improves task performance across multiple benchmarks. The results show a marked increase in success rates, with ALFWorld performance rising from 75.4% to 96.3% and WebShop scores increasing from 45.1% to 61.3%, demonstrating the framework's effectiveness in knowledge retention and transferability.
UCE enables LLM agents to evolve their knowledge dynamically, achieving a staggering 96.3% success rate in complex tasks by leveraging a structured experience library.
LLM-based agents can solve multi-step interactive tasks by combining reasoning with environment feedback, yet each episode starts from the same fixed context and any useful strategy discovered along the way is lost once the task ends. Existing approaches either limit learning to the current task or pool all experience into a single untyped store, without distinguishing knowledge types, tracking quality through use, or balancing what the library still lacks. We introduce Unified Context Evolution (UCE), a gradient-free framework that externalizes agent experience into an evolving library of typed Evolvable Context Units (ECUs). UCE decomposes experience into four complementary types (Memory, Strategy, Workflow, and Skill), each generated from trajectories under type-specific conditions, retrieved at decision time, scored through repeated usage outcomes, and pruned when no longer valuable. A scheduling module allocates each cycle's generation budget toward the types where the library is weakest. Across two interactive benchmarks, UCE raises ALFWorld success from 75.4% to 96.3% and WebShop task score from 45.1% to 61.3%, and the accumulated library transfers to alternative actor backbones without retraining.
NUS