Search papers, labs, and topics across Lattice.
This paper introduces Role-Agent, a novel framework that enables Large Language Model (LLM) agents to evolve through a dual-role mechanism where the LLM simultaneously acts as both the agent and the environment. By implementing two components鈥擶orld-In-Agent (WIA) for predicting future states and Agent-In-World (AIW) for analyzing failure modes鈥攖he framework enhances interaction feedback and promotes environment-aware reasoning. Experimental results demonstrate that Role-Agent achieves an average performance improvement of over 4% across various benchmarks compared to strong baselines, highlighting its effectiveness in fostering broader generalization in LLMs.
Bootstrapping LLM agents to co-evolve as both agent and environment can lead to significant performance gains, with an average improvement of over 4% on complex tasks.
Although Large Language Model (LLM) agents have demonstrated strong performance on complex tasks, their learning is often limited by inefficient interaction feedback and static training environments, which hinder broader generalization. To address these limitations, this paper introduces Role-Agent, black{a framework} that harnesses a single LLM to function concurrently as both the agent and the environment, enabling a bootstrapped co-evolution. Role-Agent comprises two synergistic components: World-In-Agent (WIA) and Agent-In-World (AIW). In WIA, the LLM acts as the agent and predicts future states after each action; the alignment between predicted and actual states is then used as a process reward, encouraging environment-aware reasoning. In AIW, the LLM analyzes failure modes from failed trajectories and retrieves tasks with similar failure patterns, thereby reshaping the training data distribution for targeted practice. Experiments on multiple benchmarks show that Role-Agent consistently improves performance, yielding an average gain of over 4\% over strong baselines.
DAMO