Search papers, labs, and topics across Lattice.
This paper introduces OASE (Opponent-Aware Selective Evolution), a novel approach for adapting strategies in dynamic multi-agent environments by leveraging historical opponent behavior. Unlike traditional skill-revision methods that fail in evolving contexts, OASE employs paired comparisons to evaluate candidate skills against incumbents, ensuring only those with a significant estimated payoff gain are adopted. Experimental results demonstrate that OASE achieves lower final equilibrium distances in first-price auctions and Cournot competition while significantly reducing unnecessary skill revisions, enhancing both stability and efficiency in agent adaptation.
OASE enables agents to adapt effectively in constantly evolving environments by selecting skill revisions based on historical opponent strategies, rather than outdated references.
Learning to adapt strategies through interaction is a key step toward more general and autonomous LLM agents. Existing approaches typically achieve behavioral adaptation by revising skill libraries. However, in multi-agent environments, opponents may simultaneously update their strategies, causing the environment itself to evolve continuously. Applying skill-revision methods designed for static environments in such settings therefore amounts to updating against an obsolete reference. To address this challenge, we introduce OASE (Opponent-Aware Selective Evolution), which identifies and adopts genuinely beneficial skill revisions in dynamic multi-agent environments. Specifically, OASE conducts paired comparisons between a candidate skill and the incumbent under identical conditions anchored by historical snapshots of opponent strategies, and adopts the candidate only when its estimated payoff gain exceeds an acceptance threshold. We evaluate OASE in two decision-making scenarios: first-price auctions and private-cost Cournot competition. Experimental results show that, compared with a Reflexion-style baseline, OASE achieves a lower final equilibrium distance in both environments while accepting substantially fewer skill revisions, thereby suppressing strategy changes that lack sufficient payoff support. OASE therefore replaces blind updating with evidence-anchored selection, allowing agents to adapt stably and efficiently even as opponents continuously evolve.
