Search papers, labs, and topics across Lattice.
This paper investigates the limitations of Large Language Model (LLM) agents in adapting to dynamic real-world scenarios, revealing that their performance significantly deteriorates under distributional shifts in user queries and tool interactions. By formalizing the OpenAgent framework and conducting experiments in a controlled sandbox environment, the authors identify critical vulnerabilities in agents trained through Supervised Fine-Tuning (SFT) and Reinforcement Learning. They introduce Perturbation-Augmented Fine-Tuning, a novel strategy aimed at enhancing agent robustness against these environmental shifts, setting a new direction for improving tool-use agents in open-world contexts.
Agents trained on static benchmarks falter dramatically in open-world settings, revealing a critical gap in their adaptability to real-world complexities.
While Large Language Model (LLM) agents demonstrate proficiency in static benchmarks, their deployment in real-world scenarios is hindered by the dynamic nature of user queries, tool sets, and interaction dynamics. To address this generalization gap, we formalize OpenAgent (Tool-Use Agent in Open-World), a problem setting characterized by distributional shifts across query, action, observation, and domain dimensions. To systematically diagnose its impact, we construct a controlled sandbox environment where we define fine-grained environmental shifts across a four-tier hierarchy, Perception, Interaction, Reasoning, and Internalization, and conduct a comprehensive series of experiments. Our analysis yields a series of key insights, demonstrating that agents trained via both Supervised Fine-Tuning(SFT) and Reinforcement Learning suffer from varying degrees of performance degradation when confronting open environmental shifts. Building on these insights, we propose Perturbation-Augmented Fine-Tuning, a disturbance-based intervention strategy for SFT that lays the foundation for enhancing agent robustness and utility in realistic environments. Our code will be released at: https://github. com/LAMDA-NeSy/OpenAgent.
