Search papers, labs, and topics across Lattice.
This paper conducts a comprehensive survey of agentic environments for large language models (LLMs), analyzing their modeling, synthesis, evaluation, and application across various domains. By categorizing environments based on eight attributes and exploring two paradigms for automated environment synthesis鈥攕ymbolic and neural鈥攖he authors highlight the evolution of agent capabilities in dynamic contexts. Key findings reveal distinct pathways for agent evolution and propose future directions such as Environment-as-a-Service and Multi-agent Environments, which could significantly enhance LLM interactions with their environments.
Agentic environments are not just backdrops for LLMs; they are pivotal in shaping agent evolution and capabilities.
Environments serve as interactive systems for large language model (LLM) based agents across diverse scenarios and play a crucial role in driving the continual evolution of model capabilities. Despite this importance, existing work lacks a systematic categorization and deep analysis. This paper systematically studies current researches on agentic environments from the perspective of the environment engineering lifecycle, covering their modeling, synthesis, evaluation and application. Specifically, the paper first introduces representative environments from the perspectives of eight attributes and eight domains, providing detailed analyses of their development paths and highlighting their core capabilities. Second, for automated environment synthesis, two paradigms are introduced, such as symbolic synthesis and neural synthesis. This paper also shows different environment evaluation methods in each paradigm. Thirdly, the corresponding environment applications from the perspective of agent-environment co-evolution are discussed. In specific, the paper characterizes the primary pathways for agent evolution in dynamic environments from four complementary perspectives: memory-centric experience evolution, orchestration-centric workflow evolution, trajectory-centric offline evolution, and exploration-centric online evolution. And three paradigms of environment evolution are identified, namely neural-driven, difficulty-driven, and scaling-driven approaches. At last, several promising future directions are discussed, including Environment-as-a-Service, Multi-agent Environments, and Neural-Symbolic Environments.
