Search papers, labs, and topics across Lattice.
This paper introduces a hierarchical architecture that integrates a pretrained large language model (LLM) as a strategic controller with specialized reinforcement learning (RL) policies for executing coordinated actions in multi-agent environments. By evaluating this hybrid system in a competitive 2v2 King of the Hill setting, the authors show that the LLM+RL approach achieves performance comparable to behavior tree baselines while significantly outperforming traditional flat RL methods. User studies indicate that participants perceive the LLM+RL agents as more human-like, highlighting the effectiveness of LLM reasoning in orchestrating RL skills for enhanced adaptability and tactical variability.
LLMs can effectively coordinate multi-agent strategies, achieving human-like adaptability without manual rule crafting.
Reinforcement learning (RL) has achieved strong performance in sequential decision-making, yet scaling to complex multi-agent environments remains challenging due to sparse rewards, large state-action spaces, and the difficulty of learning coordinated strategies. We propose a hierarchical architecture where a pretrained large language model (LLM) acts as a centralized strategic controller that selects among specialized RL skill policies for a team of agents, while RL policies handle reactive low-level execution. We evaluate this hybrid system in a competitive 2v2 King of the Hill environment against behavior tree (BT) and \emph{``Flat''} RL (end-to-end training without skill decomposition) baselines. The LLM+RL system achieves task performance statistically equivalent to hand-crafted BT (46.4\% vs 51.5\% win rate, $p=0.103$) while both significantly outperform Flat RL trained without skill decomposition. A user study ($n=15$) reveals that 60\% of participants perceive LLM+RL agents as the most human-like ($p=0.027$), citing behavioral adaptability and tactical variability. These results demonstrate that pretrained LLM reasoning can effectively orchestrate pretrained RL skills, achieving competitive multi-agent coordination and superior perceived believability without manual rule engineering.
