Search papers, labs, and topics across Lattice.
This position paper argues that cognitive models and AI algorithms offer valuable templates for designing modular language agents, addressing the challenge of effectively combining multiple LLMs for complex tasks. The authors formalize the concept of an "agent template" to specify roles and composition strategies for individual LLMs. They then survey existing language agents, demonstrating how their designs are often rooted in cognitive models or AI algorithms, advocating for the use of these templates to create more effective and interpretable agents.
Cognitive models and classic AI algorithms offer a surprisingly rich source of inspiration for structuring multi-LLM agents, potentially sidestepping ad-hoc designs.
While contemporary large language models (LLMs) are increasingly capable in isolation, there are still many difficult problems that lie beyond the abilities of a single LLM. For such tasks, there is still uncertainty about how best to take many LLMs as parts and combine them into a greater whole. This position paper argues that potential blueprints for designing such modular language agents can be found in the existing literature on cognitive models and artificial intelligence (AI) algorithms. To make this point clear, we formalize the idea of an agent template that specifies roles for individual LLMs and how their functionalities should be composed. We then survey a variety of existing language agents in the literature and highlight their underlying templates derived directly from cognitive models or AI algorithms. By highlighting these designs, we aim to call attention to agent templates inspired by cognitive science and AI as a powerful tool for developing effective, interpretable language agents.
