Search papers, labs, and topics across Lattice.
This paper quantifies the intelligence of agentic systems by applying the principle that "compression is intelligence," demonstrating that stronger agentic systems can reconstruct target objects with fewer bits under fixed constraints. Through a series of experiments involving reversed text, chess moves, protein sequences, retrieval-augmented question answering, and semantic story compression, the authors show that the incorporation of agentic components consistently reduces codelength. These findings provide a novel analytical framework for evaluating the efficiency of agentic systems and their components in managing uncertainty.
Agentic systems can reconstruct complex tasks with significantly less information, revealing a new metric for measuring their intelligence.
Large language models are turning from isolated predictors into agentic systems: they call tools, retrieve evidence, obey environment constraints, use verifiers, and complete tasks through search and multi-turn interaction. We adopts an analytical viewpoint based on "compression is intelligence": under a fixed task distribution, interface, and compute budget, a stronger agentic system lets a target object be reconstructed with fewer bits. We operationalize the measure with arithmetic coding, seed coding, and a fallback, and evaluate it in five settings: reversed text, chess moves, protein sequences, retrieval-augmented question answering, and semantic story compression; in all of them agentic components reduce codelength. These small, controlled experiments cover component types typical of real agentic systems, show that codelength can analyze how components, observers, and budgets change residual uncertainty, and offer guidance for evaluating real agent systems.
