Search papers, labs, and topics across Lattice.
This study investigates the effectiveness of progressive disclosure in LLM-maintained knowledge bases by conducting a preregistered ablation on a 709-page markdown wiki. Contrary to expectations, the results reveal that a capable tool-using agent does not benefit from the intended cost savings of progressive disclosure, as it infers content paths directly from questions rather than loading the index. Nevertheless, the retrieval method maintains answer quality comparable to the baseline while achieving significant cost reductions, with savings ranging from one-third to over half depending on the access regime employed.
A capable LLM agent can achieve significant cost savings by directly inferring content paths, rendering traditional index loading unnecessary.
LLM agents increasingly answer questions against knowledge bases they help maintain. A common intuition holds that progressive disclosure, a compact catalog plus a one-line summary per page so the agent loads only what it needs, should make this cheaper than consulting a large monolithic index. We test that on a real 709-page markdown wiki maintained by an LLM. We retrofit it for progressive disclosure and run a preregistered ablation in which four versions of the corpus differ only in how the agent reaches the content: page bodies are byte-identical across arms, frozen as immutable git tags, so any measured difference is due to access structure alone. We cross the arms with three access conditions (a protocol-constrained agent, a free self-routing agent, and a catalog-preload regime) and grade answers blind against verified gold references with a cross-family judge. A pilot upended the premise: a capable tool-using agent never loads the index, inferring a page's path from the question and reading it directly, so the specific saving the retrofit targets does not materialize. We therefore made answer quality primary and cost secondary. Quality is non-inferior (the retrieval arm matches the index baseline within the preregistered margin) while cost falls in every regime, from about a third for a self-routing agent to well over half under catalog-preload, all confidence intervals excluding zero. The saving comes not from avoiding the index load but from more targeted access: the retrieval arm cites fewer pages and takes fewer tool turns. The study doubles as a case study in evaluation validity, applying threat-to-validity discipline to the tooling that produced it.
