Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
To mitigate the ballooning operational costs of expanding tool registries in enterprise LLM agents, this report empirically evaluates the trade-offs of progressive disclosure (just-in-time, lazy-loading of skills into context) against standard static in-context skill loading. Storing exhaustive skill definitions directly in the prompt degrades context efficiency and increases compute overhead as agent capabilities scale. The evaluation reveals that lazy-loading skills not only lowers token costs but actually improves skill-retrieval accuracy, trading off only a marginal degradation in end-to-end latency.
Lazy-loading agent skills on demand doesn't just slash context window costs—it actively sharpens tool retrieval quality, all while incurring only a negligible hit to latency.
Users of Workday's deployed LLM-based agents often request features which can be addressed by defining named procedures, also known as skills, in the LLM context, effectively augmenting agents' capabilities. However, as an agent's skills library grows in size, so does the agent's operational cost. Progressive disclosure (lazy-loading) of skills as needed may reduce operational costs, but its impact on overall latency and skill-retrieval quality remains unclear. In this report, we investigate the impact empirically and find that progressive disclosure improves skill-retrieval quality but marginally degrades overall latency.