Search papers, labs, and topics across Lattice.
This paper redefines capability discovery in agent ecosystems by introducing an offline enrichment step that transforms sparse metadata into searchable profiles, paired with an online retrieve-then-rank mechanism. The authors demonstrate that while in-context routing's accuracy significantly deteriorates as the number of capabilities increases, the retrieve-then-rank approach maintains a more stable performance, achieving a Match@1 accuracy of 0.39 compared to 0.12 for in-context routing at larger scales. Additionally, this new pipeline outperforms traditional methods by 6.5 percentage points in accuracy while reducing costs by 70 times, making it the default capability-discovery layer for a large-scale multi-agent platform.
In a world of rapidly expanding agent capabilities, a new retrieval-based approach keeps accuracy high and costs low, outperforming traditional methods by a significant margin.
Agent ecosystems now include thousands of MATS components (Models, Agents, Tools, and Skills), yet their discovery still relies on in-context routing. These systems read a registry (names, hints, or descriptions, as context budget permits), pick a candidate, invoke it, and retry on failure. This pattern degrades with scale, and registries are growing fast. We recast capability discovery as search over a registry by defining an offline enrichment step that turns sparse metadata into searchable profiles, and an online retrieve-then-rank pipeline that returns a ranked shortlist without invoking any candidates online. We show that from N=10 to 7,278 capabilities, in-context routing's top-1 accuracy (Match@1) collapses (0.85 to 0.12), while retrieve-then-rank degrades more gently (0.81 to 0.39) because its reranker still ranks the right capability first 0.70-0.87 of the time once retrieval finds it. In the Nova Micro sweep, the crossover is around N=500. We compare against two in-context baselines. Full-Ctx puts the whole registry in the prompt and asks the LLM to pick. Search&Pick gives the LLM a search tool to narrow candidates before it picks. At full scale the pipeline leads Search&Pick by 6.5 percentage points (pp) on Match@1 at about half the cost. It reduces cost 70x versus Full-Ctx. We use a fixed configuration (same enrichment, retriever, and scorer weights) across agent, tool, and skill registries. The pipeline runs in production as the default capability-discovery layer of a large-scale multi-agent platform.
Amazon Science