Search papers, labs, and topics across Lattice.
This paper introduces Skill2Query, a novel framework that enhances agent skill retrieval by explicitly leveraging the internal structure of skill documents through a Skill Knowledge Graph. By employing a three-stage process of style mimicking, query template generation, and parameter filling, Skill2Query generates 700K diverse pseudo-queries that significantly improve retrieval performance across four benchmarks. The method results in an average Recall@1 increase of 6.70 percentage points and demonstrates that better skill retrieval correlates with higher success rates in agent tasks when evaluated with various LLM backends.
Skill2Query transforms agent skill retrieval by generating contextually grounded pseudo-queries that boost retrieval accuracy and agent performance.
Pseudo-query generation can alleviate the supervision bottleneck for agent skill retrieval, but existing document-level approaches typically leave the rich internal relations among capabilities, parameters, and usage examples implicit. As a result, generated queries may be topically relevant to a skill while lacking capability grounding and parameter consistency, raising the question of whether explicitly exploiting a skill document's internal structure can produce more effective retrieval signals. We therefore propose Skill2Query, a framework that first parses a skill document into a Skill Knowledge Graph and then generates pseudo-queries through a three-stage process including style mimicking, query template generation, and parameter filling. The generated queries can be used for offline index augmentation, online query expansion, and retriever training. Four benchmarks (TheoremQA, LogicBench, ToolQA, and CHAMP) are used to evaluate Skill2Query with large-scale skill candidate pools across multiple downstream applications, including skill retrieval, retriever training, and end-to-end agent execution. Using nearly 30K skills across diverse domains, we generate 700K category-diverse pseudo-queries. Skill2Query consistently improves sparse, dense, and skill-routing retrieval, with an average Recall@1 gain of 6.70 percentage points across retrieval settings. Skill2Query-generated training data also achieves the best Recall@1 and nDCG@1 among the evaluated generation baselines. Further evaluations with multiple LLM backends demonstrate that improved skill retrieval translates into higher agent task success rates. Code and resources are available at https://github.com/MatZaharia/Skill2Query.
