Search papers, labs, and topics across Lattice.
This paper introduces SKT, a verified data synthesis pipeline designed to enhance the skill-use capabilities of language-model agents by generating skill-grounded tasks and executable trajectories from a large collection of agent skills. By employing rule-based and agent-based verification methods, SKT successfully produces 4,000 task packages and 27,164 verified trajectories, demonstrating that supervised fine-tuning on these synthesized trajectories significantly improves performance across diverse models. The findings underscore the importance of high-quality supervision and broader skill coverage in achieving effective skill-use training for language models.
Verified data synthesis can dramatically elevate the skill-use performance of language models, producing thousands of executable trajectories that enhance agent capabilities.
Agent skills have become an important mechanism for equipping language-model agents with reusable procedural knowledge. However, providing skills alone does not guarantee that current models can effectively identify, apply, and coordinate them. To improve skill-use capabilities, we introduce SKT, a verified data synthesis pipeline that constructs skill-grounded tasks and executable trajectories from large collections of agent skills. SKT selects suitable single-skill and multi-skill configurations, synthesizes tasks through rule-based and agent-based verification with feedback-guided repair, and retains only successful trajectories that substantially use every required skill. Using 2,000 public skills, SKT produces 4,000 task packages and 27,164 verified trajectories. Based on the same pipeline and a disjoint test pool, we further construct SkillEval, a held-out executable benchmark for evaluating skill use. Experiments across diverse models, benchmarks, and agent harnesses show that supervised fine-tuning on SKT-generated trajectories consistently improves skill-use performance. Verification ablations, cross-harness evaluation, and scaling experiments further demonstrate that these gains depend on high-quality supervision, extend beyond a single agent interface, and increase with broader skill coverage. Together, these results establish verified data synthesis as an effective and scalable approach for skill-use training.
Apple ML