Search papers, labs, and topics across Lattice.
Tsinghua AIBeijing University of Aeronautics and AstronauticsNTUPolyURMITJun 15, 2026arXiv:2606.16774This paper introduces Collective Skill Tree Search (CSTS), a framework designed to enhance Large Language Models (LLMs) by automatically constructing reusable skills for complex tasks. By leveraging collective intelligence through iterative phases of skill generation and assessment, CSTS enables comprehensive exploration and evaluation of diverse skills, resulting in a structured skill tree that improves LLM performance in dynamic environments. The resulting model, OpenClaw-Skill, demonstrates significant advancements in long-horizon planning, tool use, and generalization across challenging benchmarks.
Collective Skill Tree Search transforms LLMs into versatile agents capable of mastering complex tasks through a structured skill tree that enhances their adaptability and performance.
Equipping Large Language Model (LLM) agents with effective skills is crucial for solving complex tasks in real-world systems like OpenClaw. In this work, we aim to develop a framework that automatically constructs such reusable skills to enhance LLMs in tool use, multi-step reasoning, and dynamic environment interaction. To this end, we propose Collective Skill Tree Search (CSTS), a novel tree-search-based skill construction framework that constructs structured, diverse and generalizable tree of skills. The core idea of CSTS is to leverage collective intelligence to jointly search, identify and compose effective skills via two iterative phases: Collective Skill Node Generation (CSN-Gen) and Collective Skill Node Assessment (CSN-Assess). CSN-Gen exploits collective knowledge from multiple models to explore diverse candidate skills for each subtask, enabling comprehensive skill exploration. CSN-Assess employs multiple models as judges to evaluate and select skill nodes with two scoring mechanisms: (1) collective quality scoring that aggregates independent evaluations to produce a robust estimate of skill effectiveness, and (2) collective transferability scoring that explicitly verifies whether a skill generalizes well across different models. With CSTS, we construct a set of comprehensive tree of skills along with skill-augmented training data, enabling models to effectively learn and utilize skills. Besides, we introduce Collective Skill Reinforcement Learning, which actively selects multiple relevant skills from the tree to broaden solution-space exploration, avoid being trapped by a single skill and its resulting homogeneous or suboptimal solutions. As a result, our trained model, OpenClaw-Skill, exhibits outstanding agentic capabilities in long-horizon planning, tool use and generalization over challenging benchmarks.
