Search papers, labs, and topics across Lattice.
This paper introduces DART-SD, a novel framework that enhances multi-turn tool-calling capabilities in Large Language Models (LLMs) by leveraging a diamond-topology aware approach to self-distillation. By modeling the execution process as an Interaction-State Transition Graph (ISTG), DART-SD identifies Critical Topological Breakpoints (CTBs) to guide localized corrections during training, thereby preserving policy diversity and mitigating topological collapse. Experimental results show that DART-SD outperforms traditional full-trajectory imitation methods, demonstrating its effectiveness in complex multi-turn tasks.
DART-SD reveals that leveraging diamond-topology awareness can drastically improve policy diversity and performance in multi-turn tool-calling agents.
Equipping Large Language Models (LLMs) with multi-turn tool-calling capabilities is essential for building autonomous agents. However, progress is fundamentally limited by the reliance on full-length trajectory imitation. For tasks involving multiple order-independent sub-goals, the optimal solution space forms a vast combinatorial diamond lattice. Forcing this rich topology into monolithic trajectories causes a severe topological collapse, indiscriminately penalizing valid alternative explorations and severely degrading policy diversity. To address this, we propose DART-SD (Diamond-topology Aware Retrieval and Tuning for Self-Distillation), a novel framework that shifts the paradigm from global forcing to topology-guided localized correction. DART-SD first models the execution process as a converging Interaction-State Transition Graph (ISTG), faithfully capturing the inherent diamond topology of successful and failed exploratory paths. During autonomous rollouts, the framework identifies the Critical Topological Breakpoint (CTB) and retrieves success-supported recovery references. Finally, we introduce a progressive self-distillation paradigm through CTB-guided localized supervision, ensuring that the training loss is calculated exclusively on the generated recovery steps while strictly protecting the valid reasoning prefix from destructive gradient updates. Experiments on complex multi-turn tool-calling benchmarks demonstrate that DART-SD significantly outperforms traditional full-trajectory baselines.
