Search papers, labs, and topics across Lattice.
MagicSelector is a novel joint optimization framework that integrates Counterfactual task decomposition, Progressive reranking, and Dynamic Top-K strategies to enhance tool retrieval in agent systems. By translating ambiguous user instructions into executable subtasks, it effectively reduces noise and context distraction in out-of-domain scenarios. Evaluated on the MTDTool benchmark, MagicSelector significantly outperforms existing methods in tool retrieval accuracy and generalization, showcasing its efficiency and effectiveness in real-world applications.
MagicSelector achieves unprecedented tool retrieval accuracy by translating vague user instructions into precise subtasks, outperforming state-of-the-art methods.
We present MagicSelector, a joint optimization framework integrating Counterfactual task decomposition, Progressive reranking, and Dynamic Top-K, designed to address the fundamental challenges of tool retrieval in agents. MagicSelector is a specialized framework capable of translating ambiguous user instructions into executable atomic subtasks and guiding high-precision tool retrieval, effectively mitigating redundant noise and severe context distraction in out-of-domain (OOD) scenarios.We empower MagicSelector with these capabilities through three key contributions: (1) a preferenceguided counterfactual task decomposition mechanism that utilizes a counterfactual reward to quantify the marginal causal gain of decomposition on retrieval ranking, effectively imposing fine-grained structural supervision on logical coherence; (2) a progressive tool reranking method driven by self-distillation hard negative mining, which optimizes both point-wise and list-wise relevance to enhance fine-grained discrimination among highly similar tools; and (3) a dual semantic boundary-aware dynamic Top-K strategy that adaptively monitors reranking score cliffs and inter-tool semantic shifts to dynamically truncate the candidate list, maximizing relevant tool recall while filtering long-tail noise. Evaluated on MTDTool, the first task decomposition benchmark we constructed tailored for mobile multi-turn interactions with process-level annotations, MagicSelector yields promising performance. Extensive experiments demonstrate that MagicSelector significantly outperforms state-of-the-art methods in terms of tool retrieval accuracy, OOD generalization capability, and overall token efficiency, thereby demonstrating the effectiveness of our proposed framework.
