Search papers, labs, and topics across Lattice.
This paper introduces MidTool, a novel corpus construction pipeline aimed at enhancing the agentic tool-use capabilities of large language models through mid-training. By integrating diverse data sources and synthesized supervision from real-world tool APIs, MidTool effectively teaches models to recognize tool affordances and manage workflows. The results demonstrate that models mid-trained with MidTool outperform baselines in downstream tasks, highlighting the importance of targeted mid-training for developing general tool use in LLMs.
MidTool reveals that dedicated mid-training can significantly enhance LLMs' ability to utilize tools effectively, outperforming traditional post-training approaches.
Mid-training is increasingly recognized as a critical stage for shaping the capabilities of large language models. Recent work has shown that targeted mid-training can strengthen reasoning-intensive abilities such as math and science, and can also improve agentic capabilities in software-engineering settings. In this work, we study the parallel but less explored agentic capability: general tool use. We present MidTool, an open corpus construction pipeline for agentic tool-use mid-training that combines large-scale web, PDF, and code data with synthesized supervision from real-world tool APIs, MCP skills, and document-grounded workflows. MidTool is designed to teach models how to recognize tool affordances, ground arguments from context, compose tool call workflow, and recover from incomplete information. We mid-train Qwen3-4B-Base and Qwen3-8B-Base on MidTool-Mix, and then apply follow-up post-training with both supervised fine-tuning and reinforcement learning. Compared with baselines, MidTool-Mix consistently improves downstream performance under both SFT and RL on BFCL, tau2-Bench, and MCP Universe. These results suggest that general tool use, like other important LLM capabilities, benefits from dedicated mid-training rather than being left entirely to post-training.
