Search papers, labs, and topics across Lattice.
The paper introduces ORBIT, a framework for generating a 20K-sample training dataset of reasoning-intensive question-answer pairs for search agents, without relying on paid API services. ORBIT employs a modular four-stage process involving seed creation, question-answer generation, self-verification, and external search verification. Training Qwen3-4B on ORBIT demonstrates strong performance among sub-4B LLMs on Wikipedia question answering, validating the effectiveness of synthetic datasets for training search agents.
Forget expensive APIs: ORBIT offers a frugal framework for generating high-quality, verifiable training data for search agents, unlocking research on a tight budget.
Search agents, which integrate language models (LMs) with web search, are becoming crucial for answering complex user queries. Constructing training datasets for deep research tasks, involving multi-step retrieval and reasoning, remains challenging due to expensive human annotation, or cumbersome prerequisites. In this work, we introduce ORBIT, a training dataset with 20K reasoning-intensive queries with short verifiable answers, generated using a frugal framework without relying on paid API services. The modular framework relies on four stages: seed creation, question--answer pair generation, and two stages of verification: self and external. ORBIT spans 15 domains and each training pair requires 4--5 reasoning steps, with external search verification required from the complete web. We train Qwen3-4B as the base model on ORBIT using GRPO and evaluate it on Wikipedia question answering tasks. Extensive experiment results demonstrate that ORBIT-4B achieves strong performance among sub-4B LLMs as search agents, proving the utility of synthetic datasets. Our framework, code and datasets are open-sourced and available publicly.
