Search papers, labs, and topics across Lattice.
This paper investigates the capacity distribution in hierarchical search agents by factorizing roles into delegation, execution, and answer generation. Through controlled capacity sweeps across five multi-hop QA benchmarks, the authors find that enhancing the delegation role significantly boosts performance, while scaling the execution role yields diminishing returns. Notably, a smaller executor trained via trajectory distillation achieves comparable accuracy to larger models, suggesting an optimal strategy for resource allocation in multi-agent architectures.
Concentrating model capacity on delegation roles can yield substantial performance gains in hierarchical search agents, revealing a critical bottleneck in task decomposition.
Large language model based search agents increasingly adopt multi-agent architectures in which a main agent decomposes a complex question into sub-queries and dispatches them to parallel sub-agents. However, existing systems instantiate all roles from a single model of identical scale, leaving open how model capacity should be distributed across roles. We factorize hierarchical search into three roles: a delegation role responsible for task decomposition, an execution role responsible for retrieval and evidence extraction, and an answer generation role held fixed as a confound control. We then conduct controlled capacity sweeps along the delegation and execution axes on five multi-hop QA benchmarks. The experiments yield three findings. First, role factorization consistently outperforms a single-agent baseline, improving exact match from 4.5 to 8.6 points across six model scales. Second, capacity sensitivity is asymmetric: scaling the delegation backbone improves EM by ~11 points, whereas scaling the execution sub-agent moves EM by only ~2.6 points, identifying decomposition as the capability bottleneck. Third, a 1.7B-parameter executor trained via quality-filtered trajectory distillation matches a frontier sub-agent in accuracy while consuming 37% fewer sub-agent tokens, advancing the Pareto frontier. These results suggest a concrete recipe for building hierarchical search agents: concentrate capacity at delegation and downsize execution without sacrificing accuracy. Our code is available at https://github.com/QinnanCai0115/role-factorized-search.
