Search papers, labs, and topics across Lattice.
This paper introduces ProgRouter, an online framework that optimally orchestrates multi-agent LLM workflows by adaptively selecting agents based on task progress and cost-efficiency. By employing a multi-view task progress scorer and a dual-path task progress predictor, ProgRouter effectively balances the quality of task-solving with operational costs over multiple workflow steps. Experimental results show that ProgRouter significantly reduces operating costs while maintaining high performance across various complex tasks, such as code generation and mathematical reasoning.
Operating costs for multi-agent LLM workflows can be slashed without sacrificing performance, thanks to ProgRouter's adaptive routing strategy.
Multi-agent large language model (LLM) workflows have emerged as a powerful paradigm for solving complex, open-ended tasks through collaborative reasoning among specialized LLM agents, but they incur substantial operating costs due to repeated LLM invocations and long-horizon context accumulation. Existing cascade routing methods make one-shot, query-level decisions and cannot adapt to the dynamic, state-dependent nature of multi-step workflows, in which the right LLM at each step depends on evolving task progress, remaining task difficulty, and cost-efficiency requirements. We present ProgRouter, an online progress-guided routing framework that adaptively selects LLM agents across workflow steps to preserve task-solving quality while adhering to time and cost budgets. ProgRouter introduces a multi-view task progress scorer that combines coarse workflow outcome regimes with fine-grained signals on subtask completion, progress trends, and workflow state quality. Then, a dual-path task progress predictor and an adaptive meta-gating mechanism estimate the progress gain for each candidate routed LLM. ProgRouter makes online step-wise routing decisions that balance progress gain, task time budgets, and long-term operating cost efficiency. Experiments on HumanEval Plus, MBPP, MATH-500, and ASQA, spanning agentic code generation, mathematical reasoning, and retrieval-augmented long-form question answering, demonstrate that ProgRouter reduces the operating cost relative to key baselines while maintaining strong task-solving performance.
