Search papers, labs, and topics across Lattice.
This paper introduces MARA, a novel approach to resource allocation that utilizes conditional flow matching to predict future loss trajectories and coordinates compute nodes through a cooperative multi-agent autoregressive policy. By addressing the challenges of uncertain demand and discrete computation resources, MARA achieves a significant improvement in task completion rates compared to existing methods. Specifically, it completes 63.46% of tasks on average, outperforming the strong baseline LARA by 8.54 percentage points, even under unseen heavier workloads.
MARA achieves 63.46% task completion in resource-constrained environments, outperforming existing methods by over 8 percentage points.
Allocating limited computation among concurrent learning tasks is difficult when each task must reach a target loss before a deadline but its required training effort is unknown. Existing approaches combine online loss prediction with adaptive resource allocation, yet commonly treat computation as continuously divisible throughput. We instead study a practical setting in which tasks arrive over time and computation is provided by discrete nodes. This setting introduces both uncertain demand and constrained sequential decisions. We propose MARA, which predicts future loss trajectories with conditional flow matching and coordinates compute nodes through a cooperative multi-agent autoregressive policy. A potential-based progress reward supplies intermediate training feedback while preserving the undiscounted task-completion objective. Across in-distribution, reinforcement-learning, and vision workloads, flow matching reduces remaining-resource prediction error relative to weighted least squares. At the scheduler's training load, MARA completes 63.46% of tasks on average, 8.54 percentage points above strong baseline Learning with Adaptive Resource Allocation (LARA), and remains ahead under unseen heavier workloads.
