Search papers, labs, and topics across Lattice.
This paper introduces AutoPipe, a two-stage framework for efficiently configuring LLM post-training pipelines under limited compute budgets. AutoPipe leverages offline learning-to-rank to capture dataset preferences and guides online Bayesian optimization, which is further refined by a Gaussian-process residual surrogate to model dataset-specific deviations. By incorporating early-stopping and a learned performance predictor, AutoPipe achieves comparable performance to online HPO baselines on biomedical reasoning tasks while reducing computational cost by over 90%.
LLM post-training pipelines can be configured with 10x less compute using AutoPipe, a budget-aware framework that learns from historical runs and predicts performance from early training signals.
LLM post-training pipelines that combine supervised fine-tuning and reinforcement learning are difficult to configure under realistic compute budgets: the configuration space is high-dimensional and heterogeneous, stages are strongly coupled, and each end-to-end evaluation is expensive. We propose AutoPipe, a budget-aware two-stage framework for configuration selection in LLM post-training. Offline, AutoPipe learns a dataset-conditioned learning-to-rank surrogate from historical runs, capturing within-dataset preferences and providing transferable guidance toward promising regions of the configuration space. Online, for a new dataset, AutoPipe uses the offline guidance to steer Bayesian optimization and models dataset-specific deviations with a Gaussian-process residual surrogate. To reduce evaluation cost, each trial is early-stopped and scored by a learned predictor that maps early training signals to a low-cost proxy for final post-training performance. Experiments on biomedical reasoning tasks show that AutoPipe consistently outperforms offline-only baselines and achieves comparable performance with the strongest online HPO baselines while using less than 10\% of their computational cost.
