Search papers, labs, and topics across Lattice.
This paper introduces FT-Dojo, a benchmark environment for autonomous LLM fine-tuning across 13 tasks in 5 domains, and proposes FT-Agent, an autonomous system that iteratively refines fine-tuning strategies based on evaluation feedback. The authors frame LLM fine-tuning as an open-ended search problem involving data curation, processing, pipeline construction, and iterative refinement. Experiments show that FT-Agent outperforms general-purpose agents on most tasks, demonstrating the potential for autonomous LLM fine-tuning while also revealing limitations in causal reasoning.
LLM-based agents can now automate end-to-end fine-tuning across diverse domains, but still struggle with causal reasoning, revealing both the promise and limitations of this approach.
Fine-tuning large language models for vertical domains remains a labor-intensive and expensive process, requiring domain experts to curate data, configure training, and iteratively diagnose model behavior. Despite growing interest in autonomous machine learning, no prior work has tackled end-to-end LLM fine-tuning with agents. Can LLM-based agents automate this complete process? We frame this as a substantially open problem: agents must navigate an open-ended search space spanning data curation from diverse data sources, processing with complex tools, building a training pipeline, and iteratively refining their approach based on evaluation outcomes in rapidly growing logs--an overall scenario far more intricate than existing benchmarks. To study this question, we introduce FT-Dojo, an interactive environment comprising 13 tasks across 5 domains. We further develop FT-Agent, an autonomous system that mirrors human experts by leveraging evaluation-driven feedback to iteratively diagnose failures and refine fine-tuning strategies. Experiments on FT-Dojo demonstrate that purpose-built fine-tuning agents significantly outperform general-purpose alternatives, with FT-Agent achieving the best performance on 10 out of 13 tasks across all five domains. Ablations show that the approach generalizes effectively to 3B models, with additional insights on data scaling trade-offs and backbone sensitivity. Case analyses reveal that agents can recover from failures through cumulative learning from historical experience, while also exposing fundamental limitations in causal reasoning--highlighting both the promise and current boundaries of autonomous LLM fine-tuning.
