Search papers, labs, and topics across Lattice.
Affiliation:
2
0
3
11
Adaptive LLM fine-tuning can achieve superior performance and stability by intelligently searching step-sizes along a trusted gradient direction, costing less than a full line search.
Fine-tuning 30B+ LLMs on a single 80GB GPU is now possible with TACO, slashing optimizer state memory by $174\times$ without sacrificing accuracy.
