Search papers, labs, and topics across Lattice.
1
0
2
Learning rate decay, a common optimization technique, might be the culprit behind catastrophic forgetting in LLMs during fine-tuning.