Search papers, labs, and topics across Lattice.
The paper investigates forgetting in language models, showing that self-generated samples can serve as effective replay data to mitigate it. They find that forgetting persists when models are close to saturation, indicating a capacity limitation. However, self-generated replay enables fast, high-learning-rate finetuning without forgetting, overcoming the traditional tradeoff between learning rate and forgetting.
Language models can leverage their own generative abilities to nearly eliminate forgetting during finetuning, challenging the need for stored exemplars.
Models trained on a new task typically degrade on prior tasks, a phenomenon known as forgetting. Traditionally, mitigating forgetting has required replaying stored exemplars from prior tasks, which is often impractical. By contrast, language models can sample from their own training distribution, and we show that these self-generated samples serve as effective replay data, nearly eliminating forgetting. We find that forgetting nonetheless persists when the model has little remaining capacity: models pretrained close to saturation cannot absorb new information without overwriting prior knowledge. When capacity is not the limiting factor, low learning rates reduce forgetting but require substantially more training steps. Replay breaks this tradeoff, enabling fast, high-learning-rate finetuning without forgetting.
