Search papers, labs, and topics across Lattice.
This paper addresses model collapse in long-term test-time adaptation (TTA) by introducing an Adaptive and Selective Reset (ASR) scheme that dynamically determines when and where to reset model parameters. To mitigate knowledge loss from resets, they propose an importance-aware regularizer to recover essential knowledge. Finally, they introduce an on-the-fly adaptation adjustment scheme to improve adaptability under significant domain shifts, demonstrating improved performance on long-term TTA benchmarks.
Stop throwing away the baby with the bathwater: selectively resetting model parameters during test-time adaptation prevents catastrophic forgetting and collapse, leading to better long-term performance.
When continual test-time adaptation (TTA) persists over the long term, errors accumulate in the model and further cause it to predict only a few classes for all inputs, a phenomenon known as model collapse. Recent studies have explored reset strategies that completely erase these accumulated errors. However, their periodic resets lead to suboptimal adaptation, as they occur independently of the actual risk of collapse. Moreover, their full resets cause catastrophic loss of knowledge acquired over time, even though such knowledge could be beneficial in the future. To this end, we propose (1) an Adaptive and Selective Reset (ASR) scheme that dynamically determines when and where to reset, (2) an importance-aware regularizer to recover essential knowledge lost due to reset, and (3) an on-the-fly adaptation adjustment scheme to enhance adaptability under challenging domain shifts. Extensive experiments across long-term TTA benchmarks demonstrate the effectiveness of our approach, particularly under challenging conditions. Our code is available at https://github.com/YonseiML/asr.
