Search papers, labs, and topics across Lattice.
This study benchmarks the effectiveness of model merging combined with test-time adaptation (TTA) for continual Whole Slide Image (WSI) classification, addressing the limitations of traditional continual learning methods that rely on historical data. By evaluating the approach across various cancer subtyping cohorts and different task orders, the authors demonstrate that TTA-guided merging can enhance task-specific performance while preserving previously learned knowledge. However, the results reveal that performance is highly sensitive to the order of tasks and the interplay between current adaptation and historical knowledge retention.
Adapting models at test time can significantly boost performance in continual learning for computational pathology, but task order matters more than you might think.
Model merging offers a practical alternative to conventional continual learning by integrating independently fine-tuned models without retaining previous training data. Recent state-of-the-art model merging methods employ test-time adaptation (TTA-guided merging) to address distribution shifts by adjusting merging-related variables using unlabeled target data. However, these methods have primarily been studied in multi-task or single-target settings, and their behavior under sequential continual learning remains insufficiently understood. We present a benchmark study that maps this family of methods to rehearsal-free continual Whole Slide Image classification and evaluates them against traditional continual-learning approaches. Experiments on six TCGA cancer-subtyping cohorts cover CLASS-IL and TASK-IL scenarios, in-domain and out-of-domain evaluation, and different task orders. The results show that adapting model merging at test time can provide strong task-specific performance and improve retention of previously acquired knowledge without storing historical WSIs. Nevertheless, performance remains sensitive to task order and to the interaction between adaptation on the current distribution and accumulated knowledge. This benchmark identifies model merging with test-time adaptation as a promising direction for continual computational pathology and motivates future methods that balance adaptation to domain shift with explicit preservation of historical knowledge.
