Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study systematically evaluates the effectiveness of continual learning (CL) methods in the context of heterogeneous medical visual question answering (MedVQA) tasks, such as classification and report generation. The research highlights the challenges of catastrophic forgetting and the influence of task ordering on performance retention, revealing that existing CL approaches often fail to maintain a stable-plasticity balance when faced with diverse clinical objectives. Key findings indicate significant weight drift patterns in low-rank adaptation parameters across different CL methods, underscoring the need for improved strategies in MedVQA systems.
Existing continual learning methods falter in preserving knowledge across diverse medical tasks, revealing critical gaps in their application to real-world clinical settings.
Deploying medical visual question answering (MedVQA) systems in real-world clinical settings requires models that adapt to new clinical tasks without forgetting previously acquired knowledge. Continual learning (CL) provides a practical framework for this setting. Despite rapid progress in medical vision-language models, the behavior of CL methods when training these models across heterogeneous MedVQA tasks remains underexplored. This work presents a systematic evaluation of CL for MedVQA across diverse clinical objectives, including classification, multi-label classification, detection, cell counting, and report generation. Specifically, we explore (1) the ability of existing CL methods to mitigate catastrophic forgetting; (2) their sensitivity to task ordering, analyzing how different task sequences influence performance retention and forgetting; and (3) the evolution of low-rank adaptation parameters as new tasks are learned, revealing patterns of weight drift under different CL methods. Our findings suggest that existing CL methods struggle to maintain stability-plasticity balance when tasks with different objectives and supervision formats are interleaved. Code and full experimental setup will be publicly available.