Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Dynamic LoRA-Experts and Prototype-Ensemble Matching (DLEPEM), a rehearsal-free framework for class-incremental learning that mitigates interference by allocating task-specific LoRA-Experts. It further enhances discrimination by matching frozen pre-trained model prototypes with adaptive LoRA-Expert prototypes. DLEPEM achieves strong performance on standard and few-shot CIL benchmarks, addressing cumulative interference and suboptimal module alignment in parameter-efficient fine-tuning.
Task-specific LoRA-Experts and prototype-ensemble matching unlock rehearsal-free class-incremental learning with reduced interference and improved discrimination.
Class-Incremental Learning (CIL) aims to continuously learn new classes without forgetting previously acquired knowledge. Parameter-efficient fine-tuning with pre-trained models reduces parameter overhead but can suffer from cumulative interference and suboptimal alignment between inference samples and specialized modules. We propose Dynamic LoRA-Experts and Prototype-Ensemble Matching (DLEPEM), a two-stage rehearsal-free framework. DLEPEM allocates a task-specific LoRA-Expert for each incremental task to reduce cross-task interference, then combines frozen pre-trained-model prototypes with task-adaptive LoRA-Expert prototypes for reliable task-level discrimination. Experiments on standard CIL and Few-Shot CIL benchmarks demonstrate strong performance under the evaluated protocols.