Search papers, labs, and topics across Lattice.
This paper introduces Task-Anchored Inference Latent Shaping (TAILS), a novel module designed to enhance continual learning in pre-trained models by addressing cross-task prediction ambiguities. By utilizing fixed task anchors as persistent references, TAILS corrects feature representations before prediction, thereby improving classification and task-inference performance without altering the original model architecture. Extensive experiments demonstrate that TAILS achieves these improvements with minimal additional parameters and negligible inference costs, making it a practical solution for enhancing model adaptability across tasks.
TAILS resolves cross-task ambiguities in continual learning by directly correcting feature representations, leading to significant performance boosts without changing the underlying model.
Pre-trained models (PTMs) provide a strong foundation for continual learning by offering stable representations that facilitate lightweight adaptation to new tasks. However, adapting well to each task does not ensure reliable inference over all learned tasks. Since task boundaries are often artificial and semantically entangled, an input from an unknown task can remain ambiguous even with strong PTM features, making cross-task prediction a key bottleneck. We propose Task-Anchored Inference Latent Shaping (TAILS), a lightweight post-PTM module that can be integrated into diverse continual learners and optimized through a decoupled step. TAILS uses fixed task anchors as persistent references to accumulated knowledge. It interprets each sample's feature representation relative to these references, then composes relevant evidence across tasks into latent recall. Rather than selecting a task-specific path or adjusting classifier outputs, TAILS uses latent recall to directly correct the feature representation before prediction. It therefore resolves cross-task ambiguity at the representation level, while leaving the original PTM, method-specific modules, and classifier unchanged. Extensive experiments across multiple PTM-based continual learning paradigms show that TAILS can improve classification and task-inference performance with modest parameter overhead and negligible inference cost.
