Search papers, labs, and topics across Lattice.
MAGIC Net, a novel Streaming Continual Learning (SCL) approach, combines CL architectural strategies with recurrent neural networks to handle temporal dependence in data streams. It uses learnable masks over frozen weights to retain past knowledge and dynamically expands its architecture as needed, operating entirely online. Experiments on synthetic and real-world streams demonstrate improved adaptation, reduced memory usage, and mitigated forgetting compared to existing SCL methods.
By integrating architectural strategies from continual learning with recurrent neural networks, MAGIC Net offers a more effective way to learn from temporally dependent data streams without catastrophic forgetting.
Concept drift, temporal dependence, and catastrophic forgetting represent major challenges when learning from data streams. While Streaming Machine Learning and Continual Learning (CL) address these issues separately, recent efforts in Streaming Continual Learning (SCL) aim to unify them. In this work, we introduce MAGIC Net, a novel SCL approach that integrates CL-inspired architectural strategies with recurrent neural networks to tame temporal dependence. MAGIC Net continuously learns, looks back at past knowledge by applying learnable masks over frozen weights, and expands its architecture when necessary. It performs all operations online, ensuring inference availability at all times. Experiments on synthetic and real-world streams show that it improves adaptation to new concepts, limits memory usage, and mitigates forgetting.
