Search papers, labs, and topics across Lattice.
This paper explores the challenges of continual learning in hyperbolic geometry, particularly in preserving representation across modalities. It establishes a theoretical foundation for preventing forgetting through cross-modal invariance under hyperbolic isometries, revealing that forgetting is influenced by semantic relation drift and hierarchical distortion. The proposed continual learning framework effectively maintains essential geometric structures while adapting to new tasks, as validated by experiments on multimodal benchmarks.
Forgetting in hyperbolic continual learning is driven by semantic drift and hierarchical distortion, revealing critical insights for preserving multimodal representations.
Hyperbolic geometry has recently emerged as a powerful representation space for multimodal learning, as it naturally captures hierarchical semantic structure across modalities. Despite this progress, how such representations behave under continual learning poses fundamentally different challenges that remain underexplored. This work provides a geometric perspective on this problem and establishes a theoretical foundation for representation preservation in hyperbolic space, showing that preventing forgetting requires cross-modal invariance under a shared hyperbolic isometry. We further show that forgetting in hyperbolic continual learning involves both semantic relation drift and hierarchy-related distortion, motivating preservation of both cross-modal relational structure and hierarchical geometry. Guided by these insights, a principled continual learning framework is derived that preserves essential geometric structure while allowing effective adaptation to new tasks. Experiments on continual multimodal benchmarks corroborate the effectiveness of the proposed approach.
NUS