Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper introduces the Informational Buildup Framework (IBF) for continual learning, which posits that information retention arises from structural alignment driven by intrinsic learning dynamics rather than parameter superposition. IBF uses a Law of Motion to increase coherence and Modification Dynamics to deform the coherence landscape based on discrepancies, enabling memory and self-correction without external mechanisms. The framework is validated across a 2D toy model, a non-stationary world, chess (Stockfish), and Split-CIFAR-100 (frozen ViT), demonstrating replay-superior retention and near-zero forgetting in some cases without storing raw data.
Forget replay buffers: this new framework achieves near-zero forgetting in continual learning by encoding information as structural alignment within the learning dynamics themselves.
Catastrophic forgetting is not an engineering failure. It is a mathematical consequence of storing knowledge as global parameter superposition. Existing methods, such as regularization, replay, and frozen subnetworks, add external mechanisms to a shared-parameter substrate. None derives retention from the learning dynamics themselves. This paper introduces the Informational Buildup Framework (IBF), an alternative substrate for continual learning, based on the premise that information is the achievement of structural alignment rather than stored content. In IBF, two equations govern the dynamics: a Law of Motion that drives configuration toward higher coherence, and Modification Dynamics that persistently deform the coherence landscape in response to localized discrepancies. Memory, agency, and self-correction arise from these dynamics rather than being added as separate modules. We first demonstrate the full lifecycle in a transparent two-dimensional toy model, then validate across three domains: a controlled non-stationary world, chess evaluated independently by Stockfish, and Split-CIFAR-100 with a frozen ViT encoder. Across all three, IBF achieves replay-superior retention without storing raw data. We observe near-zero forgetting on CIFAR-100 (BT = -0.004), positive backward transfer in chess (+38.5 cp), and 43% less forgetting than replay in the controlled domain. In chess, the framework achieves a mean behavioral advantage of +88.9 +/- 2.8 cp under independent evaluation, exceeding MLP and replay baselines.