Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper introduces Grow-Prune-Freeze (GPF) networks, an adaptive framework for continual learning in dynamic environments, specifically olfactory navigation. GPF networks dynamically adjust their capacity by growing, pruning, and freezing layers based on environmental complexity. The authors extend random matrix theory to analyze GPFs, demonstrating eigenvalue preservation across layers and achieving a 94% success rate in turbulent plume navigation using Expected SARSA.
Achieve 94% success in turbulent plume navigation by dynamically growing, pruning, and freezing layers of a neural network policy, adapting to the complexity of the environment.
Training data for olfaction is scattered through disparate, non-standardized datasets that limit the ability to build representative world models. Olfactory navigation is a highly dynamic and non-stationary task that benefits from real-time continual learning. We introduce an adaptive framework called Grow-Prune-Freeze (GPF) networks that enable an agent to continually learn through growing, pruning, and freezing early layers of its policy in response to world complexity. Grounding GPFs in non-linear random matrix theory, we show that the work of Pennington & Worth (2017) can be extended from single hidden layers to n-layer continual-learning models, and that eigenvalue composition of network weights is preserved as successive layers are added. We show that GPFs based on Expected SARSA achieve a 94% success rate on turbulent plume navigation - a partially observable, non-stationary task representative of the "big world" challenges that motivate adaptive learning in robotics - and provide supporting methodology for applying GPFs in other world models. Further experiments amount evidence that GPFs may generalize well to other machine learning tasks such as reinforcement learning in Atari, image classification, and autoregressive language models. We open source all code and data to encourage improvements on and more research in olfactory robotics.