Search papers, labs, and topics across Lattice.
This paper introduces a Cerebellar-inspired Deep Reinforcement Learning (CDRL) framework that incorporates large expansion, sparse connectivity, sparse activation, and dendritic-level modulation, drawing inspiration from the structural principles of the cerebellum. The motivation is to improve sample efficiency, robustness to noise, and generalization in RL, which are limitations of existing approaches that primarily focus on optimization strategies. Experiments on noisy, high-dimensional RL benchmarks demonstrate that CDRL consistently outperforms conventional designs in terms of sample efficiency, robustness, and generalization, highlighting the value of cerebellar structural priors as effective inductive biases for RL.
Cerebellar-inspired architectures with dendritic modulation offer a surprisingly effective inductive bias for reinforcement learning, boosting sample efficiency, robustness, and generalization.
Reinforcement learning (RL) has achieved notable performance in high-dimensional sequential decision-making tasks, yet remains limited by low sample efficiency, sensitivity to noise, and weak generalization under partial observability. Most existing approaches address these issues primarily through optimization strategies, while the role of architectural priors in shaping representation learning and decision dynamics is less explored. Inspired by structural principles of the cerebellum, we propose a biologically grounded RL architecture that incorporate large expansion, sparse connectivity, sparse activation, and dendritic-level modulation. Experiments on noisy, high-dimensional RL benchmarks show that both the cerebellar architecture and dendritic modulation consistently improve sample efficiency, robustness, and generalization compared to conventional designs. Sensitivity analysis of architectural parameters suggests that cerebellum-inspired structures can offer optimized performance for RL with constrained model parameters. Overall, our work underscores the value of cerebellar structural priors as effective inductive biases for RL.
