Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Adaptive Hebbian Routing in Vision Transformers to enhance few-shot image recognition by dynamically adjusting memory contributions during learning episodes. The method employs a lightweight MLP router to optimize memory updates and retention, leading to improved performance on benchmark datasets like Omniglot and CIFAR-FS. Key results indicate that the Fully Adaptive Routing variant achieves a state-of-the-art accuracy of 96.94% while also reducing inference time, demonstrating significant advantages over fixed Hebbian approaches.
Adaptive Hebbian Routing boosts few-shot learning accuracy to 96.94% while cutting inference time by nearly 15%.
Few-shot image recognition requires models to adapt to new classes from a small labeled support set. Hebbian fast-weight memory can provide temporary associative information during an episode, but fixed memory behavior may not be appropriate for every few-shot task. In this work, we propose Adaptive Hebbian Routing for few-shot Vision Transformers. The method uses a lightweight MLP router to control the contribution of Hebbian memory, the strength of memory updates, and the retention of previous memory from support-set features. We study Adaptive Placement, Adaptive Plasticity, and Fully Adaptive Hebbian Routing. Experiments use ViT-Small, DeiT-Small, and Swin-Tiny under 5-way 1-shot evaluation on Omniglot, CIFAR-FS, and cross-domain transfer from CIFAR-FS to Omniglot. In the direct Swin comparison, fixed and adaptive Hebbian variants use the same memory location. Adaptive Plasticity improves the fixed Hebbian result from 96.74\% to 96.92\%, while Fully Adaptive Routing achieves the best result at 96.94\%. The fully adaptive Swin model also reduces inference time from 16.51 ms to 14.05 ms relative to fixed Hebbian Swin. On CIFAR-FS, adaptive variants improve performance across all three backbones, and the multi-shot evaluation shows that these gains remain useful as the number of support examples increases. These results show that adaptive plasticity and adaptive memory activation can improve few-shot Transformer representations beyond fixed Hebbian behavior.