Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a learnable residual speech-to-spike encoder that is jointly trained with a Recurrent Leaky Integrate-and-Fire (R-LIF) backbone to overcome the limitations of fixed spike encoders in neuromorphic speech processing. By validating the approach on the Google Speech Commands v2 benchmark, the authors achieve up to 94.97% accuracy with a compact 35k-parameter model, demonstrating significant efficiency compared to prior methods. The study reveals that the encoder focuses on learning task-aligned spike representations rather than faithful signal reconstruction, enhancing class separability in spiking neural networks.
A compact, learnable speech-to-spike encoder achieves 94.97% accuracy, outperforming traditional models with an order of magnitude fewer parameters.
The mismatch between continuous acoustic signals and discrete event-driven processing remains a fundamental bottleneck for neuromorphic speech processing. Current systems typically rely on fixed spike encoders, forcing downstream Spiking Neural Networks (SNNs) to compensate for non-adaptive input representations. To address this, we present a learnable residual speech-to-spike encoder jointly trained end-to-end with a Recurrent Leaky Integrate-and-Fire (R-LIF) backbone. We validate this approach on the Google Speech Commands v2 (GSC-v2) benchmark, achieving up to 94.97% accuracy. Notably, the learned encoder remains highly parameter-efficient with a compact 35k-parameter variant that reaches 89.8%, matching or exceeding prior baselines that require an order of magnitude more parameters. Our encoder-focused analysis, including linear probing and gradient-residual inspection, indicates that the encoder does not target faithful signal reconstruction but instead learns task-aligned spike representations that enhance class separability. Finally, we benchmark bio-inspired, hardware-friendly credit assignment by comparing Direct Feedback Alignment (DFA) with surrogate-gradient BPTT under identical architectures and training conditions. We find that DFA reaches 91.5% accuracy, quantifying the performance trade-off of bio-inspired learning rules for modern neuromorphic audio.