Track synthesis, materials and catalysis as it is published.
Search papers, labs, and topics across Lattice.
This paper benchmarks optimized attention mechanisms, including RetNet, LightNet, GSA, FoX, and KDA, for Speech Emotion Recognition (SER) against standard self-attention. While standard self-attention achieves the highest accuracy on MSP-Podcast, efficient attention variants significantly improve scalability, reducing inference latency and memory usage by up to 10x. The study reveals a trade-off between accuracy and efficiency, offering insights for building scalable SER systems.
Efficient attention mechanisms like RetNet and LightNet can speed up Speech Emotion Recognition by an order of magnitude, but at the cost of some accuracy compared to standard self-attention.
Speech Emotion Recognition (SER) plays a key role in advancing human-computer interaction. Attention mechanisms have become the dominant approach for modeling emotional speech due to their ability to capture long-range dependencies and emphasize salient information. However, standard self-attention suffers from quadratic computational and memory complexity, limiting its scalability. In this work, we present a systematic benchmark of optimized attention mechanisms for SER, including RetNet, LightNet, GSA, FoX, and KDA. Experiments on both MSP-Podcast benchmark versions show that while standard self-attention achieves the strongest recognition performance across test sets, efficient attention variants dramatically improve scalability, reducing inference latency and memory usage by up to an order of magnitude. These results highlight a critical trade-off between accuracy and efficiency, providing practical insights for designing scalable SER systems.