Search papers, labs, and topics across Lattice.
This study explores the use of State Space Models (SSMs) for respiratory sound classification, addressing limitations of existing self-attention architectures like the Audio Spectrogram Transformer (AST) that may overlook localized anomalies. By implementing spectral-aware layer regularization and Dual-Axis Patch-Mix contrastive learning, the authors enhance the model's sensitivity to mid-to-high spatial-frequency components. The proposed method achieves a 64.48% score on the ICBHI benchmark, surpassing the AST baseline by 5%, demonstrating its effectiveness in improving respiratory sound analysis.
SSMs can significantly enhance respiratory sound classification by preserving critical frequency components that traditional models often miss.
Recent respiratory sound classification (RSC) studies largely rely on CLS-token driven self-attention architectures such as the Audio Spectrogram Transformer (AST). While effective at modeling global context, recent analyses suggest a low-pass filtering behavior that may reduce sensitivity to localized abnormal patterns. In this work, we investigate State Space Models (SSMs) as an alternative backbone for RSC. Using the Distilled Audio State Space model, we analyze intermediate representations through spectral response curves and observe stronger preservation of mid-to-high spatial-frequency components. Based on these observations, we introduce spectral-aware layer regularization using Gaussian convolution applied to selected layers. We further propose Dual-Axis Patch-Mix contrastive learning tailored to SSM-based audio models for robust representation learning. Experiments on the ICBHI benchmark show that our approach achieves 64.48% score, outperforming the AST baseline by 5%. Code is available at https://github.com/RSC-Toolkit/Lung-SRAD.
