Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper explores the application of transformer-based architectures, inspired by Vision Transformers (ViT), to machine fault detection using audio input, contrasting them with traditional CNN approaches. The study compares the performance of transformers and CNNs in analyzing spectrograms generated from machine sounds, focusing on the quality of the learned embeddings for fault detection. Results demonstrate the effectiveness of transformer-driven architectures in this Sound AI application, suggesting their potential to outperform CNNs due to lower inductive biases when sufficient data is available.
Transformers might just dethrone CNNs in Sound AI for machine fault detection, thanks to their ability to learn better spectrogram embeddings with enough data.
In recent years, Sound AI is being increasingly used to predict machine failures. By attaching a microphone to the machine of interest, one can get real time data on machine behavior from the field. Traditionally, Convolutional Neural Net (CNN) architectures have been used to analyze spectrogram images generated from the sounds captured and predict if the machine is functioning as expected. CNN architectures seem to work well empirically even though they have biases like locality and parameter-sharing which may not be completely relevant for spectrogram analysis. With the successful application of transformer-based models in the field of image processing starting with Vision Transformer (ViT) in 2020, there has been significant interest in leveraging these in the field of Sound AI. Since transformer-based architectures have significantly lower inductive biases, they are expected to perform better than CNNs at spectrogram analysis given enough data. This paper demonstrates the effectiveness of transformer-driven architectures in analyzing Sound data and compares the embeddings they generate with CNNs on the specific task of machine fault detection.