Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces MelT, a novel audio frontend framework that leverages precomputed Mel-spaced Non-Uniform Discrete Fourier Transform (NDFT) bases to optimize audio processing on modern accelerators. By reformulating the NDFT projection as a General Matrix Multiplication (GEMM) operation, MelT addresses the inefficiencies of traditional Short-Time Fourier Transform (STFT) and Mel aggregation methods, which suffer from structural heterogeneity. The results demonstrate that MelT achieves up to a 3.75× speedup in inference latency and a 3.52× reduction in energy consumption without compromising classification accuracy across various hardware platforms.
MelT achieves up to 3.75× faster inference and 3.52× lower energy use by transforming audio frontends into GEMM-native operations, challenging conventional STFT approaches.
Modern audio processing networks are commonly deployed on accelerators whose peak throughput is obtained through dense linear algebra, whereas conventional acoustic frontends -- a Short-Time Fourier Transform (STFT) followed by sparse Mel aggregation -- remain structurally heterogeneous. This mismatch can introduce memory-bandwidth, dispatch, and intermediate-allocation overheads on contemporary accelerator backends. This work introduces MelT, a single-stage frontend framework in which Mel-spaced Non-Uniform Discrete Fourier Transform (NDFT) bases are precomputed and applied to time-domain acoustic frames through dense General Matrix Multiplication (GEMM) operations. The contribution is not the NDFT operator itself; rather, it is the formulation of Mel-spaced NDFT projection as a GEMM-native audio frontend and its evaluation as a hardware-efficient alternative to conventional STFT+Mel pipelines. Evaluated across platforms ranging from Apple A18 Pro edge hardware to NVIDIA H100 datacenter acceleration, MelT attains up to a $3.75\times$ speedup in inference latency and a $3.52\times$ reduction in energy consumption while maintaining downstream classification accuracy.