Search papers, labs, and topics across Lattice.
This paper introduces FastWave, a diffusion model optimized for audio super-resolution from arbitrary sample rates to 48 kHz. By leveraging recent advances in diffusion model training, FastWave achieves performance comparable to state-of-the-art models like NU-Wave 2 while significantly reducing computational complexity to 50 GFLOPs and model size to 1.3M parameters. The authors demonstrate that FastWave can be trained with fewer resources and faster than other diffusion- and flow-based methods.
You can now super-resolve audio to 48kHz with a diffusion model that's both faster to train and smaller than existing approaches, without sacrificing quality.
Audio Super-Resolution is a set of techniques aimed at high-quality estimation of the given signal as if it would be sampled with higher sample rate. Among suggested methods there are diffusion and flow models (which are considered slower), generative adversarial networks (which are considered faster), however both approaches are currently presented by high-parametric networks, requiring high computational costs both for training and inference. We propose a solution to both these problems by re-considering the recent advances in the training of diffusion models and applying them to super-resolution from any to 48 kHz sample rate. Our approach shows better results than NU-Wave 2 and is comparable to state-of-the-art models. Our model called FastWave has around 50 GFLOPs of computational complexity and 1.3 M parameters and can be trained with less resources and significantly faster than the majority of recently proposed diffusion- and flow-based solutions. The code has been made publicly available.
