Search papers, labs, and topics across Lattice.
The paper introduces S-PRESSO, a neural audio compression model for 48kHz sound effects that achieves ultra-low bitrates (down to 0.096 kbps) by leveraging a latent diffusion model as a decoder. S-PRESSO learns compressed audio embeddings using a latent encoder and then uses the diffusion decoder's generative priors to achieve extremely low frame rates (1Hz), enabling high compression ratios. Experiments demonstrate that S-PRESSO outperforms existing continuous and discrete compression methods in audio quality, acoustic similarity, and reconstruction metrics, despite operating at high compression rates.
Key contribution not extracted.
Neural audio compression models have recently achieved extreme compression rates, enabling efficient latent generative modeling. Conversely, latent generative models have been applied to compression, pushing the limits of continuous and discrete approaches. However, existing methods remain constrained to low-resolution audio and degrade substantially at very low bitrates, where audible artifacts are prominent. In this paper, we present S-PRESSO, a 48kHz sound effect compression model that produces both continuous and discrete embeddings at ultra-low bitrates, down to 0.096 kbps, via offline quantization. Our model relies on a pretrained latent diffusion model to decode compressed audio embeddings learned by a latent encoder. Leveraging the generative priors of the diffusion decoder, we achieve extremely low frame rates, down to 1Hz (750x compression rate), producing convincing and realistic reconstructions at the cost of exact fidelity. Despite operating at high compression rates, we demonstrate that S-PRESSO outperforms both continuous and discrete baselines in audio quality, acoustic similarity and reconstruction metrics.
