Search papers, labs, and topics across Lattice.
This paper introduces a Mixture-of-Experts (MoE) approach to learned image compression by developing a MoE-based Entropy model (MoEE), which selectively activates a subset of parameters tailored to the input image. The method leverages the strengths of MoE architectures to enhance compression efficiency, resulting in a significant BD-Rate improvement of -16.85% over the state-of-the-art VVC on the Kodak dataset. This advancement not only demonstrates the potential of MoE in image compression but also sets a new benchmark for future research in the field.
Achieving a remarkable -16.85% BD-Rate improvement over VVC, this MoE-based approach revolutionizes learned image compression efficiency.
Learned image compression has seen significant progress in recent years with the development of end-to-end learned models that achieve better compression efficiency than state-of-the-art conventional methods. Recently, Mixture of Experts (MoE) approaches have seen promising results in NLP and computer vision tasks. In this paper, we introduce the MoE approach to learned image compression. We propose a MoE-based Entropy model (MoEE) for learned image compression, allowing the model to selectively activate only the subset of parameters required for the input image. Our model achieves a BD-Rate improvement over VVC of -16.85% on the Kodak dataset.