Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces PivCo-Huffman, a novel approach to Huffman coding that leverages wavelet tree data structures to enhance encoding and decoding efficiency. The method achieves significant improvements in decoding throughput compared to existing Huffman codecs, making it particularly suitable for SIMD architectures. Furthermore, by selectively applying ANS-coding to skewed nodes, PivCo-Huffman achieves compression ratios that rival ANS-based codecs while maintaining rapid decompression speeds.
PivCo-Huffman outperforms traditional Huffman codecs in decoding speed while achieving compression ratios comparable to advanced ANS-based methods.
Huffman encoding has been an enduring technique for 70+ years, ubiquitous in compression algorithms since its invention. In this paper we propose a new approach to Huffman coding, based on a data structure from wavelet trees. The resulting pivot-coded Huffman (PivCo-Huffman) enables high-performance SIMD-friendly encoding and decoding operations. In our tests PivCo-Huffman consistently outperforms state-of-the-art Huffman codecs in decoding throughput. Additionally, we show how ANS-coding can be selectively applied to skewed nodes in this structure, yielding compression ratios approaching those of ANS-based codecs while preserving very high decompression speeds.