Search papers, labs, and topics across Lattice.
This paper introduces ACEAPEX, a novel format that enables position-invariant random access through both entropy and match layers using a single absolute-offset coordinate. By resolving back-references at encode time, ACEAPEX allows for bit-perfect decoding of arbitrary blocks, achieving a seek time of just 0.334ms for a 16KB block. The method's efficiency is validated through a three-phase verification process and demonstrates the capability to utilize up to 25,344 independent parsers on a single H100 GPU, surpassing traditional LZ77 methods.
Achieving bit-perfect random access through dual compression layers in just 0.334ms could revolutionize data retrieval in compressed formats.
Random access into compressed data is normally confined to a single layer. Entropy-layer methods (Recoil) seek within rANS by storing intermediate decoder states; dictionary/match-layer methods seek within LZ-style references. We are not aware of a format that supports a single position-invariant seek through both an entropy layer and a match layer addressed by one coordinate. We show that ACEAPEX's absolute-offset design provides exactly this: because the match layer resolves every back-reference to an absolute position at encode time, and the entropy layer is applied per block, an arbitrary block can be decoded through both layers using one coordinate, bit-perfect, in isolation. We prove this with a three-phase verification that closes the empty-buffer trap. The seek of one 16KB block through ANS-entropy and match completes in 0.334ms. We verify the full entropy+match pipeline end-to-end on four data profiles and characterize the hardware ceiling the format reaches: the absolute-offset structure unrolls to as many as 25,344 independent parsers on one H100, which sequential LZ77 cannot do. We state explicitly what is not claimed: this is a round-trip correctness proof, not a disk-archive format; throughput figures are match-phase; and the unified-seek result is demonstrated for two layers, with three-layer generalization left as a hypothesis. Code and the verification harness are in the project repository.
