Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper catalogs 84 numeric formats used in machine learning hardware, including FP8, BF16, and MXFP4, providing a vendor-neutral reference to address the challenges engineers face when porting models across different accelerators. The authors introduce a suite of six bit-exact conformance packs that serve as standardized benchmarks, complete with SHA-256 fingerprints and a shared row schema, enabling precise comparisons and diagnostics. By cross-validating these packs against existing standards, the study highlights specification gaps while ensuring transparency in format interpretations, ultimately facilitating smoother transitions between hardware platforms.
Engineers can now navigate the complex landscape of numeric formats with a comprehensive, vendor-neutral catalog that reveals hidden divergences in model portability.
Numeric format proliferation in machine learning hardware -- FP8 (E4M3 and E5M2), BF16, MXFP4, microscaling block formats, and dozens of research variants -- has outpaced the availability of vendor-neutral, bit-exact reference material. Engineers porting models across accelerators encounter silent divergences that are difficult to diagnose without a shared ruler. This paper describes a catalog of 84 numeric formats spanning 13 families, a suite of six bit-exact conformance packs covering GF16, MXFP4 element, BF16, FP8 E4M3, FP8 E5M2, and E8M0 block scale, and an IEEE P3109 v3.2.0 cross-walk that maps each pack to its corresponding standards-track configured format. Each pack is a self-contained JSON document with a SHA-256 fingerprint, a shared row schema, and an anchor vector that encodes 3.0 -- the identity phi^2 + 1/phi^2 = 3 -- as a cross-pack sanity check. Packs are cross-validated against ml_dtypes 0.5.4 (Google/JAX); any divergence is documented explicitly and interpreted as a spec-permitted interpretation gap rather than hidden. The work is framed as registry filling: it does not propose new formats, make model-accuracy claims, or assert superiority over any vendor's implementation. All artifacts are publicly available at https://github.com/gHashTag/t27 under an open license.