Search papers, labs, and topics across Lattice.
This paper provides a comprehensive reverse-engineering analysis of the Apple Neural Engine (ANE) across multiple chip generations, including the A11 through A18 and M1 through M5 families. By employing direct measurements and static analysis of the private runtime and firmware, the authors detail the engine's architecture, performance metrics, and the underlying dispatch mechanisms that influence throughput and energy efficiency. Key findings include a documented datapath and roofline performance constraints, alongside a thorough examination of the compiler and weight-compression schemes, revealing critical insights into the ANE's operational capabilities and limitations.
The Apple Neural Engine's undocumented capabilities reveal significant performance insights that could optimize machine learning applications on Apple devices.
The Apple Neural Engine (ANE) is the fixed-function matrix accelerator that has shipped in Apple systems-on-chip since the A11-class iPhone and iPad chips and the M1-class Mac chips, exposed to applications only through the Core ML model framework. This guide reports a reverse-engineered account of the engine, based on direct measurement on Apple silicon and static analysis of the private runtime, compiler, kernel driver, and firmware. It documents the datapath and the roofline that bound the engine's throughput and energy, the dispatch route that reaches it below Core ML, the compiler and on-disk program format, the weight-compression scheme, and the kernel driver, firmware, and command protocol beneath them. The account covers the A11 through A18 and M1 through M5 families, with per-chip target tables and an operation-by-device matrix; the direct measurements are on the M1 and M5. Claims are labeled as measured, decompile-derived, or predicted, and the methodology and open questions are recorded. The direct route is callable from ordinary user space but remains undocumented, unsupported, and version-fragile; it is intended for measurement, research, and on-device work, not for shipping software, where Core ML remains the supported path.
