Search papers, labs, and topics across Lattice.
The paper introduces Hexagon-MLIR, an open-source MLIR-based compiler stack designed for Qualcomm Hexagon NPUs, enabling unified support for Triton kernels and PyTorch models. The compiler leverages a series of MLIR passes to exploit NPU architecture features, particularly focusing on maximizing data locality within the NPU's Tightly Coupled Memory (TCM). By generating mega-kernels from Triton code, Hexagon-MLIR reduces bandwidth bottlenecks compared to traditional library-based approaches, offering a flexible alternative to commercial toolchains.
Unlock faster AI deployment on Qualcomm NPUs with Hexagon-MLIR, an open-source compiler that generates optimized mega-kernels from Triton and PyTorch models, bypassing the limitations of traditional library-based approaches.
In this paper, we present Hexagon-MLIR,an open-source compilation stack that targets Qualcomm Hexagon Neural Processing Unit (NPU) and provides unified support for lowering Triton kernels and PyTorch models . Built using the MLIR framework, our compiler applies a structured sequence of passes to exploit NPU architectural features to accelerate AI workloads. It enables faster deployment of new Triton kernels (hand-written or subgraphs from PyTorch 2.0), for our target by providing automated compilation from kernel to binary. By ingesting Triton kernels, we generate mega-kernels that maximize data locality in the NPU's Tightly Coupled Memory (TCM), reducing the bandwidth bottlenecks inherent in library-based approaches. This initiative complements our commercial toolchains by providing developers with an open-source MLIR-based compilation stack that gives them a path to advance AI compilation capabilities through a more flexible approach. Hexagon-MLIR is a work-in-progress, and we are continuing to add many more optimizations and capabilities in this effort.
