Search papers, labs, and topics across Lattice.
This paper details the development of a quantized, integer-only transformer model specifically designed for jet tagging in resource-constrained environments like the CERN LHC trigger systems. The authors introduce a reusable software framework that translates high-level Python model descriptions into optimized Vitis graph code, enabling efficient mapping of dense and multi-head attention layers to AMD Versal AI Engine tiles. The framework not only enhances the deployment of transformer models in low-latency applications but is also made available as open-source software, fostering further research in this area.
A novel software framework transforms high-level transformer models into efficient, deployable components for low-latency jet tagging on advanced AI hardware.
Transformer-based models achieve strong performance for jet tagging at the CERN LHC, but deploying them in low-latency, resource-constrained trigger systems is challenging. We present an initial implementation of a quantized, integer-only transformer for jet tagging on the AMD Versal AI Engine (AIE), mapping dense and multi-head attention (MHA) layers to AIE tiles. The main contribution is a reusable software framework that represents transformer layers as composable AIE building blocks and automatically generates the corresponding Vitis graph code from a high-level Python model description. This framework provides a foundation for future research and is released as open-source software at https://github.com/KastnerRG/particle_transformer_aie.
