Search papers, labs, and topics across Lattice.
Brno University of Technology
1
0
3
GQA's theoretical memory footprint reduction translates to a 2.72x peak on-chip memory utilization decrease in practice, unlocking further power-gating opportunities for embedded transformer inference.