Search papers, labs, and topics across Lattice.
1
0
2
Activating only half the query heads in Transformers can match the performance of fully active models, slashing computational costs while maintaining accuracy.