Search papers, labs, and topics across Lattice.
Affiliation:
1
0
3
Freezing the input factor A in LoRA, especially on top singular directions, unlocks substantial performance gains over freezing the output factor B, even at rank 2.