Search papers, labs, and topics across Lattice.
Basic Research of Artificial Intelligence Laboratory (BRAIn Lab)
2
0
3
SGD's noise isn't Brownian motion, and this difference explains why neural nets diffuse along flat valleys in the loss landscape.
LoRA fine-tuning just got a memory-efficient upgrade: LoRSum matches or beats standard LoRA performance by reformulating optimization as a proximal problem and using diagonal K-FAC approximations, all without expensive SVD.
