Search papers, labs, and topics across Lattice.
Electrical and Computer Engineering Department University of Illinois at Urbana-Champaign
2
0
2
7
Fisher8 reorients gradient updates using Fisher geometry, leading to superior uncertainty predictions without introducing complex hyperparameters.
Vector-based fine-tuning just got an 8x speed boost, rivaling LoRA's performance with a fraction of the parameters, thanks to a clever gradient-informed initialization.
