Search papers, labs, and topics across Lattice.
Northwestern University, Work done while the author was a Student Researcher at Google.
Google Research1
0
3
Randomly masking parameter updates in RMSProp delivers state-of-the-art LLM training performance, revealing a surprisingly effective form of geometric regularization.