Eugene Ie

Google

Google Research

Papers on Lattice

Total citations

Topics

Publication activitypapers/week, last 8 weeks

Research focus

Architecture Design (Transformers, SSMs, MoE) (1)Natural Language Processing (1)Training Efficiency & Optimization (1)

Frequent co-authors

Taejong Joo (1)Wenhan Xia (1)Cheolmin Kim (1)Ming Zhang (1)

Papers (1)

Feb 17, 2026

Google Research3w ago·also Northwestern

On Surprising Effectiveness of Masking Updates in Adaptive Optimizers

Randomly masking parameter updates in RMSProp delivers state-of-the-art LLM training performance, revealing a surprisingly effective form of geometric regularization.

Taejong Joo, Wenhan Xia, Cheolmin Kim +2

Architecture Design (Transformers, SSMs, MoE)Natural Language Processing Training Efficiency & Optimization

Search

Eugene Ie

Publication activitypapers/week, last 8 weeks

Research focus

Frequent co-authors

Papers (1)