Eitan Gronich

Papers on Lattice

Total citations

Topics

Publication activitypapers/week, last 8 weeks

Research focus

Architecture Design (Transformers, SSMs, MoE) (1)Training Efficiency & Optimization (1)

Frequent co-authors

Gal Vardi (1)

Papers (1)

Feb 18, 2026

Eitan Gronich +13w ago

The Implicit Bias of Adam and Muon on Smooth Homogeneous Neural Networks

Adam and Muon secretly optimize for different margin norms when training homogeneous neural networks, revealing a hidden bias in these popular optimizers.

Eitan Gronich, Gal Vardi

Architecture Design (Transformers, SSMs, MoE)Training Efficiency & Optimization

Search

Eitan Gronich

Publication activitypapers/week, last 8 weeks

Research focus

Frequent co-authors

Papers (1)