Papers Digest Topics Labs Collections FAQ

Track papers across labs, topics, and trends.

Papers Digest Topics Labs Saved

Search

Search papers, labs, and topics across Lattice.

Lattice AI Lattice Medical Lattice Physics Lattice Chemistry Lattice Maths Lattice Robotics Lattice Biology

Built by Flynn Lachendro·𝕏 / Twitter·RSS··FAQ·Glossary·Privacy

Yaomengxi Han

Papers on Lattice

1

Total citations

0

Topics

3

Publication activitypapers/week, last 8 weeks

Research focus

Architecture Design (Transformers, SSMs, MoE) (1)Interpretability & Mechanistic Interp (1)Training Efficiency & Optimization (1)

Frequent co-authors

Debarghya Ghoshdastidar (1)

Papers (1)

Oct 14, 2026

TU Munich4d ago

Training Dynamics of Transformers on Unbounded Inputs: Attention Learning Can Lag Output Layer Learning

For star-free languages, transformers learn best when attention weights lag behind output layer updates, defying intuitive feature learning theories.

Yaomengxi Han, Debarghya Ghoshdastidar

Architecture Design (Transformers, SSMs, MoE)Interpretability & Mechanistic Interp Training Efficiency & Optimization