Vatsal Sharan

University of Southern California ψ UC San Diego

Papers on Lattice

Total citations

Topics

Publication activitypapers/week, last 8 weeks

Research focus

Architecture Design (Transformers, SSMs, MoE) (1)Interpretability & Mechanistic Interp (1)Natural Language Processing (1)Scaling Laws & Emergent Abilities (1)

Frequent co-authors

Deqing Fu (1)Tianyi Zhou (1)Mikhail Belkin (1)V. Sharan (1)

Papers (1)

Apr 22, 2026

3d ago·also UCSD

Convergent Evolution: How Different Language Models Learn Similar Number Representations

Despite architectural differences, language models converge on similar periodic features for representing numbers, but geometric separability requires specific training conditions.

Deqing Fu, Tianyi Zhou, Mikhail Belkin +3

Architecture Design (Transformers, SSMs, MoE)Interpretability & Mechanistic Interp Natural Language Processing+1

Search

Vatsal Sharan

Publication activitypapers/week, last 8 weeks

Research focus

Frequent co-authors

Papers (1)