LatticeTrack papers across labs, topics, and trends.

Papers Digest Topics Labs Collections FAQ

Created by Flynn Lachendro

Papers Digest Topics Labs Saved

Search

Search papers, labs, and topics across Lattice.

Built by Flynn Lachendro·𝕏 / Twitter·RSS··FAQ·Glossary·Privacy

Jorge Gallego-Feliciano

Papers on Lattice

1

Total citations

0

Topics

3

h-index

1

Publication activitypapers/week, last 8 weeks

Research focus

Architecture Design (Transformers, SSMs, MoE) (1)Interpretability & Mechanistic Interp (1)Training Efficiency & Optimization (1)

Frequent co-authors

S. A. McClendon (1)Antonios Saravanos (1)

Papers (1)

Sep 30, 2026

Aimpoint Digital Labs2w ago·also Mistral, NYU

The Life Cycle of a Massive Activation: Stochastic Birth, Weight-Decay-Driven Growth, and Competitive Consolidation

Weight decay, not just learning rate, dictates the peak magnitude and lifespan of massive activations in transformers.

S. A. McClendon, Jorge Gallego-Feliciano, Antonios Saravanos

Architecture Design (Transformers, SSMs, MoE)Interpretability & Mechanistic Interp Training Efficiency & Optimization