Jae Hee Lee

Papers on Lattice

Total citations

Topics

h-index

Research focus

Architecture Design (Transformers, SSMs, MoE) (1)Interpretability & Mechanistic Interp (1)

Frequent co-authors

Jeremy Herbst (1)Stefan Wermter (1)

Papers (1)

Apr 2, 2026

Jeremy Herbst +2Apr 2, 2026

The Expert Strikes Back: Interpreting Mixture-of-Experts Language Models at Expert Level

Forget broad domain specialization – MoE experts are actually fine-grained task specialists, handling everything from LaTeX bracket closing to specific linguistic operations.

Jeremy Herbst, Jae Hee Lee, Stefan Wermter

Architecture Design (Transformers, SSMs, MoE)Interpretability & Mechanistic Interp

Jae Hee Lee

Research focus

Frequent co-authors

Papers (1)

Search

Jae Hee Lee

Research focus

Frequent co-authors

Papers (1)