Nitesh Sekhar

Papers on Lattice

Total citations

Topics

Research focus

Architecture Design (Transformers, SSMs, MoE) (1)Distributed Systems & Hardware (1)Training Efficiency & Optimization (1)

Frequent co-authors

Tobias Falke (1)Nicolas Anastassacos (1)Samson Tan (1)Chankrisna Richy Meas (1)Chandana Satya Prakash (1)M Saiful Bari (1)Krishna Kompella (1)Gamaleldin F. Elsayed (1)

Papers (1)

Apr 8, 2026

Tobias Falke +8Apr 8, 2026

MoE Routing Testbed: Studying Expert Specialization and Routing Behavior at Small Scale

MoE routing algorithms that look similar in standard benchmarks can be dissected using the new MoE Routing Testbed, revealing that balancing scope is the key to unlocking expert specialization and utilization.

Tobias Falke, Nicolas Anastassacos, Samson Tan +6

Architecture Design (Transformers, SSMs, MoE)Distributed Systems & Hardware Training Efficiency & Optimization

Nitesh Sekhar

Research focus

Frequent co-authors

Papers (1)

Search

Nitesh Sekhar

Research focus

Frequent co-authors

Papers (1)