Viktor Stein

Technische Universität Berlin

Papers on Lattice

Total citations

Topics

Publication activitypapers/week, last 8 weeks

Research focus

Architecture Design (Transformers, SSMs, MoE) (1)Natural Language Processing (1)Training Efficiency & Optimization (1)

Frequent co-authors

Wuchen Li (1)Gabriele Steidl (1)

Papers (1)

Mar 17, 2026

2w ago·also University of South Carolina

SympFormer: Accelerated attention blocks via Inertial Dynamics on Density Manifolds

SympFormer achieves faster convergence in attention blocks by drawing inspiration from inertial Nesterov acceleration, offering a potential speedup without additional computational cost.

Viktor Stein, Wuchen Li, Gabriele Steidl

Architecture Design (Transformers, SSMs, MoE)Natural Language Processing Training Efficiency & Optimization

Search

Viktor Stein

Publication activitypapers/week, last 8 weeks

Research focus

Frequent co-authors

Papers (1)