Alexander Koller

Saarland University

Papers on Lattice

Total citations

Topics

Publication activitypapers/week, last 8 weeks

Research focus

Architecture Design (Transformers, SSMs, MoE) (1)Reasoning & Chain-of-Thought (1)Scaling Laws & Emergent Abilities (1)

Frequent co-authors

Oliver Kraus (1)Yash Sarrof (1)Yuekun Yao (1)Michael Hahn (1)

Papers (1)

Apr 28, 2026

Saarland University4d ago·also Ohio State

Barriers to Universal Reasoning With Transformers (And How to Overcome Them)

Chain-of-Thought reasoning in Transformers hits a surprising expressivity ceiling when generalizing to longer sequences, unless you let your vocabulary grow with the problem size and use "signpost" tokens.

Oliver Kraus, Yash Sarrof, Yuekun Yao +2

Architecture Design (Transformers, SSMs, MoE)Reasoning & Chain-of-Thought Scaling Laws & Emergent Abilities

Search

Alexander Koller

Publication activitypapers/week, last 8 weeks

Research focus

Frequent co-authors

Papers (1)