Latticethe structure behind the noise

Papers Digest Topics Selected Labs Collections FAQ

Created by Flynn Lachendro

Papers Digest Topics Labs Saved

Search

Search papers, labs, and topics across Lattice.

Built by Flynn Lachendro·𝕏 / Twitter·RSS··FAQ·Glossary·Privacy

Lukas Gienapp | Lattice

Lukas Gienapp

Seltz, ScaDS.AI Dresden/Leipzig

Papers on Lattice

1

Total citations

0

Topics

3

h-index

2

Publication activitypapers/week, last 8 weeks

Research focus

Architecture Design (Transformers, SSMs, MoE) (1)Inference & Quantization (1)Training Efficiency & Optimization (1)

Frequent co-authors

Christopher Schröder (1)Ferdinand Schlatt (1)Martin Potthast (1)Gerhard Heyer (1)

Papers (1)

Aug 4, 2026

Institute for Applied Informatics at Leipzig3w ago·also hessian.AI, Kassel, ScaDS.AI Dresden/Leipzig, Seltz

When Attention Goes Blind: Numerical Failure in ALiBi Positional Encodings

ALiBi positional encoding can blind attention heads, drastically impairing token retrieval without impacting standard performance metrics.

Christopher Schröder, Lukas Gienapp, Ferdinand Schlatt +2

Architecture Design (Transformers, SSMs, MoE)Inference & Quantization Training Efficiency & Optimization