Markus Hoehnerbach

Papers on Lattice

Total citations

Topics

h-index

Publication activitypapers/week, last 8 weeks

Research focus

Architecture Design (Transformers, SSMs, MoE) (1)Distributed Systems & Hardware (1)Training Efficiency & Optimization (1)

Frequent co-authors

Ted Zadouri (1)Jay Shah (1)Timmy Liu (1)Timothy Liu (1)

Papers (1)

Mar 5, 2026

6d ago

FlashAttention-4: Algorithm and Kernel Pipelining Co-Design for Asymmetric Hardware Scaling

FlashAttention-4 shatters attention bottlenecks on Blackwell GPUs, achieving up to 71% hardware utilization and 2.7x speedups over Triton, thanks to innovations like software-emulated softmax and asynchronous MMA pipelines.

Ted Zadouri, Markus Hoehnerbach, Jay Shah +4

Architecture Design (Transformers, SSMs, MoE)Distributed Systems & Hardware Training Efficiency & Optimization

Search

Markus Hoehnerbach

Publication activitypapers/week, last 8 weeks

Research focus

Frequent co-authors

Papers (1)