Raphael Baena

Papers on Lattice

Total citations

Topics

Publication activitypapers/week, last 8 weeks

Research focus

Architecture Design (Transformers, SSMs, MoE) (1)Natural Language Processing (1)Training Efficiency & Optimization (1)

Frequent co-authors

David Picard (1)Nicolas Dufour (1)Lucas Degeorge (1)Arijit Ghosh (1)

Papers (1)

Apr 7, 2026

David Picard +16Apr 7, 2026·also Institut Polytechnique de Paris, LASTIG, Univ Gustave Eiffel, University of Padova

PoM: A Linear-Time Replacement for Attention with the Polynomial Mixer

Attention's quadratic scaling problem? Solved: this new Polynomial Mixer (PoM) matches attention performance at linear complexity across diverse tasks.

David Picard, Nicolas Dufour, Lucas Degeorge +14

Architecture Design (Transformers, SSMs, MoE)Natural Language Processing Training Efficiency & Optimization

Search

Raphael Baena

Publication activitypapers/week, last 8 weeks

Research focus

Frequent co-authors

Papers (1)