Search papers, labs, and topics across Lattice.
1
0
3
5
Parallax achieves a Pareto improvement in LLM pretraining by replacing standard attention with a novel parameterized local linear attention mechanism, demonstrating that architectural innovation in attention can still yield significant gains.
