Search papers, labs, and topics across Lattice.
4
0
6
2
Soofi S outperforms larger European models while maintaining a fraction of the active parameters, redefining the potential of open-source foundation models.
English LLMs dominate math reasoning with a richer set of parameters, while lower-resource languages struggle with significant gaps.
LLMs can get a free performance boost: decoupling compute and capacity within each layer lets you beat standard transformers at the same FLOPs.
Looping helps transformers think harder on math problems, while memory lets them remember more commonsense facts, and combining both beats simply scaling up layers.
