Search papers, labs, and topics across Lattice.
2
0
5
Motif 3 achieves unprecedented efficiency and performance in language modeling by leveraging a novel Mixture-of-Experts architecture that activates only a fraction of its parameters per token.
Architectural specialization and an efficient training approach enable Motif-Video 2B to outperform larger models with a fraction of the resources.
