Search papers, labs, and topics across Lattice.
2
0
5
16
Kimi Delta Attention with Muon outperforms other architectures in validation loss, while introducing Cross-Layer Value Routing reveals new avenues for optimizing memory management in linear attention models.
Training a 70B parameter open-source LLM on a supercomputer reveals the hidden engineering hurdles and infrastructure adaptations needed to democratize large-scale AI development beyond the private sector.
