Search papers, labs, and topics across Lattice.
3
4
7
0
The DeepSeek-V4.1-Flash model, a multimodal Mixture-of-Experts model with 552B backbone parameters and support for contexts of up to one million tokens, is introduced, substantially improving cost efficiency for agentic workloads and pushing the limits of KV cache compression.
A new framework, Open-MOPD, boosts capability integration in multi-teacher distillation from 35.6% to 83.4% by addressing critical optimization imbalances.
Weak models can teach strong ones how to act better, boosting performance without the heavy lifting of direct RL training.