Search papers, labs, and topics across Lattice.
2
0
5
SoftMoE achieves comparable or superior performance to traditional sparse MoE while activating significantly fewer experts, revolutionizing expert allocation in LLMs.
Vision-language models aren't as entangled as we thought: a simple rotation can reveal surprisingly clean, interpretable features without adding parameters.
