Search papers, labs, and topics across Lattice.
Multi-modal alignment in symbolic regression models like SNIP doesn't actually improve during optimization, suggesting current approaches are too coarse to effectively guide symbolic search.
MoEs don't always need learned routers: routing information can be embedded directly in the hidden state.
Takeuchi's Information Criterion (TIC) accurately predicts DNN generalization gaps, but only when models operate near the Neural Tangent Kernel (NTK) regime.
Forget full fine-tuning: this dynamic routing strategy lets you adapt dense retrieval to new domains while using just 2% of the parameters.
