Search papers, labs, and topics across Lattice.
ST Engineering Geo-Insights, Singapore
1
0
3
Pre-trained Softmax ViTs can directly bootstrap linear-attention models without expensive pre-training from scratch: simply copy the operator-agnostic MLP weights and distill the attention routing behavior.
