Search papers, labs, and topics across Lattice.
Institute of Advanced Intelligence and Computing (IAIC), A*STAR, Singapore
1
0
3
Pre-trained Softmax ViTs can directly bootstrap linear-attention models without expensive pre-training from scratch: simply copy the operator-agnostic MLP weights and distill the attention routing behavior.
