Search papers, labs, and topics across Lattice.
3
0
6
4
This work proposes Abstract Token Curriculum (ATC), a novel curriculum learning framework that elicits effective continuous intermediate representations without direct supervision or manual scratchpad design and shows ATC's effectiveness on graph reachability and arithmetic learning tasks.
It is shown that this gating mechanism causes SSMs to first learn an in-weights"memorization"solution, while delaying, or even preventing, convergence to a correct in-context learning solution, and that gating is often beneficial for improving generalization to long sequence lengths.
Closed-source AI models can outperform open-weight counterparts by 10% on seemingly simple tasks, revealing hidden vulnerabilities in multimodal systems.
