Search papers, labs, and topics across Lattice.
2
0
4
CoT transformers can simulate Word RAM algorithms with poly-logarithmic overhead, revolutionizing our understanding of their computational efficiency.
Linear RNNs achieve transformer-like parallelization because they're essentially log-depth arithmetic circuits, while nonlinear RNNs are fundamentally limited by their ability to solve computationally harder problems.