Search papers, labs, and topics across Lattice.
Affiliation:
1
0
1
A thorough investigation of distance generalization probes performance when inter-token distances are changed between training and inference, while keeping a fixed context length, finding that it is paramount to improve the understanding of the underlying mechanisms.