Search papers, labs, and topics across Lattice.
Affiliation:
1
0
2
5
Two new tokenisation algorithms are introduced by introducing two new tokenisation algorithms that complete this 2x2 design space: BottomUpLL, a bottom-up likelihood-based tokeniser, and TopDownComp, a top-down compression-based tokeniser.
