Search papers, labs, and topics across Lattice.
2
0
2
1
Retaining more copies of low-frequency content while aggressively pruning high-frequency duplicates can significantly boost model performance during pretraining.
Book-level organization of synthetic data boosts language model performance by over 1% compared to traditional methods, highlighting the power of structured content.