Search papers, labs, and topics across Lattice.
2
0
5
3
Data mixing, especially with instruction-heavy data, emerges as the crucial factor for optimizing VLM training, challenging traditional filtering approaches.
Stop wasting your finetuning data: Specialized Pretraining (SPT) can outperform standard pretraining and finetuning, achieving better domain performance with fewer parameters and less compute.