Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
-Dwarf A/S
1
0
2
Forget separate tuning for low-bit QAT: for sub-100M models, the optimal learning rate schedule is surprisingly consistent across FP16, INT8, and INT6, but INT4 needs special handling.