Track trials, findings, and clinical evidence as it lands.
Search papers, labs, and topics across Lattice.
Peking University
2
0
4
Larger momentum coefficients ($β$) are crucial for preserving optimization gains in LLM post-training with noisy rewards, outperforming conventional choices and boosting accuracy by nearly 2% on large models.
High-norm outlier tokens, often preserved by existing methods, are actually redundant and can be pruned without sacrificing performance—SinkPruner proves it with an 89% token reduction while retaining over 96% of model effectiveness.