Search papers, labs, and topics across Lattice.
2
2
1
3
It is proved that symmetric losses enable successful policy improvement even with noisy labels, as the resulting reward is rank-preserving鈥攁 property that is identified as sufficient for policy improvement.
Even with noisy human preferences, symmetric losses can guarantee rank-preserving rewards, unlocking robust policy optimization for aligning language models.