Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
Zhejiang University, School of Engineering, Westlake University, Shanghai Innovation Institute
1
6
3
2
Initializing the DPO reference model *before* training, rather than identically to the policy, unlocks better preference optimization and beats standard DPO.