Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
School of Biomedical Engineering, Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei, Anhui, 230026, China, Center for Medical Imaging, Robotics, Analytic Computing & Learning (MIRACLE), Suzhou Institute for Advanced Research, University of Science and Technology of China, Suzhou, Jiangsu, 215123, China, National Key Laboratory of Intelligent Collaborative Computing, University of Electronic Science and Technology of China, Chengdu, 610097, China, Soochow University. Correspond to: mengfanqing33@gmail.com
1
6
3
3
Initializing the DPO reference model *before* training, rather than identically to the policy, unlocks better preference optimization and beats standard DPO.