Search papers, labs, and topics across Lattice.
East China Normal University, Tsinghua University, Hebei University of Science and Technology
Tsinghua AI1
5
3
2
Using preference data from stronger models to align LLMs via DPO can backfire, dramatically worsening safety by making models more susceptible to jailbreaking.
