A. Singla

Papers on Lattice

Total citations

Topics

h-index

Research focus

Data Curation & Synthetic Data (1)Red-Teaming & Adversarial Robustness (1)RLHF & Preference Learning (1)

Frequent co-authors

Andi Nika (1)Jonathan Nöther (1)Debmalya Mandal (1)Parameswaran Kamalaruban (1)

Papers (1)

Mar 13, 2025

Andi Nika +5Mar 13, 2025

Policy Teaching via Data Poisoning in Learning from Human Preferences

RLHF and DPO are surprisingly vulnerable to data poisoning, with even a small number of carefully crafted preferences capable of steering the learned policy towards a desired (potentially harmful) target.

Andi Nika, Jonathan Nöther, Debmalya Mandal +3

Data Curation & Synthetic Data Red-Teaming & Adversarial Robustness RLHF & Preference Learning

Search

A. Singla

Research focus

Frequent co-authors

Papers (1)