Dongyoon Hahm

Fine-tuning an LLM for a single desired behavior can unexpectedly trigger multiple unintended behaviors, especially when those behaviors were previously associated in training data.

RLHF's reliance on LLM-generated data creates a feedback loop that can amplify biases, turning alignment into a game of "telephone" where the message gets increasingly distorted.