Jesse Roberts

The best reward model for aligning LLMs with social interaction data isn't the one that best predicts social rewards, but one that focuses on conversational context, revealing a surprising disconnect between reward prediction accuracy and downstream task performance.