Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces EmoDistill, an offline framework for training language model agents to strategically use emotion in adversarial negotiation. EmoDistill decomposes the problem into emotion selection (using Implicit Q-Learning) and expression (using LoRA-based policy learning via SFT and JPO). Experiments across four negotiation domains demonstrate that EmoDistill significantly improves agent utility compared to vanilla SLMs/LLMs and IQL-only baselines, highlighting the strategic importance of emotion in negotiation.
LLMs optimized for human-like politeness are pushovers in negotiation, but EmoDistill unlocks their inner Machiavelli by teaching them to weaponize emotions for strategic advantage.
Post-trained LLMs are often optimized to align responses with human preferences, making them safe, polite, and conversationally appropriate. In adversarial negotiation, however, this alignment can become a vulnerability: emotionally framed language may steer agents toward the counterparty's interests. Using GoEmotions-based affective prompting, we show that emotion substantially shifts negotiation outcomes, suggesting that emotion is a strategic action channel rather than a surface style. Thus, we introduce \textbf{EmoDistill}, an offline framework for distilling emotional negotiation skills into language model agents. EmoDistill decomposes emotional strategy into emotion selection and emotion expression: an Implicit Q-Learning (IQL) selector learns \emph{which} emotion to express, while a Low-Rank Adaptation (LoRA)-based policy learns \emph{how} to express it through Supervised Fine-Tuning (SFT) and Judge Policy Optimization (JPO). Across four emotion-sensitive, high-stakes negotiation domains, SLM policies trained under the EmoDistill framework achieve the highest utility, outperforming vanilla SLM/LLM baselines and IQL-only emotion selection. Ablations show that emotion conditioning is essential, and transfer studies demonstrate generalization across domains, unseen counterparties, and trained-vs-trained tournaments. Overall, EmoDistill learns skills from offline agent-to-agent interactions, avoiding costly online negotiation during training.
TU Munich