Search papers, labs, and topics across Lattice.
MIT CSAILCaltechDepartment of Civil and EnvironmentalDepartment of Computing and MathematicalGeorgia TechInstitute for DataMathematics and AstronomyOperations Research CenterPurdueSchool of BusinessSchool of Industrial and SystemsThe Division of PhysicsJul 7, 2026arXiv:2607.05863This paper addresses the limitations of standard Large Language Models (LLMs) in negotiation scenarios, particularly when a seller interacts with multiple buyers with private budgets. By employing Reinforcement Learning from Verifiable Rewards (RLVR), the authors train a negotiation agent that effectively balances market exploration and surplus extraction, leading to improved bargaining outcomes. The results indicate that the RLVR-trained seller significantly outperforms existing models by enhancing its negotiation strategies and successfully engaging high-value buyers across diverse scenarios.
LLMs can be trained to negotiate like expert agents, extracting significantly higher surpluses by strategically exploring buyer markets rather than fixating on immediate bids.
Negotiation is a fundamental strategic interaction in management science, characterized by agents attempting to reach agreements while protecting private information, such as reservation costs and hidden valuations. A prevalent yet complex scenario involves a single seller negotiating concurrently with multiple buyers, each possessing heterogeneous, private budgets. In such settings, constrained by a limited number of communication turns, the seller must balance exploring the broader market to discover the highest valuation with concentrating sufficient turns on a single target buyer to secure the best possible outcome. Our analysis reveals a significant gap in standard Large Language Models (LLMs): while these models are linguistically proficient, they fail to act as effective economic decision-makers. Specifically, they exhibit a failure to explore the buyer pool, often fixating on the current highest bid rather than strategically investigating the market to discover latent high valuations. In this paper, we propose a specialized training recipe using Reinforcement Learning from Verifiable Rewards (RLVR). By anchoring the reward function to objective economic outcomes, the strategic balance between market discovery and surplus extraction emerges natively through the learning process. Our results demonstrate that the trained seller undergoes a multi-stage strategic evolution, learning to leverage price anchoring and strategic probing to identify more profitable counterparties. The agent extracts a substantially higher surplus than frontier models by both improving its persuasive bargaining skills and consistently closing deals with high-value buyers. Finally, we show that our seller strategies generalize robustly to unseen buyer negotiation styles and budget distributions.
