Search papers, labs, and topics across Lattice.
This paper introduces a structured reinforcement learning framework tailored for Bayesian persuasion in interactive driving, where a lead vehicle influences connected vehicles' route choices through selective information disclosure. By addressing the computational challenges posed by the agent's long-term reward maximization, the authors develop MAPL, a structured policy learning algorithm that enables faster online learning and identifies conditions for effective signaling strategies. The proposed method achieves a 30% improvement in cost efficiency for optimizing travel rewards in real-time lane selection scenarios compared to existing approaches.
A novel structured reinforcement learning approach can enhance persuasive signaling strategies in interactive driving, yielding a 30% boost in cost efficiency for route optimization.
Interactive driving, wherein an intelligent lead vehicle equipped with real-time traffic data coordinates route choices of connected vehicles, offers a promising approach to dynamic traffic management. To address the challenge of harmonising decisions, this paper considers the strategic information revealing framework of Bayesian persuasion. Here, the principal (lead vehicle) aims to guide the agent's (connected vehicle) partially observable sequential decision making towards its own objectives by selectively revealing information, such as real-time traffic ahead, using signals. However, the agent's farsighted response to maximize its long-term reward, renders the principal's signaling strategy design computationally challenging. We propose an online structured reinforcement learning framework to synthesize computationally efficient signaling strategy which is persuasive for a far-sighted agent. The main contributions of the paper are as follows: (i) For a monotonic agent with approximate best response, we propose MAPL, a structured policy learning algorithm for faster online learning, (ii) Identification of sufficient conditions for the supermodular structure of the Q function of the principal for a monotonic agent, (iii) Identification of sufficient conditions to ensure the persuasiveness of the principal's signaling strategy, (iv) Supermodular Q learning for Principal (SQP), which leverages the supermodular structure of principal's action value to synthesize computationally efficient signaling strategy that is persuasive for a monotonic learning agent, (v) Numerical analysis considering a real-time application of Bayesian persuasive driving for lane selection demonstrates that the proposed method is 30% cost efficient for optimising travelling rewards of both the lead and connected vehicle compared to the existing methodologies for signaling strategy design.
