Search papers, labs, and topics across Lattice.
This paper introduces a collaborative multi-agent framework to generate high-quality, role-driven scripts for Murder Mystery Games, designed to improve VLMs' reasoning capabilities under imperfect information. The framework uses a two-stage training strategy: chain-of-thought fine-tuning on curated and synthetic datasets modeling uncertainty and deception, followed by GRPO-based reinforcement learning with agent-monitored reward shaping. Experiments show the method significantly enhances VLMs' narrative reasoning, hidden fact extraction, and deception-resilient understanding in complex multiplayer settings.
Training VLMs on collaboratively generated Murder Mystery scripts dramatically improves their ability to reason about hidden facts and deception in complex, multi-agent scenarios.
Vision-language models (VLMs) have shown impressive capabilities in perceptual tasks, yet they degrade in complex multi-hop reasoning under multiplayer game settings with imperfect and deceptive information. In this paper, we study a representative multiplayer task, Murder Mystery Games, which require inferring hidden truths based on partial clues provided by roles with different intentions. To address this challenge, we propose a collaborative multi-agent framework for evaluating and synthesizing high-quality, role-driven multiplayer game scripts, enabling fine-grained interaction patterns tailored to character identities (i.e., murderer vs. innocent). Our system generates rich multimodal contexts, including character backstories, visual and textual clues, and multi-hop reasoning chains, through coordinated agent interactions. We design a two-stage agent-monitored training strategy to enhance the reasoning ability of VLMs: (1) chain-of-thought based fine-tuning on curated and synthetic datasets that model uncertainty and deception; (2) GRPO-based reinforcement learning with agent-monitored reward shaping, encouraging the model to develop character-specific reasoning behaviors and effective multimodal multi-hop inference. Extensive experiments demonstrate that our method significantly boosts the performance of VLMs in narrative reasoning, hidden fact extraction, and deception-resilient understanding. Our contributions offer a scalable solution for training and evaluating VLMs under uncertain, adversarial, and socially complex conditions, laying the groundwork for future benchmarks in multimodal multi-hop reasoning under imperfect information.
