Search papers, labs, and topics across Lattice.
This paper introduces E-commerce Dispute Verdicts (EDV), a new task and benchmark (VerdictBench) for simulating crowdsourced e-commerce dispute resolution, which requires reasoning over multi-round, multimodal evidence. To address the complexities of this task, the authors propose CyberJurors, a multi-agent framework that decomposes the verdict process into structured reasoning stages and simulates jury consensus. Experiments on VerdictBench demonstrate that CyberJurors outperforms existing LLMs, MLLMs, and court simulators, while better aligning with real-world jury voting patterns.
LLMs can now simulate e-commerce dispute resolution more effectively than existing methods, thanks to a multi-agent framework that mimics the deliberation and voting patterns of crowdsourced jurors.
E-commerce platforms have begun recruiting crowdsourced jurors to adjudicate massive volumes of transaction disputes. Unlike formal legal judgment, E-commerce dispute verdicts require grounding pivotal clues from redundant, multi-round, multimodal evidence and making decisions under flexible platform-specific conventions. These characteristics render existing methods insufficient for this scenario. To bridge this gap, we introduce a pioneering task, E-commerce Dispute Verdicts (EDV), and present VerdictBench, a multimodal benchmark comprising 6,000 real-world cases designed to reflect crowdsourced jury decisions. Building upon this, we propose CyberJurors, a multi-agent framework to clarify the dispute logic and regulate the verdict process. At the individual level, Individual Verdict Chain-of-Thought decomposes the EDV task into four structured reasoning stages, enabling fine-grained clue perception and clarifying causal logic between pivotal clues and the dispute focus. At the collective level, Jury Consensus Verdict simulates multi-round discussion and voting among jurors, while incorporating verdict precedents to mitigate cognitive biases toward either disputant. Experiments on VerdictBench show that CyberJurors outperforms state-of-the-art LLMs, MLLMs, and court simulators, while achieving stronger alignment with real-world jury voting patterns. Code and dataset are available at https://github.com/YanhuiS/CyberJurors and https://huggingface.co/datasets/piggi/VerdictBench.
