Search papers, labs, and topics across Lattice.
This paper introduces OBJECTION, an inference-time pipeline that employs an Adversarial Lawyer Agent to counteract the "Guilty Bias" prevalent in Legal Judgment Prediction (LJP) models, which are often skewed by prosecutorial narratives. By integrating legal defense arguments into a structured three-step reasoning process, the authors demonstrate a significant reduction in the False Guilty Rate from 82.93% to 16.69% using a newly created "Natural Innocent" dataset of real-world cases. This advancement highlights a critical step toward ensuring that AI systems in legal contexts align more closely with the presumption of innocence.
OBJECTION slashes the False Guilty Rate in legal AI predictions from over 82% to under 17% by challenging prosecutorial bias in real-time.
Legal Judgment Prediction (LJP) models are typically trained on documents that describe facts from a prosecutorial perspective. Existing datasets further exhibit severe label imbalance toward guilty outcomes. Consequently, these models suffer from"Guilty Bias", blindly accepting the prosecution's narrative as objective truth. Previous studies employing three-step reasoning structures or training on synthetically generated innocence data improve overall accuracy, but they still fail to mitigate bias at inference time. In this paper, we introduce OBJECTION, an inference-time pipeline that integrates an Adversarial Lawyer Agent into each 3-step reasoning of offense, unlawfulness, and culpability. Unlike generic critics, our agent actively challenges the model's presumptions of guilt by injecting legal defense arguments at each reasoning stage. To thoroughly evaluate this, we present a new"Natural Innocent"dataset including 3.4k real-world cases, overcoming the limitations of synthetic innocence benchmarks. Test results show that OBJECTION drastically reduces the False Guilty Rate (FGR) from 82.93% (SOTA baseline) to 16.69%, proving its capability to perform substantive legal reasoning. This work denotes a key progress toward aligning Legal AI with the presumption of innocence.
