Search papers, labs, and topics across Lattice.
The paper introduces Legal2LogicICL, a retrieval-augmented in-context learning framework that improves the generalization of LLMs in transforming legal cases into logical formulas. It addresses the scarcity of annotated legal data by balancing diversity and similarity of exemplars at both semantic and structural levels, while mitigating entity-induced retrieval bias. Experiments on Legal2Proleg, a new dataset of legal cases aligned with PROLEG logical formulas, show significant improvements in accuracy, stability, and generalization compared to existing approaches.
LLMs can now translate legal cases into logical formulas with significantly improved accuracy and stability, thanks to a novel retrieval-augmented in-context learning approach that carefully balances exemplar diversity and mitigates entity bias.
This work aims to improve the generalization of logic-based legal reasoning systems by integrating recent advances in NLP with legal-domain adaptive few-shot learning techniques using LLMs. Existing logic-based legal reasoning pipelines typically rely on fine-tuned models to map natural-language legal cases into logical formulas before forwarding them to a symbolic reasoner. However, such approaches are heavily constrained by the scarcity of high-quality annotated training data. To address this limitation, we propose a novel LLM-based legal reasoning framework that enables effective in-context learning through retrieval-augmented generation. Specifically, we introduce Legal2LogicICL, a few-shot retrieval framework that balances diversity and similarity of exemplars at both the latent semantic representation level and the legal text structure level. In addition, our method explicitly accounts for legal structure by mitigating entity-induced retrieval bias in legal texts, where lengthy and highly specific entity mentions often dominate semantic representations and obscure legally meaningful reasoning patterns. Our Legal2LogicICL constructs informative and robust few-shot demonstrations, leading to accurate and stable logical rule generation without requiring additional training. In addition, we construct a new dataset, named Legal2Proleg, which is annotated with alignments between legal cases and PROLEG logical formulas to support the evaluation of legal semantic parsing. Experimental results on both open-source and proprietary LLMs demonstrate that our approach significantly improves accuracy, stability, and generalization in transforming natural-language legal case descriptions into logical representations, highlighting its effectiveness for interpretable and reliable legal reasoning. Our code is available at https://github.com/yingjie7/Legal2LogicICL.
