Search papers, labs, and topics across Lattice.
This paper introduces a synthetic-organic supervision pipeline to personalize LLMs for individual judges by transforming raw judicial decisions into instruction-tuning data. Parameter-efficient fine-tuning with Causal Language Modeling and synthetic instruction tuning significantly outperforms other personalization baselines across lexical, stylistic, and semantic similarity metrics in Hebrew legal text. The personalized models generate outputs indistinguishable from human judges, demonstrating effective personalization in a low-resource setting.
LLMs can now mimic individual judges' reasoning so well that their outputs are indistinguishable from the real thing, even in low-resource languages.
Despite significant advances in large language models, personalizing them for individual decision-makers remains an open problem. Here, we introduce a synthetic-organic supervision pipeline that transforms raw judicial decisions into instruction-tuning data, enabling parameter-efficient fine-tuning of personalized models for individual judges in low-resource settings. We compare our approach to state-of-the-art personalization techniques across three different tasks and settings. The results show that Causal Language Modeling followed by synthetically generated instruction-tuning significantly outperforms all other baselines, providing significant improvements across lexical, stylistic, and semantic similarity. Notably, our model-generated outputs are indistinguishable from the reasoning of human judges, highlighting the viability of efficient personalization, even in low-resource settings.