Search papers, labs, and topics across Lattice.
This paper explores the application of Large Language Models (LLMs) for verifying the eligibility of securities as collateral at the German Central Bank, addressing the challenges of traditional Named Entity Recognition methods that struggle with noisy and bilingual text. By employing a generative Information Extraction pipeline that includes extraction, normalization, and interpretation, the authors enhance the flexibility and accuracy of the eligibility examination process. The results show that LLM-based systems can achieve a high precision of up to 91% in document-level eligibility assessments while maintaining a conservative approach to minimize false acceptance rates.
LLMs can achieve 91% precision in verifying securities eligibility, transforming a traditionally labor-intensive process into a more efficient and reliable system.
Verifying the eligibility of securities as collateral is a key responsibility of the German Central Bank. However, manually verifying these assets against legal and financial criteria within lengthy, semi-structured, and often bilingual prospectuses is a resource-intensive task. While previous efforts utilized traditional Named Entity Recognition (NER) for information extraction, these methods can struggle with OCR noise, linguistic variance, and rigid span-based constraints, and the need for manually annotated training data for each relevant annotation type. In this paper, we present the first case study applying Large Language Models (LLMs) to the eligibility examination process, shifting the paradigm toward a generative Information Extraction pipeline. Our approach decomposes the task into extraction, normalization, and interpretation, allowing for greater flexibility in handling noisy text and interleaved German-English content. We further introduce a value-based evaluation methodology using LLM-as-a-judge, which offers a more semantic assessment than location-based metrics. Our results demonstrate that LLM-based systems achieve high precision (up to 91%) in document-level eligibility, exhibiting a conservative operating profile that minimizes false acceptance.