Search papers, labs, and topics across Lattice.
SinhaLegal is a new corpus of 2 million words of Sinhala legislative text, comprising 1,065 Acts and 141 Bills systematically collected from official sources and processed for machine readability. The corpus was created using OCR via Google Document AI, followed by manual cleaning and the creation of metadata files. Evaluation included corpus statistics, lexical diversity, word frequency analysis, named entity recognition, topic modelling, and perplexity analysis using large and small language models, demonstrating the corpus's suitability for NLP tasks.
A new, meticulously cleaned corpus of Sinhala legal texts opens the door for NLP research in an under-resourced language.
SinhaLegal introduces a Sinhala legislative text corpus containing approximately 2 million words across 1,206 legal documents. The dataset includes two types of legal documents: 1,065 Acts dated from 1981 to 2014 and 141 Bills from 2010 to 2014, which were systematically collected from official sources. The texts were extracted using OCR with Google Document AI, followed by extensive post-processing and manual cleaning to ensure high-quality, machine-readable content, along with dedicated metadata files for each document. A comprehensive evaluation was conducted, including corpus statistics, lexical diversity, word frequency analysis, named entity recognition, and topic modelling, demonstrating the structured and domain-specific nature of the corpus. Additionally, perplexity analysis using both large and small language models was performed to assess how effectively language models respond to domain-specific texts. The SinhaLegal corpus represents a vital resource designed to support NLP tasks such as summarisation, information extraction, and analysis, thereby bridging a critical gap in Sinhala legal research.
