Search papers, labs, and topics across Lattice.
This paper outlines a conceptual framework for creating an electronic explanatory dictionary for the Tajik language by leveraging large language models (LLMs). The research addresses the critical gap in digital lexicographic resources for low-resource languages, proposing an architecture that incorporates morphological analysis, lemmatization, and semantic clustering. Key findings include the effective use of subword tokenization and a parameter-efficient fine-tuning strategy, which together enable the development of a comprehensive dictionary that can enhance various NLP applications for Tajik.
The first holistic framework for a Tajik electronic dictionary could revolutionize NLP applications in low-resource languages.
This paper presents a conceptual framework for developing an electronic explanatory dictionary of the Tajik language using large language models (LLMs). The relevance of the work stems from the absence of a comprehensive digital lexicographic resource for Tajik that is comparable in functionality to dictionaries for high-resource languages, and from the limited adaptation of modern natural language processing technologies to low-resource language systems. Based on a systematic survey of existing linguistic, statistical, and corpus resources, we propose a dictionary architecture that integrates modules for morphological analysis, lemmatization, semantic clustering, and dictionary entry generation using LLMs. The choice of subword tokenization is justified by the agglutinative nature of Tajik morphology and its high morphological variability, along with a parameter-efficient fine-tuning (PEFT) strategy suitable for limited annotated data. The novelty of the work lies in proposing the first holistic conceptual architecture of an explanatory dictionary for Tajik that unifies classical lexicographic methods, language statistics, and generative capabilities of LLMs into a single system. The practical significance of the study is the formation of a methodological foundation for developing a full-featured electronic dictionary that can serve both as a lexicographic tool and as a core resource for machine translation, automatic summarization, sentiment analysis, and other applied NLP tasks. The paper is intended for specialists in computational linguistics, lexicography, and developers of natural language processing systems working with low-resource languages.