Search papers, labs, and topics across Lattice.
MorfFlex is a novel morphological dictionary architecture designed to efficiently handle the complexities of inflection and derivation in languages with rich morphology, exemplified by its application to Czech. By encoding sophisticated inflectional and derivational patterns within a simple list of <wordform, lemma, tag> triplets, MorfFlex dramatically reduces the size of the dictionary while maintaining over 100 million wordforms and more than 1 million lemmas. This resource not only ensures consistency in manual morphological annotation for the Prague Dependency Treebanks but also supports the development of advanced NLP tools like MorphoDiTa.
MorfFlex reduces the size of morphological dictionaries by encoding complex patterns, making it a game-changer for NLP in morphologically rich languages.
We present MorfFlex, a morphological dictionary architecture suitable for languages with extensive regularity in both inflection and derivation. As the primary example of MorfFlex in use we introduce MorfFlex CZ, a morphological dictionary of Czech. It is distributed as a simple, unstructured list of <wordform, lemma, tag> triplets, however, its manually maintained, unpublished source files and conversion scripts encode a sophisticated system of inflectional and derivational patterns. These patterns dramatically reduce the otherwise enormous size of the dictionary, which currently contains over 100 million wordforms and more than 1 million lemmas. The MorfFlex CZ dictionary serves as an essential resource for ensuring the consistency of manual morphological annotation in the Prague Dependency Treebanks and underpins state-of-the-art automatic tools such as MorphoDiTa. In this paper, we focus on: (i) presenting an effective method for managing the rich morphological system within the dictionary, and (ii) demonstrating the utility of such a language resource for maintaining annotation consistency in corpora and supporting the development of advanced NLP applications.
