Search papers, labs, and topics across Lattice.
This paper introduces a general-purpose macronizer for Ancient Greek, addressing the challenge of disambiguating phonemic vowel lengths in the absence of a publicly available macronized corpus. By utilizing a set of recursive modules, the macronizer allows less common word forms to inherit vowel length markings from more frequent counterparts, facilitating the generation of training data for machine learning models. The results demonstrate that a small character-level transformer trained on the macronizer's output can achieve accuracy comparable to or exceeding that of a gold-standard benchmark, while also enhancing performance in prosodical NLP tasks like verse scansion.
A general-purpose macronizer for Ancient Greek can generate training data that enables machine learning models to outperform traditional methods in vowel length disambiguation.
Prior work in Ancient Greek NLP relies on corpora that do not disambiguate the phonemic vowel length of alpha, iota, and ypsilon, together known as the dichrona. Depending on lexeme, morphology, sandhi, syntax, and conventions of period, genre, and verse form, each of these letters can represent either a long or a short vowel. Deciding and marking the correct length is known as "macronizing", a long-tail problem given the sheer mass of word forms and the context dependency of individual instances. No macronized corpus of Ancient Greek is publicly available at scale, so a stand-alone macronizer is needed. While previous work has shown how to build a static, corpus-bespoke vowel-length dictionary, the present paper constructs the first general-purpose macronizer for arbitrary Ancient Greek input. Given input carrying lemma, part-of-speech, and morphological annotation in the standard CoNLL-U format, a set of recursive modules lets less common word forms inherit markup from more common forms of the same lexical word. The macronizer's chief application is generating training data for machine learning: we show that a small character-level transformer trained on the macronizer's own output learns to generalize past the cases the rule-based system leaves unmarked, matching or exceeding its accuracy on a gold-standard, manually annotated benchmark of verse and prose. We also show that macronization can improve downstream prosodical NLP tasks like verse scansion.