Search papers, labs, and topics across Lattice.
This paper introduces Tatoxa, a cutting-edge system for text detoxification specifically designed for the low-resource Tatar language, addressing a significant gap in research on automated content moderation for underrepresented languages. The authors demonstrate that Tatoxa surpasses existing open-source and commercial LLMs in key quality metrics through comparative experiments, highlighting the system's effectiveness in mitigating harmful content. Additionally, they present a new dataset tailored for Tatar, revealing that training on native data significantly outperforms cross-lingual transfer from Russian, even with access to large Russian corpora.
Tatoxa outperforms leading LLMs in detoxifying Tatar text, revealing the critical importance of native data for low-resource language models.
Text detoxification, the automated detection and mitigation of abusive and harmful content, is essential for ensuring the safety of online communities and protecting users. However, low resource languages such as Tatar have received little research attention. In this paper we present Tatoxa, a novel state-of-the-art system for text detoxification in the Tatar language. Comparative experiments show that the proposed approach outperforms existing open source and proprietary commercial LLMs on key quality metrics. We also introduce a new dataset for text detoxification in Tatar, designed for fine tuning and evaluation in low resource settings. Finally, cross lingual transfer experiments indicate that transfer from other languages, including the culturally close Russian, performs significantly worse than training on native Tatar data even when a large Russian corpus is available.
