Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper conducts a comprehensive manual audit of the available parallel and monolingual corpora for Lombard, highlighting significant issues such as language misidentification and non-linguistic noise that undermine the perceived abundance of web-scraped data. The analysis reveals a stark imbalance in the representation of Lombard varieties, with high-quality data predominantly favoring Western Lombard, thereby marginalizing Eastern varieties. These findings emphasize the critical need for community-driven, variety-aware data curation to enhance the development of NLP tools for under-resourced languages like Lombard.
The illusion of plentiful Lombard data is shattered by an audit revealing severe biases and misidentifications that threaten the integrity of NLP applications.
Several of the world's languages are still under-resourced in terms of Natural Language Processing (NLP) tools. This is mostly due to the lack of high-quality datasets to train, develop, and evaluate systems and models for several tasks, such as Machine Translation (MT). We conduct a manual audit of the parallel and monolingual corpora available for Lombard, an under-resourced language continuum from Italy. Our analysis reveals that the perceived abundance of web-scraped data is an illusion, with massive datasets plagued by severe language misidentification, boilerplate text, and non-linguistic noise. Furthermore, we analyze the orthographic composition of the valid Lombard portions across web-scraped datasets, curated corpora, and benchmarks. Our findings show conflicting orthographical systems and severe representational bias across all corpora: high-quality data is heavily skewed towards Western Lombard varieties, with Eastern ones left on the margins. This underscores the need for variety-aware, community-driven data curation rather than purely quantity-driven scraping.