Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The authors systematically evaluate annotation sample complexity and cross-lingual data pooling across 28 African language-task pairs (MasakhaNEWS and AfriSenti) using a lightweight character n-gram linear baseline. They establish that while news topic classification hits 90% of asymptotic macro-F1 with roughly 400 labels, tweet sentiment requires thousands of annotations to saturate. Crucially, cross-lingual data pooling offers massive performance gains (+0.20 macro-F1) at ultra-low budgets (25 labels) but consistently flips into negative transfer once in-language training data exceeds 800 examples.
Cross-lingual data pooling acts as a powerful low-resource jumpstart—boosting macro-F1 by up to 0.43 at 25 labels—but predictably degenerates into negative transfer once local annotations surpass 800 examples.
Every text classifier for an African language begins with a budgeting question: how many labelled examples are needed, and can labels from other African languages stand in for them? We answer both questions empirically for 28 language-task pairs, news topic classification in 16 languages (MasakhaNEWS) and tweet sentiment in 12 languages (AfriSenti), using a character n-gram linear model that trains in seconds on two CPU cores with no pretrained weights and no accelerator. Monolingual learning curves at budgets from 25 to several thousand labels show that topic classification reaches 90\% of its full-data macro-F1 with about 400 labels in the median language, while sentiment is still improving at the full training size in 11 of 12 languages and needs thousands of labels. Pooling the full training data of the other languages in the benchmark is worth a great deal at small budgets and nothing at large ones: at 25 target labels it adds 0.20 macro-F1 on average for news (up to 0.43 for Lingala) and 0.08 for sentiment, the gain decays to zero by 800 labels, and at full size pooling hurts in 9 of 16 and 8 of 12 languages. Twenty-five target labels plus pooled data match what 100 to 400 monolingual labels achieve for most news languages. A complete zero-shot transfer matrix shows that transfer without any target labels recovers a median of only 13\% (news) and 4\% (sentiment) of the gap between a majority-class predictor and the in-language model, with the exceptions explained by shared script (Amharic and Tigrinya), shared lexicon (English and Nigerian Pidgin, the Arabic dialects), or a shared label prior rather than by language family. We release code that regenerates every number from the public benchmark files and translate the results into concrete annotation guidance for teams building African-language classifiers without GPUs.