Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper details UOL@IDEM's approach to the BEA 2026 shared task on predicting vocabulary difficulty with a focus on L1 awareness, employing regression models tailored for Spanish, German, and Mandarin Chinese. The system integrates multilingual contextual representations with engineered features, achieving significant improvements over baseline models, particularly with sentence-embedding encoders like BGE-M3 and LaBSE. Key findings reveal that frequency is the most reliable predictor, while contextual predictability and other features enhance L1-sensitive predictions, although calibration issues arise with easier vocabulary items.
Frequency is the most stable predictor of vocabulary difficulty, but contextual features can significantly enhance L1-aware modeling.
This paper describes UOL@IDEM's closed-track submission to the BEA 2026 shared task on L1-aware vocabulary difficulty prediction. We model the task as regression and train separate systems for Spanish, German, and Mandarin Chinese\footnote{Below we use \emph{Chinese} for brevity.}. Our system combines multilingual contextual representations with engineered features capturing frequency, surface form, retrieval evidence, semantic alignment, cognate similarity, and masked-language-model predictability. Development results show consistent gains over the official closed-track baselines, with sentence-embedding encoders such as BGE-M3, multilingual E5, and LaBSE performing best. Official submissions achieve RMSE scores of 1.132, 1.037, and 0.891 for Spanish, German, and Chinese, respectively. Feature analysis identifies frequency as the most stable predictor, while contextual predictability, form similarity, retrieval, and semantic features provide complementary L1-sensitive signals. Error analysis shows strong ranking performance but weaker calibration for the easiest items, which are often overpredicted. See https://github.com/Nouran-Khallaf/UoL-IDEM-BEA2026-Vocabulary-Difficulty-Prediction