Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study explores cross-lingual relation extraction (RE) for Romanian by leveraging large language models (LLMs) to translate an English benchmark dataset and evaluate various model configurations. The findings reveal that while Romanian shows a consistent drop in performance compared to English, fine-tuning with QLoRA significantly enhances F1 scores and narrows the performance gap. Notably, smaller encoder models can achieve competitive results, suggesting that large models may not be necessary for effective RE in low-resource languages like Romanian.
Fine-tuning a model on a translated dataset can boost F1 scores by over 22 points, making it a game-changer for low-resource language tasks.
Relation extraction (RE) for low-resource languages is typically constrained by the lack of annotated corpora. We investigate the feasibility of cross-lingual RE for Romanian by combining automatic dataset translation with large language model (LLM) inference. We translate the SemEval-2010 Task 8 benchmark from English to Romanian using an LLM-based translation pipeline and evaluate Gemma 4 31B under zero-shot, few-shot, and QLoRA fine-tuned configurations, against four encoder baselines spanning 125M to 560M parameters: XLM- RoBERTa (base and large), Romanian BERT, and RoBERT- large. We assess two task formulations: relation classification with marked entities and end-to-end extraction. Our results show that Romanian incurs a 3 to 5 percentage point (pp) drop relative to English in prompt-only settings, that few-shot prompting provides marginal gains over zero-shot, and that QLoRA fine-tuning improves macro F1-Score by more than 22 percentage points in both languages while reducing the cross-lingual gap from 3.3 to 1.4pp. The encoder baselines come within 1-4pp of QLoRA Gemma on Romanian despite being 50-250 times smaller, with monolingual Romanian BERT at 125M parameters matching multilingual XLM-R at 278M. The case for using a 31B model for single-task RE on Romanian is therefore weak in deployment scenarios where compute matters. We release the translated dataset, evaluation code, and trained models.