Search papers, labs, and topics across Lattice.
This paper addresses the lack of Modern Greek support in NVIDIA's Nemotron retrieval models by adapting the retrieval stack through corpus mining, synthetic supervision, and fine-tuning processes. The authors demonstrate that a parameter-free BM25 baseline surpasses existing multilingual dense retrieval models on specialized Greek datasets, achieving significant improvements in retrieval effectiveness and generation quality. The introduction of the HERA benchmark and the adaptation of a Nemotron 30B-A3B reader for grounded generation highlight the potential for enhanced performance in legal, financial, and medical applications, with a marked increase in answer correctness and citation quality.
A parameter-free BM25 baseline outperforms advanced multilingual models in retrieving Modern Greek data, revealing the untapped potential of tailored approaches for niche languages.
Modern Greek is absent from NVIDIA's Nemotron retrieval models and from major multilingual retrieval benchmarks, despite being important for retrieval-augmented generation (RAG) in legal, energy, financial, and medical applications. We present an end-to-end adaptation of the Nemotron retrieval stack for Modern Greek, including corpus mining, synthetic supervision, retrieval model training, reranker adaptation, reader fine-tuning, and a new benchmark called HERA. Our study shows that a parameter-free BM25 baseline outperforms several off-the-shelf multilingual dense retrieval models on specialist Greek corpora. After fine-tuning on 65,773 Greek retrieval pairs, a Nemotron 1B embedder improves nDCG@10 from 0.362 to 0.835 and substantially outperforms its unadapted counterpart. The learned language competence transfers to general-domain Greek, although the advantage over BM25 remains domain-dependent. We further adapt a cross-encoder reranker and demonstrate consistent improvements across specialist domains. Finally, we LoRA-tune a Nemotron 30B-A3B mixture-of-experts reader for grounded generation, increasing judged answer correctness from 29.4% to 66.9% while significantly improving faithfulness and citation quality. We also introduce HERA, the first large-scale Greek benchmark for retrieval-augmented generation, and release our adapted models and benchmark to support future research on Greek-language RAG systems.
