Search papers, labs, and topics across Lattice.
This paper introduces ARMOR, an Adaptive Regularized Mixture Optimization method that enhances retrieval-augmented generation (RAG) for telecom question answering by optimizing query-side retriever adaptation instead of generator fine-tuning. The authors demonstrate that their approach, which combines latent-document RAG likelihood and InfoNCE objectives, significantly improves both evidence retrieval and answer generation in low-resource telecom subdomains. Key results show that ARMOR outperforms traditional generator-side adaptation methods across various telecom-specific benchmarks, highlighting its effectiveness in handling fragmented and technical information sources.
ARMOR reveals that optimizing query retrievers can outperform generator fine-tuning in low-resource telecom question answering, enhancing both retrieval and generation performance.
Telecom question answering (QA) is a challenging setting for retrieval-augmented generation (RAG): evidence is fragmented across standards, papers, encyclopedic resources, and web documents, and answers often hinge on technical tables, equations, and specialized protocol language. In low-resource subdomains, generator fine-tuning can over-specialize and degrade general capability, making query-side retriever adaptation an attractive alternative. To this end, we ask whether a fixed-generator, query-adapted RAG system can outperform generator-side adaptation, and which retriever objectives best support that setting. We motivate retrieval, rather than generator fine-tuning, as the adaptation target through a capacity comparison: under bounded-parameter and soft-retrieval assumptions, query-encoder tuning can have a smaller estimation term than supervised fine-tuning when its effective dimension is smaller. We identify two particularly relevant objectives -- the latent-document RAG likelihood, which optimizes generation utility, and the InfoNCE contrastive objective, which improves semantic retrieval geometry -- and leverage them jointly through a retriever optimization method targeting downstream QA performance in the telecom domain. Specifically, we introduce ARMOR, Adaptive Regularized Mixture Optimization for Retrievers, which learns separate temperatures for the RAG retrieval distribution and InfoNCE softmax and regularizes the adapted query encoder toward the frozen base query encoder. Across telecom-specific retrieval and generative QA benchmarks, we show that ARMOR improves evidence retrieval and answer generation in several in-domain settings. Code is available at https://github.com/heshandevaka/ARMOR.git.
