Search papers, labs, and topics across Lattice.
This paper introduces NE-R1, a novel framework that enhances Named Entity Recognition (NER) by integrating a "retrieval-on-demand" mechanism through reinforcement learning. By employing a two-stage training method that combines multi-task instruction tuning with end-to-end reinforcement learning optimization, NE-R1 effectively balances the use of parametric knowledge and external retrieval. The framework demonstrates state-of-the-art performance improvements, achieving an average F1 score gain of 2.52% in in-domain evaluations and 1.18% in zero-shot cross-domain scenarios.
NE-R1 achieves a remarkable 2.52% F1 score improvement in in-domain NER tasks by intelligently balancing parametric and external knowledge retrieval.
Named Entity Recognition (NER) has achieved substantial progress since the advent of large language models (LLMs). Nevertheless, the recognition of long-tail and domain-specific entities remains challenging due to the deficiency in parametric knowledge. Retrieval-augmented generation (RAG) offers a promising remedy by injecting external knowledge, but it also introduces noise and unnecessary cost when dealing with familiar cases. In this paper, we propose NE-R1, a novel framework for adaptive retrieval-augmented NER. We design a "retrieval-on-demand" mechanism for NER. Then we integrate it into models by a two-stage training method: (1) multi-task instruction tuning initialization; (2) end-to-end RL optimization with CoT. To achieve reasonable selection between parameterized and external knowledge, we design a multi-dimensional reward considering both accuracy and retrieval benefit. NE-R1 achieves state-of-the-art performance on various benchmarks, with an average F1 score gain of 2.52% in in-domain evaluation and 1.18% in zero-shot cross-domain evaluation.
