Search papers, labs, and topics across Lattice.
This paper shifts the analysis of technology development in Natural Language Processing (NLP) from a thematic to an entity-centric perspective by utilizing automatic entity recognition techniques to extract and normalize technology-related entities from research articles. The study reveals that while the average number of entities per paper is increasing, indicating a growing knowledge burden for researchers, pre-trained language models like BERT and Transformer have emerged as dominant forces driving innovation in the field. Additionally, the analysis highlights a notable rise in the acceptance and popularity of new high-impact technologies, suggesting a rapid evolution in NLP research dynamics.
The rise of pre-trained language models has not only reshaped NLP innovation but also intensified the knowledge demands on researchers, with implications for future research directions.
Most studies on technology development have been conducted from a thematic perspective, but the topics are coarse-grained and insufficient to accurately represent technology. The development of automatic entity recognition techniques makes it possible to extract technology-related entities on a large scale. Thus, we perform a more accurate analysis of technology development from an entity-centric perspective. To begin with, we extract technology-related entities such as methods, datasets, metrics, and tools in articles on Natural Language Processing (NLP), and we apply a semi-automatic approach to normalize the entities. Subsequently, we calculate the z-scores of entities based on their co-occurrence networks to measure their impact. We then analyze the development trends of new technologies in the NLP domain since the beginning of the 21st century. The findings of this paper include three aspects: Firstly, the continued increase in the average number of entities per paper implies a growing burden on researchers to acquire relevant technical background knowledge. However, the emergence of pre-trained language models has injected new vitality into the technological innovation of the NLP domain. Secondly, Methods dominate among the 179 high-impact entities. An analysis of the z-score trend about the top 10 entities reveals that pre-trained language models, exemplified by BERT and Transformer, have become mainstream in recent years. Unlike the trend of the other eight method entities, the impact of Wikipedia dataset and BLEU metric has continued to rise in the long term. Thirdly, in recent years, there has been a remarkable surge in popularity for new high-impact technologies than ever before, and their acceptance by researchers has accelerated at an unprecedented speed. Our study provides a new perspective on analyzing technology development in a specific domain.
