Search papers, labs, and topics across Lattice.
This paper investigates the effectiveness of active learning (AL) for chemical reaction extraction using transformer-CRF architectures, focusing on product extraction and role labeling. The authors integrate six uncertainty- and diversity-based AL strategies and find that while some methods approach full-data performance with less data, learning curves are unstable and task-dependent. They attribute this instability to strong pretraining, structured CRF decoding, and label sparsity, highlighting limitations of conventional AL in this domain.
Active learning's promise of efficient annotation falls flat in chemical reaction extraction, with strong pretraining and structured decoding creating instability.
The rapid growth of chemical literature has generated vast amounts of unstructured data, where reaction information is particularly valuable for applications such as reaction predictions and drug design. However, the prohibitive cost of expert annotation has led to a scarcity of training data, severely hindering the performance of automatic reaction extraction. In this work, we conduct a systematic study of active learning for chemical reaction extraction. We integrate six uncertainty- and diversity-based strategies with pretrained transformer-CRF architectures, and evaluate them on product extraction and role labeling task. While several methods approach full-data performance with fewer labeled instances, learning curves are often non-monotonic and task-dependent. Our analysis shows that strong pretraining, structured CRF decoding, and label sparsity limit the stability of conventional active learning strategies. These findings provide practical insights for the effective use of active learning in chemical information extraction.
