Search papers, labs, and topics across Lattice.
This paper addresses the challenge of extracting problem and method sentences from scientific papers, which is hindered by the limitations of small-scale annotated datasets. By introducing formulaic expression (FE) desensitization and a context-enhanced transformer, the authors enhance dataset scale and reduce model reliance on specific forms, leading to improved generalization. Experiments demonstrate that their approach achieves a higher macro F1 score, with improvements of 3.71% and 2.67% over baseline models on two datasets, while revealing that LLM-based in-context learning methods are inadequate for this task.
Formulaic expression desensitization not only boosts dataset scale but also enhances model generalization in extracting key sentences from scientific literature.
Billions of scientific papers lead to the need to identify essential parts from the massive text. Scientific research is an activity from putting forward problems to using methods. To learn the main idea from scientific papers, we focus on extracting problem and method sentences. Annotating sentences within scientific papers is labor-intensive, resulting in small-scale datasets that limit the amount of information models can learn. This limited information leads models to rely heavily on specific forms, which in turn reduces their generalization capabilities. This paper addresses the problems caused by small-scale datasets from three perspectives: increasing dataset scale, reducing dependence on specific forms, and enriching the information within sentences. To implement the first two ideas, we introduce the concept of formulaic expression (FE) desensitization and propose FE desensitization-based data augmenters to generate synthetic data and reduce models' reliance on FEs. For the third idea, we propose a context-enhanced transformer that utilizes context to measure the importance of words in target sentences and to reduce noise in the context. Furthermore, this paper conducts experiments using large language model (LLM) based in-context learning (ICL) methods. Quantitative and qualitative experiments demonstrate that our proposed models achieve a higher macro F1 score compared to the baseline models on two scientific paper datasets, with improvements of 3.71% and 2.67%, respectively. The LLM based ICL methods are found to be not suitable for the task of problem and method extraction.
