Search papers, labs, and topics across Lattice.
This study explores the use of prompt-based learning for the automatic generation of highlights from academic papers, addressing the challenge posed by the lack of labeled training data in existing supervised methods. By designing task-specific prompt templates and evaluating various language models, including ChatGPT, the authors demonstrate that prompt-based approaches can achieve performance comparable to traditional methods without extensive training datasets. Notably, when supplemented with a few examples, the model significantly surpasses state-of-the-art techniques, highlighting the importance of prompt design in enhancing generation quality.
ChatGPT can generate high-quality academic highlights without the need for extensive labeled datasets, outperforming traditional methods with just a few examples.
Highlights provide a concise summary of the main contributions of an academic paper and help readers quickly understand its focus. However, many journals do not provide highlights, which limits their use in literature retrieval, text mining, and bibliometric analysis. Existing studies have explored supervised learning methods for automatic highlight extraction, but these methods usually require large amounts of labeled training data. This study investigates prompt-based learning for automatic highlight generation. We design task-specific prompt templates and combine them with paper abstracts as model inputs. Several language models are evaluated, including locally deployed pre-trained models such as GPT-2 and T5, as well as ChatGPT accessed through an API. Experiments on three datasets show that ChatGPT with prompt templates achieves performance comparable to previous supervised methods without using task-specific training samples. When a small number of examples are added to the prompts, the model significantly outperforms state-of-the-art methods on two datasets. We further analyze how prompt design affects generation quality and find that, although ChatGPT has strong language modeling ability, its performance on this task is highly sensitive to the information provided in the prompt. Case studies also show that the generated highlights are generally coherent, informative, and close to author-written highlights. This study is among the first to apply prompt-based learning to academic highlight generation. The proposed method does not rely on domain-specific training corpora and can generate highlights for papers that lack such information, thereby supporting downstream text mining and bibliometric research.
