Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper introduces PubMedCausal, a new span-level annotated corpus for causal relation extraction (CRE) in biomedical text, addressing limitations of existing resources that conflate causality with association or focus on sentence-level annotations. The corpus comprises 30,000 paragraph-level rows with detailed annotations including cause/effect spans, causality type, and sententiality. Benchmarking experiments reveal that while biomedical encoders excel at causal detection (PubMedBERT F1=0.7391), generative models like DeepSeek-R1-32B achieve the best span-level extraction performance (Cosine Pair F1=0.6765), highlighting the challenges posed by class imbalance, long spans, and implicit relations.
Current models still struggle to extract causal relationships from biomedical text, especially when causality is implicit, spans multiple sentences, or involves long cause/effect phrases, despite the availability of large language models.
Causal relation extraction (CRE) is central to biomedical text mining, but current resources often conflate causal relations with broader associations, restrict annotation to sentence-level examples, or focus mainly on explicit causal cues. This limits their usefulness for evaluating whether models can recover causal claims as they are actually expressed in biomedical text. We introduce PubMedCausal, a span-level annotated corpus for biomedical CRE built from PubMed abstracts. The corpus contains 30,000 paragraph-level rows, including 3,945 causal rows and 6,491 adjudicated cause--effect pairs. Each causal relation is annotated with full-text cause and effect spans, causality type, and sententiality, enabling evaluation of both causal detection and full-span causal extraction. We benchmark discriminative encoders and open-source generative models across detection and extraction settings. For causal detection, biomedical encoders are strongest, with PubMedBERT reaching an F$_1$ score of 0.7391. For span-level extraction, the best generative baseline is DeepSeek-R1-32B with few-shot prompting, reaching a Cosine Pair F$_1$ of 0.6765. We further test transfer learning by evaluating PubMedCausal-trained encoders on external causal relation datasets, showing that the resource supports cross-dataset evaluation. Our results show that biomedical CRE remains difficult under class imbalance, long causal spans, implicit causality, inter-sentential relations, and prompt sensitivity. Code and Data can be found here: https://github.com/josiahpaul07/PubMedCausal_Exp