Search papers, labs, and topics across Lattice.
This paper introduces MUSE, a comprehensive knowledge base that extracts Problem-Solution-Rationale (P-S-R) triplets from scientific literature, addressing the need for structured insights into scientific problem-solving. By curating 579 expert-annotated paragraphs and scaling the annotation process to generate 37,000 high-quality P-S-R triplets, the authors provide a valuable resource for understanding the reasoning behind scientific methods. The study also reveals that rationale supervision enhances performance in complex problem-solving scenarios, while potentially hindering simpler tasks, highlighting the nuanced impact of reasoning in AI training.
Rationale supervision can boost performance on complex scientific problems but may backfire on simpler ones, revealing critical insights into AI training dynamics.
Scientific papers contain fine-grained records of problem solving: authors mention technical obstacles and methods that were used to address them, often along with reasoning on why those methods were chosen. We introduce MUSE (Mining Underlying Scientific Explanations), a full-text, multi-domain resource of scientific Problem-Solution-Rationale (P-S-R) triplets. We curate 579 expert-annotated full-text paragraphs, with a rich annotation schema covering salient problem, solution, and rationale spans, solves and rationale_of links and conceptual coreference. A modular extraction pipeline scales this annotation to build a high-quality knowledge base of 37K source-grounded P-S-R triplets. We evaluate the extraction components and include a preliminary experiment training a rationale-supervised LLM for scientific problem solving. Interestingly, we find that rationale supervision improves performance on complex, multi-constraint problems but can harm performance on simpler ones.
