Search papers, labs, and topics across Lattice.
The paper introduces MatProcBench, a new benchmark for evaluating process reasoning in materials synthesis, constructed from literature-mined MatPROV graphs and covering tasks like route continuity and causal consistency. To address this benchmark, they propose ProvMind, a process-memory reasoning framework that retrieves analogous training processes and converts them into provenance-aware option-level compatibility scores for a language model. ProvMind significantly outperforms baselines, achieving 52.84% accuracy on a strict dual out-of-distribution split combining temporal and material-class shifts.
Materials synthesis just got a reasoning upgrade: a new benchmark reveals the limitations of current methods, while a novel provenance-grounded framework leaps ahead in out-of-distribution performance.
Materials process optimization requires reasoning over routes, conditions, tools and causal dependencies, yet most computational formulations flatten synthesis procedures into text or ordered steps. We introduce MatProcBench, a provenance-grounded benchmark constructed from literature-mined MatPROV graphs, to evaluate seven process-reasoning tasks spanning route continuity, step-level variable inference and global causal consistency under both same-split and shift-aware evaluation, including a strict dual-OOD split that combines temporal and material-class shift. We further introduce ProvMind, a process-memory reasoning framework that retrieves analogous training processes, converts them into provenance-aware option-level compatibility scores, and uses a language model for constrained final decision making. ProvMind achieves 52.84\% accuracy on the dual-OOD split, outperforming prompting, retrieval-augmented and supervised fine-tuning baselines.
