Search papers, labs, and topics across Lattice.
This paper introduces CoMPASS, a framework that synergizes small graph attention networks (GATs) with large language models (LLMs) for enhanced molecular property prediction. By employing a retrieval-calibrated approach, CoMPASS allows the GAT to leverage LLM-generated insights selectively, improving predictions in areas of uncertainty while maintaining high confidence in reliable predictions. The results demonstrate significant performance gains across multiple benchmarks, highlighting the effectiveness of evidence-grounded corrections over direct LLM outputs.
CoMPASS achieves a remarkable balance, enhancing molecular predictions by intelligently integrating LLM insights only when uncertainty is high, leading to improved accuracy without sacrificing reliability.
Accurate molecular property prediction requires both statistical reliability and chemical reasoning. Graph neural networks can be calibrated directly on labeled assays but remain limited by the coverage of their training data. Large language models (LLMs) can compare molecular evidence and articulate chemical rationales, yet are unreliable as standalone quantitative predictors. The central challenge is therefore to determine when an LLM should influence a calibrated model and by how much. Here we present CoMPASS, a retrieval-calibrated framework for small-large model collaboration. CoMPASS retains a graph attention network (GAT) as the predictive anchor, retrieves locally relevant training molecules, provides attention-grounded evidence to an LLM, and converts its proposal into a bounded correction through an agreement-aware gate. Across six classification and two regression benchmarks, CoMPASS improves the GAT anchor in regions of correctable uncertainty while limiting LLM intervention in high-confidence regimes. Ablations show that the gains arise from validation-calibrated retrieval and bounded fusion rather than prompting alone. These results suggest that generative reasoning should augment calibrated prediction through evidence-grounded, controlled corrections rather than direct output replacement. Code is available at https://github.com/littlepeachs/CoMPASS.
Tsinghua AI