Search papers, labs, and topics across Lattice.
This paper benchmarks four GNN architectures (GCN, GraphSAGE, GIN, GAT) on molecular regression tasks across diverse datasets and introduces a GNN+fingerprint fusion framework. The fusion framework consistently outperforms standalone GNNs and baseline models, achieving RMSE improvements greater than 7%. Centered Kernel Alignment (CKA) reveals that GNN and fingerprint embeddings occupy distinct latent spaces, while GCN, GraphSAGE, and GIN exhibit high representational similarity.
Fusing GNNs with molecular fingerprints boosts prediction accuracy by over 7% on molecular property tasks, but CKA reveals that these methods learn surprisingly independent representations.
Molecules are commonly represented as SMILES strings, which can be readily converted to fixed-size molecular fingerprints. These fingerprints serve as feature vectors to train ML/DL models for molecular property prediction tasks in the field of computational chemistry, drug discovery, biochemistry, and materials science. Recent research has demonstrated that SMILES can be used to construct molecular graphs where atoms are nodes ($V$) and bonds are edges ($E$). These graphs can subsequently be used to train geometric DL models like GNN. GNN learns the inherent structural relationships within a molecule rather than depending on fixed-size fingerprints. Although GNN are powerful aggregators, their efficacy on smaller datasets and inductive biases across different architectures is less studied. In our present study, we performed a systematic benchmarking of four different GNN architectures across a diverse domain of datasets (physical chemistry, biological, and analytical). Additionally, we have also implemented a hierarchical fusion (GNN+FP) framework for target prediction. We observed that the fusion framework consistently outperforms or matches the performance of standalone GNN (RMSE improvement > $7\%$) and baseline models. Further, we investigated the representational similarity using centered kernel alignment (CKA) between GNN and fingerprint embeddings and found that they occupy highly independent latent spaces (CKA $\le0.46$). The cross-architectural CKA score suggests a high convergence between isotopic models like GCN, GraphSAGE and GIN (CKA $\geq0.88$), with GAT learning moderately independent representation (CKA $0.55-0.80$).
