Search papers, labs, and topics across Lattice.
The paper introduces MatRIS, a novel invariant machine learning interatomic potential (MLIP) that uses attention-based modeling of three-body interactions to achieve accuracy comparable to state-of-the-art equivariant MLIPs. MatRIS employs a separable attention mechanism with linear complexity, enabling scalability and expressiveness while reducing computational cost. Experiments on benchmarks like Matbench-Discovery demonstrate that MatRIS achieves similar or better accuracy than equivariant models at a lower training cost, suggesting that invariant models can be a more efficient alternative.
Invariant models can match the accuracy of equivariant machine learning interatomic potentials at a fraction of the computational cost, thanks to a novel attention mechanism.
Foundation MLIPs demonstrate broad applicability across diverse material systems and have emerged as a powerful and transformative paradigm in chemical and computational materials science. Equivariant MLIPs achieve state-of-the-art accuracy in a wide range of benchmarks by incorporating equivariant inductive bias. However, the reliance on tensor products and high-degree representations makes them computationally costly. This raises a fundamental question: as quantum mechanical-based datasets continue to expand, can we develop a more compact model to thoroughly exploit high-dimensional atomic interactions? In this work, we present MatRIS (\textbf{Mat}erials \textbf{R}epresentation and \textbf{I}nteraction \textbf{S}imulation), an invariant MLIP that introduces attention-based modeling of three-body interactions. MatRIS leverages a novel separable attention mechanism with linear complexity $O(N)$, enabling both scalability and expressiveness. MatRIS delivers accuracy comparable to that of leading equivariant models on a wide range of popular benchmarks (Matbench-Discovery, MatPES, MDR phonon, Molecular dataset, etc). Taking Matbench-Discovery as an example, MatRIS achieves an F1 score of up to 0.847 and attains comparable accuracy at a lower training cost. The work indicates that our carefully designed invariant models can match or exceed the accuracy of equivariant models at a fraction of the cost, shedding light on the development of accurate and efficient MLIPs.
