Search papers, labs, and topics across Lattice.
This paper investigates the limitations of conventional SO(2) linear architectures for machine learning interatomic potentials (MLIPs) and introduces two novel interaction building blocks: the Edge Complex Product Basis and Radial Rotary Complex Attention (RRA). By leveraging Clebsch-Gordan Tensor Products for higher-order interactions and enhancing extrapolation performance, the proposed methods significantly improve the modeling of interatomic potentials. The resulting model, TECE-OAM-RRA-1.0, achieves state-of-the-art performance on the Matbench Discovery benchmark, demonstrating the effectiveness of these innovations.
Radial Rotary Complex Attention transforms interatomic potential modeling, achieving state-of-the-art performance by enhancing extrapolation capabilities.
In this paper, we provide a systematic investigation of SO(2) theory to machine learning interatomic potentials (MLIPs) and identify the limitations of conventional SO(2) Linear architectures relative to SO(3) Clebsch-Gordan Tensor Products (CGTP). Building on these insights, we propose direct Cartesian construction and recursive Clebsch-Gordan construction of Wigner D-matrices and introduce two novel interaction building blocks. First, we propose the Edge Complex Product Basis based on Generalized Asymmetric Contraction, a new formulation for many-body expansion that directly constructs higher-order interactions on edges through complex-valued equivariant multiplications. Second, we introduce Radial Rotary Complex Attention(RRA), which enhances extrapolation performance and surpasses existing attention vector formulations. We also introduce several improvements to the Atomic Cluster Expansion module. Building on these advances, we train our models on OMat24, sAlex, and MPTrj, and introduce TECE-OAM-RRA-1.0, which achieve state-of-the-art (SOTA) performance on the Matbench Discovery.
