Search papers, labs, and topics across Lattice.
The paper introduces DPA4, an SE(3)-equivariant interatomic-potential architecture that employs an EMFA SO(2)-equivariant convolution, significantly enhancing the efficiency and accuracy of machine-learning interatomic potentials. By integrating a low-rank edge-node product, multi-focus design, and envelope-gated attention, DPA4 achieves state-of-the-art performance on the Matbench Discovery benchmark while drastically reducing the parameter count and training compute required. Notably, DPA4-Pro and DPA4-Air outperform existing models, achieving superior accuracy with up to 42.9 times less training compute, thereby establishing a new accuracy-cost frontier in this domain.
DPA4 achieves quantum-mechanical accuracy with a fraction of the parameters and training cost, setting a new standard for interatomic potentials.
Machine-learning interatomic potentials now approach quantum-mechanical accuracy on standard benchmarks, but the training cost of the most expressive equivariant architectures has become a serious bottleneck. We introduce DPA4, an SE(3)-equivariant interatomic-potential architecture with an EMFA (Edge-conditioned, Multi-Focus, Attention) SO(2)-equivariant convolution that combines a low-rank edge-node SO(2)-equivariant product, a multi-focus design for message nonlinearity, and envelope-gated attention for message aggregation. A Lebedev-grid projection further preserves SO(3)-equivariance in the nonlinearity to machine precision. A compiler-friendly conservative energy-gradient training path provides up to $\sim$3 times wall-clock speedup under torch.compile. On the compliant Matbench Discovery benchmark, DPA4-Pro attains the best Combined Performance Score (CPS) on the leaderboard, while the 2.76M-parameter DPA4-Air exceeds the accuracy of the 30.1M-parameter eSEN-30M-MP baseline with 10.9$\times$ fewer parameters and 42.9$\times$ less training compute. On SPICE-MACE-OFF, the 5.4M-parameter DPA4-Plus lowers the aggregate molecular energy and force errors of the 6.5M-parameter eSEN baseline by 29% and 30%, while the 2.7M-parameter DPA4-Air still surpasses that baseline with $\sim$2.4$\times$ fewer parameters. Together these results place DPA4 on a new accuracy-cost Pareto frontier on Matbench Discovery and position it as a strong candidate backbone for future multi-task large atomistic model (LAM) pretraining.
Tsinghua AI