Learning Inter-Atomic Potentials without Explicit Equivariance
This work addresses the need for accurate and scalable MLIPs for molecular simulations in fields like drug discovery and material design, offering a novel alternative to current equivariant models.
The paper tackled the problem of machine-learned inter-atomic potentials (MLIPs) by introducing TransIP, a Transformer-based model that learns symmetry compliance without explicit architectural constraints, achieving 40% to 60% improvement in performance compared to a data augmentation baseline on the OMol25 dataset.
Accurate and scalable machine-learned inter-atomic potentials (MLIPs) are essential for molecular simulations ranging from drug discovery to new material design. Current state-of-the-art models enforce roto-translational symmetries through equivariant neural network architectures, a hard-wired inductive bias that can often lead to reduced flexibility, computational efficiency, and scalability. In this work, we introduce TransIP: Transformer-based Inter-Atomic Potentials, a novel training paradigm for interatomic potentials achieving symmetry compliance without explicit architectural constraints. Our approach guides a generic non-equivariant Transformer-based model to learn SO(3)-equivariance by optimizing its representations in the embedding space. Trained on the recent Open Molecules (OMol25) collection, a large and diverse molecular dataset built specifically for MLIPs and covering different types of molecules (including small organics, biomolecular fragments, and electrolyte-like species), TransIP effectively learns symmetry in its latent space, providing low equivariance error. Further, compared to a data augmentation baseline, TransIP achieves 40% to 60% improvement in performance across varying OMol25 dataset sizes. More broadly, our work shows that learned equivariance can be a powerful and efficient alternative to augmentation-based MLIP models.