Track the frontier, from condensed matter to cosmology.
Search papers, labs, and topics across Lattice.
This paper introduces Mol-JEPA, a scalable framework designed to learn molecular world models by leveraging modality masking to integrate diverse biochemical data sources. The approach addresses critical limitations in existing molecular foundation models, such as chemically invalid augmentations and modality collapse. Experimental results across multiple benchmarks reveal that Mol-JEPA's representations significantly enhance predictive performance by effectively incorporating biochemical context into latent space predictions.
By integrating diverse biochemical data through modality masking, Mol-JEPA outperforms traditional molecular models, setting a new standard for predictive accuracy in drug discovery.
Despite recent advances in molecular foundation models, several limitations remain, such as chemically invalid augmentations, modality collapse, and incomplete representation of biochemical environments. To address these challenges, we present \textbf{Mol-JEPA}, a scalable framework for learning molecular world models. Rather than relying on suboptimal molecular perturbations, our model uses modality masking to exploit information from molecular structures, cellular phenotypes, binding affinities, ADMET profiles, quantum chemistry simulations and other drug discovery data. Across various benchmarks, we show that the representations learned by Mol-JEPA deliver strong performance, demonstrating the value of incorporating biochemical context through latent space prediction.