Search papers, labs, and topics across Lattice.
The authors introduce the MMAI Gym for Science, a comprehensive environment for training and benchmarking foundation models on drug discovery tasks, encompassing diverse molecular data formats and task-specific recipes. They leverage this gym to train a Liquid Foundation Model (LFM), demonstrating that smaller, purpose-trained models can outperform larger general-purpose or specialist models. The LFM achieves near specialist-level performance across key drug discovery tasks, including molecular optimization, ADMET prediction, and retrosynthesis, while maintaining efficiency and broad applicability.
Forget scaling up: a smaller, purpose-trained Liquid Foundation Model (LFM), guided by the MMAI Gym, beats larger general-purpose models at drug discovery tasks.
General-purpose large language models (LLMs) that rely on in-context learning do not reliably deliver the scientific understanding and performance required for drug discovery tasks. Simply increasing model size or introducing reasoning tokens does not yield significant performance gains. To address this gap, we introduce the MMAI Gym for Science, a one-stop shop molecular data formats and modalities as well as task-specific reasoning, training, and benchmarking recipes designed to teach foundation models the 'language of molecules' in order to solve practical drug discovery problems. We use MMAI Gym to train an efficient Liquid Foundation Model (LFM) for these applications, demonstrating that smaller, purpose-trained foundation models can outperform substantially larger general-purpose or specialist models on molecular benchmarks. Across essential drug discovery tasks - including molecular optimization, ADMET property prediction, retrosynthesis, drug-target activity prediction, and functional group reasoning - the resulting model achieves near specialist-level performance and, in the majority of settings, surpasses larger models, while remaining more efficient and broadly applicable in the domain.
