Search papers, labs, and topics across Lattice.
AtomComposer, a novel reinforcement learning agent, autonomously constructs valid 3D molecular isomers without pre-training data, addressing limitations of dataset-biased generative models. The agent learns online using energy- and validity-based rewards within a multi-composition training scheme, enabling generalization across diverse chemical formulas. AtomComposer discovers up to an order of magnitude more valid isomers on unseen test formulas compared to single-composition RL baselines.
Forget curated datasets – this RL agent autonomously explores chemical space from first principles, discovering significantly more valid molecular isomers than existing methods.
Discovering novel stable molecules without training data remains a grand scientific challenge. Current molecular generative models are trained on large, pre-curated datasets, which introduce biases and limit exploration of novel chemistry. In contrast, we propose a new paradigm: autonomous, generalized agents capable of mapping vast, unknown chemical spaces without any pretraining. For the first time, we present AtomComposer, a self-guided agent that autonomously constructs valid 3D isomers under stoichiometric constraints and is trained exclusively online using reinforcement learning. Unlike existing approaches that generally overfit to a specific chemical formula, we establish a multi-composition training scheme that enables a broad generalization across diverse chemistry, guided by energy- and validity-based rewards. Our agent can discover up to an order of magnitude more valid isomers on unseen test formulas than existing single-composition reinforcement-learning baselines trained with per-step energy rewards. These results fulfill the promise of online reinforcement learning as a powerful paradigm for scalable, from-scratch exploration of chemical configuration space.