Track new results across pure and applied mathematics.
Search papers, labs, and topics across Lattice.
This paper introduces Latent JEPA, a framework that integrates autoregressive learning with joint-embedding prediction of future states to enhance latent reasoning in chemistry. By training continuous latent thoughts to anticipate informative aspects of future solutions, the model aims to mimic human chemical intuition, complementing explicit analysis. Experiments on ChemCoTBench demonstrate improved performance in molecular optimization and editing tasks, with representation analyses confirming that future prediction enriches latent representations with chemical structure information.
Abstract future prediction in latent space significantly boosts LLMs' chemical reasoning and molecular outcome prediction capabilities.
Large language models offer a promising foundation for chemical reasoning, bringing together chemical knowledge and multistep problem solving. Chemical intuition can provide an initial sense of plausible outcomes before the details of a solution are fully worked out. Inspired by how such expectations complement explicit analysis, we study how continuous latent thoughts can be trained to anticipate informative aspects of future solutions without verbalizing every intermediate step. We introduce Latent JEPA, a framework that combines autoregressive learning with joint-embedding prediction of one or more future views. For chemical reasoning, we develop textual and molecular prediction objectives that connect latent thoughts to both subsequent reasoning and molecular outcomes. Experiments on ChemCoTBench show gains in molecular optimization and on several editing and reaction metrics. Representation analyses show that future prediction makes latent thoughts more informative about molecular outcomes and strengthens their correspondence with chemical structure. These findings support abstract future prediction as a learning principle for connecting continuous latent reasoning with scientific outcomes.