Search papers, labs, and topics across Lattice.
This paper introduces Visual Latent Structural Reasoning (VLSR), an innovative framework that enhances molecular property reasoning by first localizing chemically significant regions in molecular images before conducting reasoning. By employing a localize-then-reason strategy, VLSR effectively combines localization and reasoning tasks, allowing for a more focused analysis of molecular structures. The method achieves a remarkable 9.6X increase in throughput compared to traditional textual-reasoning approaches, highlighting its efficiency and effectiveness in chemical perception tasks.
VLSR's localize-then-reason approach boosts throughput by 9.6X, revolutionizing how we analyze molecular properties from images.
Local chemical perception and property reasoning are both essential for understanding how molecular structure determines properties. Current LLM-based chemical reasoning methods either receive SMILES/molecular images together with descriptions of local motifs, or reason directly from molecular images. Neither approach enables the model to focus on chemically meaningful regions before reasoning. To address this gap, we propose Visual Latent Structural Reasoning (VLSR), an end-to-end framework that jointly learns localization and reasoning from molecular images. Central to our approach is a localize-then-reason strategy. VLSR first learns to locate chemically meaningful regions in a molecular image. It then reasons about their property effects in a compact latent workspace before producing the final answer. Under the same inference setup, this design achieves 9.6X higher throughput than a comparable textual-reasoning baseline.
CMU ML