Search papers, labs, and topics across Lattice.
This paper addresses the challenge of translating chemical structures from images into line notations, focusing on both optical chemical structure recognition (OCSR) and Markush structure parsing. The authors present OCSRGlyph, a state-of-the-art OCSR model that enhances performance by incorporating stereochemistry, and MarkushGlyph, a vision-language model that processes entire Markush structures in a single step. A novel metric for evaluating Markush structure translations is also introduced, effectively addressing shortcomings in existing evaluation methods.
MarkushGlyph revolutionizes the parsing of complex chemical structures by processing them in a single pass, significantly improving accuracy over traditional multi-stage approaches.
Chemical structures appear in patents and the scientific literature as images. For programmatic usage, such as indexing in databases or constructing machine learning model training sets, they must be transformed into line notations. The two common forms of this task are translating an image of a single molecule (optical chemical structure recognition - OCSR) and translating a Markush structure that represents a family of molecules. While prior work in the former case is quite mature, Markush structure parsing remains a challenging task. In this work, we treat both tasks as an image-to-text translation problem. We then propose OCSRGlyph, a state-of-the-art OCSR model, improving performance over prior methods by carefully considering stereochemistry. For the Markush task, we introduce MarkushGlyph, a vision-language model that reads the entire Markush structure as an image. This contrasts with prior systems, which often use multiple stages to separately process visual and text input content. Finally, we introduce a new metric for determining the accuracy of Markush structure translations, handling failure modes present in prior metrics.
