Search papers, labs, and topics across Lattice.
This study investigates the relationship between the syntactic and semantic representations of scientific formulae, revealing a weak observable correspondence despite a strong latent correlation. By employing graph-based encoders for syntax and text-based encoders for semantics, the authors apply contrastive learning to align these representations. The results demonstrate that this alignment significantly enhances cross-modal retrieval performance, highlighting the importance of explicit representation learning in bridging the gap between syntax and semantics in scholarly communication.
A surprising representation mismatch between syntax and semantics in scientific formulae can be effectively bridged through contrastive learning, enhancing retrieval performance.
Scientific formulae are a fundamental component of scholarly communication, yet their dual nature -- as structured syntax and carriers of semantics -- remains underexplored in scholarly information retrieval. Although prior studies show that jointly modeling syntactic and semantic modalities improves retrieval performance, the relationship between their underlying representations has not been systematically investigated. In this work, we empirically study cross-modal correspondence between formula syntax and semantics. We find that their native representation spaces exhibit extremely weak observable correspondence despite strong latent correlation, indicating a substantial representation mismatch between the two modalities. We further evaluate whether this mismatch can be reduced using standard representation learning and alignment techniques. We represent syntactic structure using graph-based encoders and semantic information using text-based encoders, then apply contrastive learning to induce a shared representation space. Results show that the learned alignment substantially improves cross-modal retrieval, suggesting that explicit representation learning can recover correspondence absent from the original representation spaces.
