Search papers, labs, and topics across Lattice.
The paper introduces GeoMathCode, a framework using programmatic representations as intermediate visual outputs to enhance MLLMs' geometry problem-solving capabilities. They analyze the latent space of reasoning and code generation, finding that these steps can be disentangled. Supervised fine-tuning improves the structure and informativeness of the reasoning manifold, and hierarchical syntactic code structures contain more mathematical symbolic information than visual representations.
Code isn't just for computation: it's a better latent representation of mathematical concepts than pure visuals, and can be used to boost geometric reasoning in MLLMs.
Mathematical reasoning is a hallmark of human intelligence, requiring logical deduction, symbolic manipulation, and abstract thinking. Recent multimodal large language models (MLLMs) have demonstrated strong performance on geometry problems through multi-step reasoning. To better emulate human problem-solving, intermediate steps can incorporate auxiliary visual constructions, such as additional lines or points, which improve geometric interpretation and educational clarity. In this work, we introduce the GeoMathCode, where programmatic representations serve as intermediate visual outputs. We further conduct an in-depth analysis of the underlying reasoning geometry. Experimental results show that reasoning and code generation steps can be disentangled in the latent space, while supervised fine-tuning (SFT) makes the reasoning manifold more structured and informative. Moreover, hierarchical syntactic code structures emerge as disentangled latent subspaces, and contain more mathematical symbolic information than visual representations.
