Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces the concept of "Mathematical Primitives" and a novel benchmark, \hlei{}, to systematically diagnose structural mathematical understanding in LLMs across four dimensions: Discovery, Generation, Digestion, and Execution. Findings reveal that solution accuracy obscures varied capability profiles, with Discovery emerging as the primary bottleneck, and that failures in this primitive are particularly reparable. A primitive-privileged self-distillation framework, \abs{}, is then proposed and validated to effectively transfer primitive-guided reasoning, leading to consistent improvements in mathematical reasoning.
LLMs' impressive math performance hides a critical "Discovery" bottleneck, but targeting this primitive via self-distillation unlocks significant latent reasoning capacity.
While Large Language Models (LLMs) have demonstrated striking capabilities on frontier mathematical problems, it remains unclear whether they possess the structural mathematical understanding underlying their solutions. In this paper, we take a first step toward systematically studying mathematical understanding in LLMs, from diagnosing its distinct capabilities to leveraging these findings to improve post-training. First, we introduce the notion of Mathematical Primitive to probe structural mathematical understanding and propose \hlei{}, a novel benchmark that evaluates mathematical reasoning along four distinct dimensions: Discovery, Generation, Digestion, and Execution. Second, our systematic diagnosis shows that solution accuracy masks distinct capability profiles, primitives unlock substantial latent execution capacity, and Discovery is the dominant bottleneck in mathematical reasoning. Our post-training analysis further shows that discovery-limited failures are particularly amenable to repair. Finally, building on these findings, we introduce \abs{}, a primitive-privileged self-distillation framework that selectively transfers primitive-guided reasoning into the student model. Extensive experiments demonstrate that \abs{} consistently improves mathematical reasoning over baselines across model scales and challenging benchmarks.