Search papers, labs, and topics across Lattice.
This paper introduces credit-addressable reasoning, a novel framework that enhances visual language models (VLMs) by allowing them to assign learning credit based on semantic units during inference. By implementing this approach with Code-CoT and CE-GRPO, the authors demonstrate significant improvements in multimodal geometry reasoning, achieving an average accuracy of 76.04 across nine benchmarks. The findings indicate that the method's effectiveness increases with the complexity of reasoning tasks, underscoring the importance of co-designing representation and optimization strategies.
Credit-addressable reasoning boosts multimodal geometry accuracy by over 8 points, revealing the critical role of structured learning in complex tasks.
Multimodal geometry reasoning requires VLMs to extract precise visual relations and preserve them through multi-step deduction. Existing free-form traces obscure the decisions that determine the answer, and trajectory-level reinforcement learning distributes a single terminal signal across the entire response. We introduce credit-addressable reasoning, in which the semantic units exposed during inference also define where learning compares alternatives and assigns credit. We instantiate this principle with Code-CoT, which retains the diagram, represents visual relations as line-addressable executable code, and organizes reasoning into typed events, and CE-GRPO, which selects event boundaries using structural priors and type-normalized entropy, samples complete continuations from shared prefixes, and converts outcome differences into localized advantages. Across nine geometry benchmarks, CE-GRPO achieves an average accuracy of 76.04, outperforming Qwen3-VL-8B and trajectory-level GRPO by $8.09$ and 3.43 points, respectively. Its relative advantage increases with the number of intermediate events, demonstrating the value of representation--optimization co-design for long, dependency-heavy multimodal reasoning.
Microsoft Research
Tsinghua AI