Search papers, labs, and topics across Lattice.
This paper introduces Switch-Reasoner, a GRPO-based framework that enables Multimodal Large Language Models (MLLMs) to dynamically choose between direct answering and explicit reasoning based on the complexity of the input. By incorporating a dual-level regulation mechanism, the model stabilizes its decision-making process, balancing the use of Thinking Mode and Direct Mode while providing sample-level supervision. Experiments across 11 multimodal tasks demonstrate that Switch-Reasoner significantly reduces unnecessary reasoning, achieving a superior accuracy-efficiency trade-off compared to traditional fixed paradigms.
Switch-Reasoner reveals that adaptive reasoning selection can enhance MLLM performance by reducing unnecessary cognitive load while maintaining accuracy.
Multimodal Large Language Models (MLLMs) often follow a fixed Think-then-Answer paradigm, which is inefficient in heterogeneous multitask settings because simple inputs may not require explicit reasoning while difficult ones can benefit substantially from it. Learning when to think is also unstable during post-training, where imbalanced rollouts can drive the model toward always-thinking or always-direct behavior. We propose Switch-Reasoner, a GRPO-based framework that learns to adaptively select reasoning modes for MLLMs. It treats thinking as a virtual tool invocation and allows the model to either answer directly or invoke explicit reasoning before answering. To stabilize this decision, we introduce a dual-level regulation mechanism that balances the overall use of Thinking Mode and Direct Mode while providing sample-level supervision based on the relative benefit of the two choices. Experiments on 11 multimodal tasks show that Switch-Reasoner reduces unnecessary reasoning while maintaining strong performance, achieving a better accuracy-efficiency trade-off.
