Search papers, labs, and topics across Lattice.
This paper introduces the Teach-to-Reason (T2R) framework for enhancing chain-of-thought (CoT) quality in Chest X-ray visual question answering (CXR VQA) by employing comparison-based supervision through a self-improving Teacher and a competition-guided Reasoner. The method addresses the limitations of traditional reinforcement learning, which often relies on coarse answer-level rewards, by iteratively strengthening the Teacher through self-competition and optimizing the Reasoner against increasingly robust references. Experimental results demonstrate that T2R significantly outperforms existing baselines across multiple CXR VQA benchmarks, highlighting the effectiveness of controlled comparison-based supervision in improving reasoning capabilities.
Comparison-based supervision can drastically enhance reasoning quality in medical AI, outperforming traditional reward systems.
Chest X-ray visual question answering (CXR VQA) requires models not only to predict correct answers, but also to produce reliable medical reasoning. However, existing reinforcement-learning-based training typically relies on answer-level rewards, which are often too coarse to improve chain-of-thought (CoT) quality and can become ineffective when group-level advantages collapse to zero. We propose \textbf{Teach-to-Reason (T2R)}, a framework that introduces comparison-based supervision into CoT optimization through a self-improving \emph{Teacher} and a competition-guided \emph{Reasoner}. As the Teacher is iteratively strengthened via self-competition, the Reasoner is optimized against progressively stronger Teacher-generated references. We further introduce a case-wise reward design that preserves the original reward-induced positive/negative partition when it is informative, and restores supervision from competition scores when the original reward signal degenerates. Experiments on multiple CXR open-ended VQA benchmarks show that T2R consistently outperforms strong baselines, indicating that comparison-based supervision, when integrated in a controlled and principled manner, provides a more effective training signal for reasoning optimization.
