Search papers, labs, and topics across Lattice.
This study evaluates the effectiveness of reinforcement learning and supervised fine-tuning in enhancing the mathematical reasoning capabilities of the Qwen2.5-3B-Base model for signal processing tasks. By applying two training paradigms鈥攄irect reinforcement learning on WirelessMATHBench-XL and supervised fine-tuning followed by reinforcement learning鈥攖he authors benchmark various optimization strategies. The findings reveal that the best model achieves an accuracy of 39.12%, significantly improving upon the untrained baseline performance of 12.37%, thus highlighting the potential of tailored training approaches for complex signal reasoning tasks.
Achieving over three times the accuracy of an untrained model, this research uncovers the transformative potential of domain-specific training in signal mathematical reasoning.
Post-training with supervised chain-of-thought fine-tuning and reinforcement learning from verifiable rewards has substantially improved the mathematical reasoning capabilities of large language models (LLMs). However, their application to signal processing problems remains relatively under-explored. This report investigates reinforcement fine-tuning strategies for adapting Qwen2.5-3B-Base to graduate-level signal mathematical problems from WirelessMATHBench-XL, a comprehensive benchmark for mathematical reasoning in this domain. We examine two training paradigms: (i) direct reinforcement learning (RL) on WirelessMATHBench-XL with verifiable rewards; and (ii) supervised fine-tuning (SFT) on a distilled wireless-domain chain-of-thought corpus, followed by the same domain-specific RL stage. Across both paradigms, we benchmark Group Relative Policy Optimization (GRPO), Group Sequence Policy Optimization (GSPO), and Geometric-Mean Policy Optimization (GMPO). We aim to assess whether domain-aware CoT SFT serves as an effective initialization for subsequent RL, and whether GSPO or GMPO offer advantages in stability or accuracy over GRPO for signal reasoning tasks. Our best model achieves an overall accuracy of 39.12\%, representing a more than threefold improvement over the untrained Base model (12.37\%).
