Search papers, labs, and topics across Lattice.
Riazi-8B is an Urdu large language model specifically designed to enhance mathematical reasoning, addressing the limitations of existing models that primarily rely on English data. The model was developed through a two-step adaptation process involving continued pre-training on Urdu Wikipedia and supervised fine-tuning using Urdu Chain-of-Thought data from GSM8K. Evaluation against existing Urdu instruction-tuned models revealed significant improvements in answer correctness, reasoning quality, and overall response completeness, showcasing the effectiveness of targeted adaptation for low-resource languages.
Riazi-8B outperforms existing Urdu models in mathematical reasoning, proving that targeted language adaptation can bridge the gap in low-resource AI applications.
Recent LLMs demonstrate strong mathematical reasoning capabilities, but existing gains rely heavily on English-centric training resources and benchmarks. As a result, reasoning performance degrades substantially in low-resource languages such as Urdu, where reasoning-oriented datasets and adapted models remain scarce. Urdu lacks both reasoning-oriented resources and models adapted for multi-step mathematical problem solving, limiting the applicability of recent progress to Urdu-speaking users. We address this gap through Riazi-8B, an Urdu mathematical reasoning model developed through a two-step adaptation process comprising continued pre-training on Urdu Wikipedia and supervised fine-tuning on Urdu Chain-of-Thought data derived from GSM8K. We evaluate Riazi-8B on MGSM-Urdu against existing Urdu instruction-tuned models. Our results show consistent improvements in answer correctness, reasoning quality, response completeness, and Urdu generation. Our findings demonstrate that combining Urdu language adaptation with reasoning-focused fine-tuning is an effective strategy for extending mathematical reasoning capabilities to low-resource languages.
