Muhammad Alqurishi

Measuring deep Arabic cultural and factual knowledge no longer requires laborious manual curation: dynamically generated Wikipedia probes track model capabilities just as reliably as expensive hand-crafted benchmarks.

This work constructed a large-scale Arabic Speech Question-Answering (SQA) corpus comprising over 1.5 million training samples to allow instruction tuning over a broad range of core speech tasks and designed an evaluation framework featuring diverse tasks and tailored metrics.