Search papers, labs, and topics across Lattice.
BabelJudge is an open-source benchmark designed to assess the reliability of LLMs as judges across various languages and evaluation scenarios, addressing systematic biases that traditional accuracy metrics overlook. By employing a novel gold-labeling method based on controlled perturbations, it quantifies biases such as position, verbosity, and cross-lingual degradation without the need for human annotations. Evaluation of the Qwen2.5-7B-Instruct-4bit model reveals significant reliability issues, particularly in lower-resource languages like Swahili, where the reliability score drops sharply, highlighting the inadequacy of raw accuracy metrics in capturing true performance.
LLM judges exhibit alarming biases that raw accuracy metrics fail to reveal, with reliability scores plummeting in lower-resource languages.
LLM-as-a-judge has become the dominant approach to scalable evaluation in NLP pipelines, yet judges themselves carry systematic biases that raw accuracy hides: they favor responses placed in slot A (position bias), they prefer longer responses regardless of quality (verbosity bias), and their reliability degrades sharply in lower-resource languages. We introduce BabelJudge, an open-source benchmark and reliability audit framework that measures all four failure modes -- position bias, verbosity bias, order inconsistency, and cross-lingual degradation -- on any judge model, without requiring human preference labels. The key insight is gold-labelling by degradation: starting from a high-quality reference response and applying a controlled perturbation yields a pairwise item whose gold label is known by construction, eliminating annotation cost. We evaluate Qwen2.5-7B-Instruct-4bit across English, Hindi, Arabic, and Swahili and find that our composite bias-penalised reliability score drops from 0.714 in Hindi to 0.550 in Swahili, a gap that raw accuracy (0.835 vs. 0.660) understates. Swahili order consistency collapses to 0.480, meaning judge verdicts are near-random under slot-order swaps -- a failure mode invisible to accuracy alone. We further extend the framework to agentic evaluation via nine trajectory-level perturbations (argument corruption, tool swaps, hallucinated calls, missing steps) and three new metrics: tool accuracy, hallucination detection rate, and trajectory-length bias. BabelJudge is released as a Python package supporting 11 judge backends. Code: https://github.com/Shreyaskc/BabelJudge
