Search papers, labs, and topics across Lattice.
This paper addresses the pervasive issue of gender bias in machine translation from English to Romanian by developing a hybrid pipeline that integrates large language model (LLM)-based gender classification with neural machine translation (NMT). By fine-tuning an LLM to detect intended gender and incorporating inline gender hint tags, the authors enhance the performance of a Transformer model to produce morphologically accurate Romanian translations. Their approach yields a remarkable improvement of over 40 percentage points in gender accuracy on established benchmarks, marking a significant advancement in the evaluation and mitigation of gender bias in MT systems.
Gender bias in machine translation can be drastically reduced, achieving over 40 percentage points improvement in accuracy by using a novel hybrid approach that combines LLMs with tag-aware translation.
Machine translation (MT) systems often fail to correctly translate gender, especially when converting from a gender-neutral language like English to a gendered target language such as Romanian. This bias results in translations that default to masculine forms or reinforce gender stereotypes. We propose a hybrid pipeline to mitigate this issue by combining large language model (LLM)-based gender classification with neural machine translation (NMT). Our system uses a fine-tuned LLM to detect the intended gender of target words in English sentences and insert inline gender hint tags. These tagged sentences are then passed to a Transformer model fine-tuned to generate morphologically correct Romanian translations. To support this, we introduce three novel datasets for gender disambiguation and translation. Our approach improves gender accuracy on the WinoMT and WinoGender benchmarks by over 40 percentage points compared to a baseline MT system. This is the first method to explicitly address and evaluate gender bias in English-Romanian MT using both LLM inference and tag-aware translation.