Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study evaluates the performance of three machine translation (MT) systems—DeepL, eTranslation, and Systran—alongside two distinct groups of post-editors: linguists/translators and NLP experts, focusing on specialized translation from English to French. By employing an error annotation framework tailored for MT and post-editing, the research identifies significant variances in translation quality, particularly regarding terminological accuracy and fluency. The findings underscore the critical role of domain expertise in specialized translation and reveal the inconsistent performance of MT systems in language for specific purposes (LSP).
Terminological accuracy and fluency in specialized translation vary dramatically depending on the MT system and the post-editor's background.
This article aims to evaluate the quality of machine translation (MT) and post-editing (PE) in the context of specialised translation from English into French. Three MT systems (DeepL, eTranslation and Systran) were compared, and two groups of post-editors -linguists/translators and NLP experts -were asked to perform post-editing. Translation assessment is based on error annotation using an error typology adapted to MT and PE evaluation. The results reveal significant differences between the three MT systems and the two groups of post-editors, particularly in terms of terminological accuracy and fluency. This study highlights the importance of domain knowledge in specialised translation, as well as the limitations and variable performance of MT systems in language for specific purposes (LSP).