Search papers, labs, and topics across Lattice.
This study introduces a model-agnostic framework to analyze the context sensitivity of translation tokens by employing measures of fertility and entropy derived from word alignments. The findings reveal that function words exhibit significant reductions in fertility when context is applied, while content words maintain stable fertility levels, indicating that context primarily helps resolve ambiguity rather than introducing new information. This research provides a foundational understanding of how context is utilized in human translation, offering a benchmark for assessing machine translation systems' performance in mimicking human-like context usage.
Context selectively shifts generative responsibility in translation, with function words relying heavily on surrounding sentences while content words remain stable.
When humans translate, not every word depends equally on the surrounding context. Some tokens, particularly function words like pronouns and auxiliaries, rely heavily on preceding or following sentences, while others, such as proper nouns, do not. Understanding this inherent context sensitivity is essential for evaluating whether machine translation systems use context in human-like ways. However, existing approaches to analysing context usage rely on discourse-specific test sets or model internals, making them narrow or model-dependent. We propose a post-hoc, model-agnostic framework to quantify context sensitivity at lexical and syntactic levels using two measures derived from word alignments: fertility (number of target tokens generated per source token) and entropy (stability of fertility patterns across contexts). Using reference translations for three language pairs (German $\leftrightarrow$ English, English $\rightarrow$ Hindi) under four context conditions, we show that context selectively redistributes generative responsibility from source to context tokens without altering overall fertility. Function words show the largest fertility reductions, while content words remain stable, suggesting that context resolves ambiguity rather than adding new information. Our framework provides a ground-truth characterisation of selective context usage in human translation, establishing a diagnostic baseline for evaluating machine translation models.
