Search papers, labs, and topics across Lattice.
This paper audits cultural inclusivity in LLMs by examining metaphor generation across five cultural settings. They find that LLMs often exhibit stereotyped metaphor usage and Western defaultism, suggesting a tendency towards cultural translation rather than genuine culture-aware reasoning. The study highlights that simply prompting an LLM with a cultural identity does not ensure culturally grounded reasoning.
LLMs aren't culture-aware reasoners, but biased translators: they generate stereotyped metaphors and default to Western perspectives even when prompted with specific cultural identities.
Large language models (LLMs) are often described as multilingual because they can understand and respond in many languages. However, speaking a language is not the same as reasoning within a culture. This distinction motivates a critical question: do LLMs truly conduct culture-aware reasoning? This paper presents a preliminary computational audit of cultural inclusivity in a creative writing task. We empirically examine whether LLMs act as culturally diverse creative partners or merely as cultural translators that leverage a dominant conceptual framework with localized expressions. Using a metaphor generation task spanning five cultural settings and several abstract concepts as a case study, we find that the model exhibits stereotyped metaphor usage for certain settings, as well as Western defaultism. These findings suggest that merely prompting an LLM with a cultural identity does not guarantee culturally grounded reasoning.
Amazon Science