Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study evaluates how large language models (LLMs) maintain culturally grounded meanings when generating narratives from semantically equivalent proverbs across 15 languages. By employing a multilingual framework with 414 proverbs and generating 13,000 narratives, the research reveals that while LLMs largely preserve semantic meaning, they also redistribute aspects like agency and narrative structure. The findings highlight significant inter-model convergence, suggesting that multilingual LLMs share semantic abstractions despite differences in architecture and language, calling for more nuanced evaluations of cultural grounding in AI narratives.
Cross-lingual prompting in LLMs preserves proverb-level meaning but alters narrative agency and structure, revealing hidden complexities in cultural representation.
The evaluation of cultural grounding context becomes complex when multiple cultures convey the same moral lesson. This challenge is particularly relevant to large language models (LLMs), which produce narratives across a wide range of languages and cultural contexts. However, it remains uncertain whether these models preserve culturally grounded meaning when equivalent moral lessons are conveyed through distinct cultural forms. This study introduces a multilingual evaluation narrative framework that integrates a cross-linguistic collection of 414 proverbs spanning 15 languages and uses four LLMs to generate 13k narratives. By employing semantically equivalent proverbs as culturally grounded prompts, the analysis assesses whether models preserve meaning across languages, how cross-lingual conditioning influences narrative realization, and whether different model families converge on similar interpretations. Results indicate that cross-lingual prompting largely preserves proverb-level semantic meaning while systematically redistributing agency, social positioning, and narrative structure. Additionally, strong inter-model convergence is observed in both monolingual and cross-lingual settings, suggesting that multilingual LLMs rely on shared semantic abstractions despite architectural and linguistic differences. These findings shed light on the need for more comprehensive evaluations of cultural grounding. Relying exclusively on semantic similarity in multilingual narrative assessments may overestimate cultural preservation by neglecting culturally meaningful variations in narrative expression.