Search papers, labs, and topics across Lattice.
The paper introduces a self-supervised framework to improve cultural alignment in LLMs by leveraging multilingual self-consistency. The method identifies reliable cultural responses across languages and uses a self-critique mechanism to transfer knowledge to weaker languages. Experiments on the BLEnD benchmark show a 5.03% improvement on English queries by surfacing and propagating latent cultural knowledge across languages using only self-generated data.
LLMs already know more about diverse cultures than you think; this paper unlocks that knowledge by prompting in multiple languages and aligning the responses.
Although Large Language Models (LLMs) demonstrate strong capabilities across various tasks, they exhibit significant performance discrepancies across languages. While prompting LLMs in English typically yields the highest general performance, it often induces a Western-centric bias, hindering the model's ability to accurately reflect diverse cultural knowledge. We hypothesize that LLMs already possess rich cultural knowledge embedded within local-language representations, but fail to retrieve it when prompted in English. To bridge this cross-lingual knowledge gap, we propose a novel self-supervised framework. Our method leverages multilingual self-consistency to identify the most reliable cultural responses across languages, combined with a self-critique mechanism to transfer this knowledge to the weaker language. Evaluations on the BLEnD benchmark demonstrate that our approach significantly improves cultural alignment-boosting performance on English queries by an average of 5.03%-relying entirely on self-generated data. Ultimately, our work demonstrates that latent cultural knowledge can be successfully surfaced and propagated across languages, enabling more culturally equitable and consistent LLMs.
NUS